Nov 02 12:16:00 devstack cinder-volume[75741]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 12:16:00 devstack cinder-volume[75741]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 12:16:00 devstack cinder-volume[75741]: we strongly recommend against using it for new projects. Nov 02 12:16:00 devstack cinder-volume[75741]: If you are already using Eventlet, we recommend migrating to a different Nov 02 12:16:00 devstack cinder-volume[75741]: framework. For more detail see Nov 02 12:16:00 devstack cinder-volume[75741]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 12:16:00 devstack cinder-volume[75741]: import eventlet # noqa Nov 02 12:16:03 devstack cinder-volume[75741]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75741) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 12:16:03 devstack cinder-volume[75741]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75741) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 12:16:03 devstack cinder-volume[75741]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75741) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 12:16:04 devstack cinder-volume[75741]: INFO dbcounter [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] Registered counter for database cinder Nov 02 12:16:04 devstack cinder-volume[75741]: DEBUG oslo_db.sqlalchemy.engines [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75741) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG dbcounter [-] [75741] Writer thread running {{(pid=75741) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 12:16:05 devstack cinder-volume[75741]: INFO cinder.rpc [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 12:16:05 devstack cinder-volume[75741]: INFO cinder.rpc [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_db.sqlalchemy.engines [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75741) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 12:16:05 devstack cinder-volume[75741]: INFO cinder.volume.manager [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] Determined volume DB was empty at startup. Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG cinder.volume.manager [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75741) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 12:16:05 devstack cinder-volume[75741]: INFO cinder.volume.manager [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 02 12:16:05 devstack cinder-volume[75741]: WARNING stevedore.named [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 12:16:05 devstack cinder-volume[75741]: WARNING castellan.key_manager [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 12:16:05 devstack cinder-volume[75741]: WARNING cinder.keymgr.conf_key_mgr [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG cinder.volume.drivers.lvm [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75741) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_concurrency.processutils [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75741) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_concurrency.processutils [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] CMD "cinder-rtstool verify" returned: 0 in 0.410s {{(pid=75741) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_db.sqlalchemy.engines [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75741) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 12:16:05 devstack cinder-volume[75741]: INFO cinder.rpc [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 02 12:16:05 devstack cinder-volume[75741]: INFO cinder.rpc [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 02 12:16:05 devstack cinder-volume[75741]: WARNING stevedore.named [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 12:16:05 devstack cinder-volume[75741]: WARNING castellan.key_manager [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 12:16:05 devstack cinder-volume[75741]: INFO cinder.volume.manager [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_db.sqlalchemy.engines [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75741) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 12:16:05 devstack cinder-volume[75741]: INFO oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] Starting 1 workers Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] Started child 75929 {{(pid=75741) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] Full set of CONF: {{(pid=75741) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] ******************************************************************************** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] Configuration options gathered from: {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] ================================================================================ {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] allow_availability_zone_fallback = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] allow_compression_on_image_upload = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] allowed_direct_url_schemes = [] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] api_rate_limit = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75929]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] auth_strategy = keystone {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] az_cache_duration = 3600 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_availability_zone = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_host = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_name = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_stats_polling_interval = 60 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backup_api_class = cinder.backup.api.API {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backup_name_template = backup-%s {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backup_use_same_host = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backup_use_temp_snapshot = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] chap_password = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] chap_username = {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cinder_internal_tenant_project_id = f5ca7796b3ac48a39c81c761860e7ead {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cinder_internal_tenant_user_id = e907082faa044005afd633b91ad8ef26 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cloned_volume_same_az = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cluster = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] compression_format = gzip {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] compute_api_class = cinder.compute.nova.API {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] config_dir = [] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] config_source = [] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] control_exchange = openstack {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] debug = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] default_availability_zone = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] default_group_type = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] default_volume_type = lvmdriver-1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] disk_geometry = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] driver_client_cert = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] driver_client_cert_key = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] driver_data_namespace = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] driver_ssl_cert_path = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] driver_ssl_cert_verify = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] driver_use_ssl = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] enable_force_upload = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] enable_new_services = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] enable_unsupported_driver = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] enforce_multipath_for_image_xfer = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] filter_function = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] glance_api_insecure = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] glance_api_servers = ['http://192.168.122.95/image'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] glance_api_ssl_compression = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] glance_ca_certificates_file = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] glance_catalog_info = image:glance:publicURL {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] glance_certfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] glance_keyfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] glance_num_retries = 3 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] glance_request_timeout = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] goodness_function = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] graceful_shutdown_timeout = 5 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] group_api_class = cinder.group.api.API {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] host = devstack {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] image_compress_on_upload = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] image_conversion_address_space_limit = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] image_conversion_cpu_limit = 60 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] image_conversion_disable = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] image_introspection_address_space_limit = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] image_introspection_cpu_limit = 60 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] image_upload_use_cinder_backend = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] image_upload_use_internal_tenant = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75929]: INFO cinder.volume.manager [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] image_volume_cache_enabled = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] image_volume_cache_max_count = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] image_volume_cache_max_size_gb = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] image_volume_cache_promote_across_pools = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] init_host_max_objects_retrieval = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] instance_format = [instance: %(uuid)s] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] iscsi_target_flags = {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] iscsi_write_cache = on {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] iser_helper = tgtadm {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] iser_ip_address = 192.168.122.95 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] iser_port = 3260 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] log_color = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] log_config_append = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] log_dir = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] log_file = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] log_options = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] log_rotate_interval = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] log_rotate_interval_type = days {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] log_rotation_type = none {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] max_age = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] max_logfile_count = 30 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] max_logfile_size_mb = 200 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] max_over_subscription_ratio = 20.0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] message_reap_interval = 86400 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] message_ttl = 2592000 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] migration_create_volume_timeout_secs = 300 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] monkey_patch = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] monkey_patch_modules = [] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] my_ip = 192.168.122.95 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] no_snapshot_gb_quota = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] num_iser_scan_tries = 3 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] num_shell_tries = 3 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] num_volume_device_scan_tries = 3 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:05 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] nvmeof_conn_info_version = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] nvmet_ns_id = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] nvmet_port_id = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] osapi_max_limit = 1000 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] osapi_volume_ext_list = [] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] osapi_volume_listen_port = 8776 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] osapi_volume_use_ssl = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] osapi_volume_workers = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] per_volume_size_limit = -1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] periodic_fuzzy_delay = 60 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] periodic_interval = 60 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] public_endpoint = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] publish_errors = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] quota_backup_gigabytes = 1000 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] quota_backups = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] quota_gigabytes = 1000 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] quota_groups = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] quota_snapshots = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] quota_volumes = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] rate_limit_burst = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] rate_limit_except_level = CRITICAL {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] rate_limit_interval = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] reinit_driver_count = 3 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] replication_device = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] report_discard_supported = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] report_interval = 120 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] reservation_clean_interval = 86400 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] reservation_expire = 86400 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] reserved_image_namespaces = [] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] reserved_percentage = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] rpc_response_timeout = 120 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] run_external_periodic_tasks = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] scst_target_driver = iscsi {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] scst_target_iqn_name = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] service_down_time = 720 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] shell_completion = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] snapshot_name_template = snapshot-%s {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] snapshot_same_host = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] split_loggers = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] state_path = /opt/stack/data/cinder {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] storage_availability_zone = nova {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] storage_protocol = iSCSI {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] syslog_log_facility = LOG_USER {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] target_helper = lioadm {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] target_ip_address = 192.168.122.95 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] target_port = 3260 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] target_protocol = iscsi {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] target_secondary_ip_addresses = [] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] trace_flags = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] transport_url = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] until_refresh = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] use_chap_auth = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] use_default_quota_class = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] use_journal = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] use_json = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] use_multipath_for_image_xfer = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] use_stderr = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] use_syslog = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] verify_glance_signatures = enabled {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] volume_api_class = cinder.volume.api.API {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] volume_backend_name = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] volume_clear = zero {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] volume_clear_ionice = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] volume_clear_size = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] volume_copy_bps_limit = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] volume_dd_blocksize = 1M {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] volume_name_template = volume-%s {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] volume_service_inithost_offload = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] volume_usage_audit_period = month {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] zoning_mode = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_concurrency.disable_process_locking = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.auth_section = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.auth_type = password {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.auth_version = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.cache = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.certfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.include_service_catalog = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.insecure = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.interface = public {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.keyfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.memcache_password = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.memcache_username = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.region_name = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.service_type = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.95/identity {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.backend = dogpile.cache.null {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.backend_argument = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.backend_expiration_time = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.config_prefix = cache.oslo {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.debug_cache_backend = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.enable_retry_client = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.enable_socket_keepalive = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.enabled = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.expiration_time = 600 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.hashclient_retry_attempts = 2 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.memcache_dead_retry = 300 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.memcache_pool_maxsize = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.memcache_sasl_enabled = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.password = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.proxies = [] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.redis_db = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.redis_server = localhost:6379 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.retry_attempts = 2 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.retry_delay = 0.0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.socket_keepalive_count = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.socket_keepalive_idle = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.socket_keepalive_interval = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.socket_timeout = 1.0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.tls_allowed_ciphers = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.tls_cafile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.tls_certfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.tls_enabled = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.tls_keyfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cache.username = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] coordination.backend_url = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] database.asyncio_connection = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] database.asyncio_slave_connection = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] database.backend = sqlalchemy {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] database.connection = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] database.connection_debug = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] database.connection_parameters = {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] database.connection_recycle_time = 3600 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] database.connection_trace = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] database.db_inc_retry_interval = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] database.db_max_retries = 20 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] database.db_max_retry_interval = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] database.db_retry_interval = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] database.max_overflow = 50 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] database.max_pool_size = 5 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] database.max_retries = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] database.mysql_wsrep_sync_wait = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] database.pool_timeout = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] database.retry_interval = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] database.slave_connection = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] database.sqlite_synchronous = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] database.synchronous_reader = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] database.use_db_reconnect = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_tracing.insecure = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] profiler.connection_string = messaging:// {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] profiler.enabled = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] profiler.es_doc_type = notification {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] profiler.es_scroll_size = 10000 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] profiler.es_scroll_time = 2m {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] profiler.filter_error_trace = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] profiler.hmac_keys = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] profiler.sentinel_service_name = mymaster {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] profiler.socket_timeout = 0.1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] profiler.trace_requests = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] profiler.trace_sqlalchemy = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] profiler_jaeger.process_tags = {} {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] profiler_jaeger.service_name_prefix = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] profiler_otlp.service_name_prefix = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_policy.enforce_new_defaults = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_policy.policy_default_rule = default {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_policy.policy_file = policy.yaml {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] privsep_osbrick.group = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] privsep_osbrick.helper_command = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] privsep_osbrick.user = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cinder_sys_admin.group = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cinder_sys_admin.helper_command = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] cinder_sys_admin.user = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] service_user.auth_section = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] service_user.auth_type = password {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] service_user.cafile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] service_user.certfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] service_user.collect_timing = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] service_user.insecure = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] service_user.keyfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack sudo[75981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] service_user.send_service_user_token = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] service_user.split_loggers = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] service_user.timeout = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] service_user.tls_ciphers = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] service_user.tls_min_version = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack sudo[75981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] glance.auth_section = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] glance.auth_type = password {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] glance.certfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] glance.collect_timing = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] glance.insecure = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] glance.keyfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] glance.region_name = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] glance.split_loggers = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] glance.timeout = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] glance.tls_ciphers = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] glance.tls_min_version = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.backend_availability_zone = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.chap_password = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.chap_username = {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.disk_geometry = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.driver_client_cert = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.driver_client_cert_key = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.driver_data_namespace = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.driver_use_ssl = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.extra_capabilities = {} {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.filter_function = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.goodness_function = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.image_volume_cache_promote_across_pools = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.iscsi_target_flags = {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.iscsi_write_cache = on {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.iser_helper = tgtadm {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.iser_ip_address = 192.168.122.95 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.iser_port = 3260 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.lvm_share_target = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.lvm_type = auto {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.num_shell_tries = 3 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.replication_device = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.report_discard_supported = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.reserved_percentage = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.target_helper = tgtadm {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.target_ip_address = 192.168.122.95 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.target_port = 3260 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.target_protocol = iscsi {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.trace_flags = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.unique_fqdn_network = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.use_chap_auth = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.volume_backend_name = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.volume_clear = zero {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.volume_clear_ionice = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.volume_clear_size = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_reports.file_event_handler = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_reports.log_dir = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.backend_host = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.chap_password = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.chap_username = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.disk_geometry = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.driver_client_cert = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.extra_capabilities = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.filter_function = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.goodness_function = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.image_volume_cache_promote_across_pools = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.iser_helper = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.iser_ip_address = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.iser_port = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.lvm_share_target = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.lvm_type = auto {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.num_shell_tries = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.replication_device = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.report_discard_supported = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.reserved_percentage = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.scst_target_driver = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.storage_protocol = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.target_helper = lioadm {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.target_ip_address = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.target_port = 3260 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.trace_flags = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.use_chap_auth = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.volume_clear = zero {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.volume_clear_size = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] lvmdriver-1.volumes_dir = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.ssl = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_notifications.driver = [] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_notifications.retry = -1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] key_manager.fixed_key = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] barbican.barbican_api_version = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] barbican.barbican_endpoint = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] barbican.barbican_endpoint_type = public {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] barbican.barbican_region_name = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] barbican.cafile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] barbican.certfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] barbican.collect_timing = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] barbican.insecure = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] barbican.keyfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] barbican.number_of_retries = 60 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] barbican.retry_delay = 1 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] barbican.send_service_user_token = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] barbican.split_loggers = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] barbican.timeout = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] barbican.tls_ciphers = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] barbican.tls_min_version = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] barbican.verify_ssl = True {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] barbican.verify_ssl_path = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] barbican_service_user.auth_section = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] barbican_service_user.auth_type = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] barbican_service_user.cafile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] barbican_service_user.certfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] barbican_service_user.collect_timing = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] barbican_service_user.insecure = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] barbican_service_user.keyfile = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] barbican_service_user.split_loggers = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] barbican_service_user.timeout = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] barbican_service_user.tls_ciphers = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] barbican_service_user.tls_min_version = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] vault.approle_role_id = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] vault.approle_secret_id = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] vault.auth_method = approle {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] vault.auth_path = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] vault.kv_mountpoint = secret {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] vault.kv_path = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] vault.kv_version = 2 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] vault.namespace = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] vault.root_token_id = **** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] vault.ssl_ca_crt_file = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] vault.timeout = 60.0 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] vault.token_file = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] vault.token_role = None {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] vault.use_ssl = False {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:16:06 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] ******************************************************************************** {{(pid=75741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 12:16:06 devstack sudo[75981]: pam_unix(sudo:session): session closed for user root Nov 02 12:16:06 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.332s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:16:06 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:16:06 devstack sudo[76079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 12:16:06 devstack sudo[76079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:16:06 devstack sudo[76079]: pam_unix(sudo:session): session closed for user root Nov 02 12:16:06 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.251s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:16:06 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:16:06 devstack cinder-volume[75929]: INFO cinder.brick.local_dev.lvm [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 02 12:16:06 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:16:06 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:16:06 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:16:06 devstack sudo[76165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 12:16:06 devstack sudo[76165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:16:06 devstack sudo[76165]: pam_unix(sudo:session): session closed for user root Nov 02 12:16:06 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:16:06 devstack cinder-volume[75929]: DEBUG cinder.brick.local_dev.lvm [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75929) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 02 12:16:06 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:16:06 devstack sudo[76246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 12:16:06 devstack sudo[76246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:16:07 devstack sudo[76246]: pam_unix(sudo:session): session closed for user root Nov 02 12:16:07 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.523s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:16:07 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:16:07 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:16:07 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:16:07 devstack sudo[76407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 12:16:07 devstack sudo[76407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:16:07 devstack sudo[76407]: pam_unix(sudo:session): session closed for user root Nov 02 12:16:07 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.297s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:16:07 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:16:07 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:16:07 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:16:07 devstack sudo[76487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 02 12:16:07 devstack sudo[76487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:16:08 devstack sudo[76487]: pam_unix(sudo:session): session closed for user root Nov 02 12:16:08 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.261s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:16:08 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:16:08 devstack sudo[76495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 12:16:08 devstack sudo[76495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:16:08 devstack sudo[76495]: pam_unix(sudo:session): session closed for user root Nov 02 12:16:08 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.344s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:16:08 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:16:08 devstack sudo[76574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 12:16:08 devstack sudo[76574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:16:08 devstack sudo[76574]: pam_unix(sudo:session): session closed for user root Nov 02 12:16:08 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:16:08 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:16:08 devstack sudo[76583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 12:16:08 devstack sudo[76583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:16:09 devstack sudo[76583]: pam_unix(sudo:session): session closed for user root Nov 02 12:16:09 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:16:09 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:16:09 devstack sudo[76666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 12:16:09 devstack sudo[76666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:16:09 devstack sudo[76666]: pam_unix(sudo:session): session closed for user root Nov 02 12:16:09 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:16:09 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:16:09 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:16:09 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:16:09 devstack sudo[76670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 12:16:09 devstack sudo[76670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:16:09 devstack sudo[76670]: pam_unix(sudo:session): session closed for user root Nov 02 12:16:09 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.311s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:16:09 devstack cinder-volume[75929]: INFO cinder.volume.drivers.lvm [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 02 12:16:09 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:16:09 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:16:09 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:16:09 devstack sudo[76674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 12:16:09 devstack sudo[76674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:16:09 devstack sudo[76674]: pam_unix(sudo:session): session closed for user root Nov 02 12:16:09 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.280s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:16:09 devstack cinder-volume[75929]: DEBUG cinder.volume.drivers.lvm [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Updating volume stats {{(pid=75929) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 12:16:09 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:16:09 devstack sudo[76683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 12:16:09 devstack sudo[76683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:16:10 devstack sudo[76683]: pam_unix(sudo:session): session closed for user root Nov 02 12:16:10 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:16:10 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:16:10 devstack sudo[76688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 12:16:10 devstack sudo[76688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:16:10 devstack sudo[76688]: pam_unix(sudo:session): session closed for user root Nov 02 12:16:10 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.315s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:16:10 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:16:10 devstack sudo[76691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 12:16:10 devstack sudo[76691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:16:10 devstack sudo[76691]: pam_unix(sudo:session): session closed for user root Nov 02 12:16:10 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.288s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:16:10 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:16:10 devstack sudo[76694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 12:16:10 devstack sudo[76694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:16:11 devstack sudo[76694]: pam_unix(sudo:session): session closed for user root Nov 02 12:16:11 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:16:11 devstack cinder-volume[75929]: INFO cinder.volume.driver [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Driver hasn't implemented _init_vendor_properties() Nov 02 12:16:11 devstack cinder-volume[75929]: DEBUG cinder.volume.driver [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75929) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:889}} Nov 02 12:16:11 devstack cinder-volume[75929]: DEBUG oslo_db.sqlalchemy.engines [None req-37051239-9769-4242-aec3-b7134d36b765 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75929) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 12:16:11 devstack cinder-volume[75929]: DEBUG dbcounter [-] [75929] Writer thread running {{(pid=75929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 12:16:11 devstack cinder-volume[75929]: DEBUG cinder.db.api [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Building query based on filter {{(pid=75929) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 02 12:16:11 devstack cinder-volume[75929]: DEBUG cinder.image.image_utils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75929) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 02 12:16:11 devstack cinder-volume[75929]: INFO cinder.keymgr.migration [None req-3f25f10d-7985-4f28-b2b5-8e23ed46548e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 12:16:11 devstack cinder-volume[75929]: DEBUG cinder.volume.drivers.lvm [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Updating volume stats {{(pid=75929) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 12:16:11 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:16:11 devstack sudo[76699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 12:16:11 devstack sudo[76699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:16:11 devstack sudo[76699]: pam_unix(sudo:session): session closed for user root Nov 02 12:16:11 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:16:11 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:16:11 devstack sudo[76702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 12:16:11 devstack sudo[76702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:16:11 devstack sudo[76702]: pam_unix(sudo:session): session closed for user root Nov 02 12:16:11 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:16:11 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:16:11 devstack sudo[76705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 12:16:11 devstack sudo[76705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:16:12 devstack sudo[76705]: pam_unix(sudo:session): session closed for user root Nov 02 12:16:12 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.302s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:16:12 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:16:12 devstack sudo[76708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 12:16:12 devstack sudo[76708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:16:12 devstack sudo[76708]: pam_unix(sudo:session): session closed for user root Nov 02 12:16:12 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:16:12 devstack cinder-volume[75929]: DEBUG cinder.manager [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Notifying Schedulers of capabilities ... {{(pid=75929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:16:12 devstack cinder-volume[75929]: INFO cinder.volume.manager [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Driver initialization completed successfully. Nov 02 12:16:12 devstack cinder-volume[75929]: INFO cinder.manager [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Initiating service 2 cleanup Nov 02 12:16:12 devstack cinder-volume[75929]: INFO cinder.manager [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Service 2 cleanup completed. Nov 02 12:16:12 devstack cinder-volume[75929]: DEBUG cinder.service [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Creating RPC server for service cinder-volume {{(pid=75929) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 12:16:12 devstack cinder-volume[75929]: DEBUG cinder.service [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75929) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 12:16:12 devstack cinder-volume[75929]: INFO cinder.volume.manager [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 02 12:16:12 devstack cinder-volume[75929]: DEBUG cinder.volume.drivers.lvm [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Updating volume stats {{(pid=75929) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 12:16:12 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:16:12 devstack sudo[76713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 12:16:12 devstack sudo[76713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:16:12 devstack sudo[76713]: pam_unix(sudo:session): session closed for user root Nov 02 12:16:12 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:16:12 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:16:12 devstack sudo[76719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 12:16:12 devstack sudo[76719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:16:13 devstack sudo[76719]: pam_unix(sudo:session): session closed for user root Nov 02 12:16:13 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:16:13 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:16:13 devstack sudo[76722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 12:16:13 devstack sudo[76722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:16:13 devstack sudo[76722]: pam_unix(sudo:session): session closed for user root Nov 02 12:16:13 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:16:13 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:16:13 devstack sudo[76725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 12:16:13 devstack sudo[76725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:16:13 devstack sudo[76725]: pam_unix(sudo:session): session closed for user root Nov 02 12:16:13 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-37051239-9769-4242-aec3-b7134d36b765 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:16:13 devstack cinder-volume[75929]: INFO cinder.volume.manager [None req-37051239-9769-4242-aec3-b7134d36b765 None None] Driver post RPC initialization completed successfully. Nov 02 12:16:15 devstack cinder-volume[75741]: DEBUG dbcounter [-] [75741] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75741) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:16:23 devstack cinder-volume[75929]: DEBUG dbcounter [-] [75929] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:16:23 devstack cinder-volume[75929]: DEBUG dbcounter [-] [75929] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:17:13 devstack cinder-volume[75929]: DEBUG oslo_service.periodic_task [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:17:13 devstack cinder-volume[75929]: DEBUG cinder.volume.drivers.lvm [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] Updating volume stats {{(pid=75929) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 12:17:13 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:17:13 devstack sudo[78686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 12:17:13 devstack sudo[78686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:17:14 devstack sudo[78686]: pam_unix(sudo:session): session closed for user root Nov 02 12:17:14 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:17:14 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:17:14 devstack sudo[78689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 12:17:14 devstack sudo[78689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:17:14 devstack sudo[78689]: pam_unix(sudo:session): session closed for user root Nov 02 12:17:14 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:17:14 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:17:14 devstack sudo[78692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 12:17:14 devstack sudo[78692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:17:14 devstack sudo[78692]: pam_unix(sudo:session): session closed for user root Nov 02 12:17:14 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:17:14 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:17:14 devstack sudo[78695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 12:17:14 devstack sudo[78695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:17:14 devstack sudo[78695]: pam_unix(sudo:session): session closed for user root Nov 02 12:17:14 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:17:14 devstack cinder-volume[75929]: DEBUG cinder.manager [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] Notifying Schedulers of capabilities ... {{(pid=75929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:17:14 devstack cinder-volume[75929]: DEBUG oslo_service.periodic_task [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] Running periodic task VolumeManager._thread_info {{(pid=75929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:17:14 devstack cinder-volume[75929]: DEBUG cinder.volume.manager [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] thread count: 6 {{(pid=75929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:17:14 devstack cinder-volume[75929]: DEBUG cinder.volume.manager [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] thread info: [<_MainThread(MainThread, started 140306305278080)>, , , , , ] {{(pid=75929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:18:13 devstack cinder-volume[75929]: DEBUG oslo_service.periodic_task [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:18:13 devstack cinder-volume[75929]: DEBUG cinder.volume.drivers.lvm [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] Updating volume stats {{(pid=75929) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 12:18:13 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:18:13 devstack sudo[82048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 12:18:13 devstack sudo[82048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:18:14 devstack sudo[82048]: pam_unix(sudo:session): session closed for user root Nov 02 12:18:14 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:18:14 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:18:14 devstack sudo[82055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 12:18:14 devstack sudo[82055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:18:14 devstack sudo[82055]: pam_unix(sudo:session): session closed for user root Nov 02 12:18:14 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:18:14 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:18:14 devstack sudo[82061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 12:18:14 devstack sudo[82061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:18:14 devstack sudo[82061]: pam_unix(sudo:session): session closed for user root Nov 02 12:18:14 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:18:14 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:18:14 devstack sudo[82065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 12:18:14 devstack sudo[82065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:18:14 devstack sudo[82065]: pam_unix(sudo:session): session closed for user root Nov 02 12:18:14 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:18:14 devstack cinder-volume[75929]: DEBUG cinder.manager [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] Notifying Schedulers of capabilities ... {{(pid=75929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:18:14 devstack cinder-volume[75929]: DEBUG oslo_service.periodic_task [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] Running periodic task VolumeManager._thread_info {{(pid=75929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:18:14 devstack cinder-volume[75929]: DEBUG cinder.volume.manager [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] thread count: 6 {{(pid=75929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:18:14 devstack cinder-volume[75929]: DEBUG cinder.volume.manager [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] thread info: [<_MainThread(MainThread, started 140306305278080)>, , , , , ] {{(pid=75929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:18:23 devstack cinder-volume[75929]: DEBUG dbcounter [-] [75929] Writing DB stats cinder:SELECT=1 {{(pid=75929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:18:23 devstack cinder-volume[75929]: DEBUG dbcounter [-] [75929] Writing DB stats cinder:UPDATE=1 {{(pid=75929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:19:13 devstack cinder-volume[75929]: DEBUG oslo_service.periodic_task [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:19:13 devstack cinder-volume[75929]: DEBUG cinder.volume.drivers.lvm [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] Updating volume stats {{(pid=75929) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 12:19:13 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:19:13 devstack sudo[84188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 12:19:13 devstack sudo[84188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:19:14 devstack sudo[84188]: pam_unix(sudo:session): session closed for user root Nov 02 12:19:14 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:19:14 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:19:14 devstack sudo[84204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 12:19:14 devstack sudo[84204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:19:14 devstack sudo[84204]: pam_unix(sudo:session): session closed for user root Nov 02 12:19:14 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:19:14 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:19:14 devstack sudo[84207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 12:19:14 devstack sudo[84207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:19:14 devstack sudo[84207]: pam_unix(sudo:session): session closed for user root Nov 02 12:19:14 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:19:14 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:19:14 devstack sudo[84214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 12:19:14 devstack sudo[84214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:19:14 devstack sudo[84214]: pam_unix(sudo:session): session closed for user root Nov 02 12:19:14 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:19:14 devstack cinder-volume[75929]: DEBUG cinder.manager [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] Notifying Schedulers of capabilities ... {{(pid=75929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:20:13 devstack cinder-volume[75929]: DEBUG oslo_service.periodic_task [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:20:13 devstack cinder-volume[75929]: DEBUG cinder.volume.drivers.lvm [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] Updating volume stats {{(pid=75929) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 12:20:13 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:20:13 devstack sudo[85453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 12:20:13 devstack sudo[85453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:20:14 devstack sudo[85453]: pam_unix(sudo:session): session closed for user root Nov 02 12:20:14 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:20:14 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:20:14 devstack sudo[85456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 12:20:14 devstack sudo[85456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:20:14 devstack sudo[85456]: pam_unix(sudo:session): session closed for user root Nov 02 12:20:14 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:20:14 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:20:14 devstack sudo[85462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 12:20:14 devstack sudo[85462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:20:14 devstack sudo[85462]: pam_unix(sudo:session): session closed for user root Nov 02 12:20:14 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:20:14 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:20:14 devstack sudo[85465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 12:20:14 devstack sudo[85465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:20:14 devstack sudo[85465]: pam_unix(sudo:session): session closed for user root Nov 02 12:20:14 devstack cinder-volume[75929]: DEBUG oslo_concurrency.processutils [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75929) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:20:14 devstack cinder-volume[75929]: DEBUG cinder.manager [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] Notifying Schedulers of capabilities ... {{(pid=75929) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:20:14 devstack cinder-volume[75929]: DEBUG oslo_service.periodic_task [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] Running periodic task VolumeManager._thread_info {{(pid=75929) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:20:14 devstack cinder-volume[75929]: DEBUG cinder.volume.manager [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] thread count: 6 {{(pid=75929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:20:14 devstack cinder-volume[75929]: DEBUG cinder.volume.manager [None req-8dfb2843-dce3-4f74-820d-e5c887ef1137 None None] thread info: [<_MainThread(MainThread, started 140306305278080)>, , , , , ] {{(pid=75929) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:20:23 devstack cinder-volume[75929]: DEBUG dbcounter [-] [75929] Writing DB stats cinder:SELECT=1 {{(pid=75929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:20:23 devstack cinder-volume[75929]: DEBUG dbcounter [-] [75929] Writing DB stats cinder:UPDATE=1 {{(pid=75929) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:20:30 devstack cinder-volume[75741]: INFO oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] Caught SIGTERM, stopping children Nov 02 12:20:30 devstack cinder-volume[75741]: DEBUG oslo_concurrency.lockutils [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] Acquiring lock "singleton_lock" {{(pid=75741) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 12:20:30 devstack cinder-volume[75741]: DEBUG oslo_concurrency.lockutils [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] Acquired lock "singleton_lock" {{(pid=75741) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 12:20:30 devstack cinder-volume[75741]: DEBUG oslo_concurrency.lockutils [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] Releasing lock "singleton_lock" {{(pid=75741) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 12:20:30 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] Stop services. {{(pid=75741) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 02 12:20:30 devstack cinder-volume[75741]: DEBUG oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] Killing children. {{(pid=75741) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 02 12:20:30 devstack cinder-volume[75741]: INFO oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] Waiting on 1 children to exit Nov 02 12:20:32 devstack cinder-volume[75929]: DEBUG oslo_concurrency.lockutils [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] Acquiring lock "singleton_lock" {{(pid=75929) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 12:20:32 devstack cinder-volume[75929]: DEBUG oslo_concurrency.lockutils [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] Acquired lock "singleton_lock" {{(pid=75929) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 12:20:32 devstack cinder-volume[75929]: DEBUG oslo_concurrency.lockutils [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] Releasing lock "singleton_lock" {{(pid=75929) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 12:20:32 devstack cinder-volume[75929]: WARNING amqp [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 12:20:32 devstack cinder-volume[75929]: WARNING amqp [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 12:20:32 devstack cinder-volume[75741]: INFO oslo_service.backend._eventlet.service [None req-173b7048-1f37-415e-8da6-922f07c86c32 None None] Child 75929 exited with status 0 Nov 02 12:20:33 devstack cinder-volume[85950]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 12:20:33 devstack cinder-volume[85950]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 12:20:33 devstack cinder-volume[85950]: we strongly recommend against using it for new projects. Nov 02 12:20:33 devstack cinder-volume[85950]: If you are already using Eventlet, we recommend migrating to a different Nov 02 12:20:33 devstack cinder-volume[85950]: framework. For more detail see Nov 02 12:20:33 devstack cinder-volume[85950]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 12:20:33 devstack cinder-volume[85950]: import eventlet # noqa Nov 02 12:20:35 devstack cinder-volume[85950]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85950) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 12:20:35 devstack cinder-volume[85950]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85950) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 12:20:35 devstack cinder-volume[85950]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85950) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 12:20:35 devstack cinder-volume[85950]: INFO dbcounter [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] Registered counter for database cinder Nov 02 12:20:35 devstack cinder-volume[85950]: DEBUG oslo_db.sqlalchemy.engines [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85950) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG dbcounter [-] [85950] Writer thread running {{(pid=85950) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 12:20:36 devstack cinder-volume[85950]: INFO cinder.rpc [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 12:20:36 devstack cinder-volume[85950]: INFO cinder.rpc [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_db.sqlalchemy.engines [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85950) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 12:20:36 devstack cinder-volume[85950]: INFO cinder.volume.manager [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] Determined volume DB was empty at startup. Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG cinder.volume.manager [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85950) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 12:20:36 devstack cinder-volume[85950]: INFO cinder.volume.manager [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 02 12:20:36 devstack cinder-volume[85950]: WARNING stevedore.named [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 12:20:36 devstack cinder-volume[85950]: WARNING castellan.key_manager [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 12:20:36 devstack cinder-volume[85950]: WARNING cinder.keymgr.conf_key_mgr [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 12:20:36 devstack cinder-volume[85950]: INFO cinder.volume.manager [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_db.sqlalchemy.engines [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85950) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 12:20:36 devstack cinder-volume[85950]: INFO oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] Starting 1 workers Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] Started child 86165 {{(pid=85950) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] Full set of CONF: {{(pid=85950) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] ******************************************************************************** {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] Configuration options gathered from: {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] ================================================================================ {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] allow_availability_zone_fallback = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] allow_compression_on_image_upload = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] allowed_direct_url_schemes = [] {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[86165]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] api_rate_limit = True {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] auth_strategy = keystone {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_availability_zone = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_host = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_name = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_stats_polling_interval = 60 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backup_api_class = cinder.backup.api.API {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backup_name_template = backup-%s {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backup_use_same_host = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backup_use_temp_snapshot = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] chap_password = **** {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] chap_username = {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cinder_internal_tenant_project_id = f5ca7796b3ac48a39c81c761860e7ead {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cinder_internal_tenant_user_id = e907082faa044005afd633b91ad8ef26 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cluster = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] compression_format = gzip {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] compute_api_class = cinder.compute.nova.API {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] config_dir = [] {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] config_source = [] {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] control_exchange = openstack {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] debug = True {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] default_availability_zone = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] default_group_type = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] default_volume_type = QuobyteHD {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] disk_geometry = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] driver_client_cert = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] driver_client_cert_key = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] driver_data_namespace = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] driver_ssl_cert_path = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] driver_ssl_cert_verify = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] driver_use_ssl = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] enable_new_services = True {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] enable_unsupported_driver = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] enabled_backends = ['QuobyteHD'] {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] enforce_multipath_for_image_xfer = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] filter_function = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] glance_api_insecure = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] glance_api_servers = ['http://192.168.122.95/image'] {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] glance_api_ssl_compression = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] glance_ca_certificates_file = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] glance_catalog_info = image:glance:publicURL {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] glance_certfile = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] glance_keyfile = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] glance_num_retries = 3 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] glance_request_timeout = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] goodness_function = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] graceful_shutdown_timeout = 5 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] group_api_class = cinder.group.api.API {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] host = devstack {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] image_compress_on_upload = True {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] image_conversion_address_space_limit = 1 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] image_conversion_cpu_limit = 60 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] image_conversion_disable = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] image_introspection_address_space_limit = 1 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] image_introspection_cpu_limit = 60 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] image_upload_use_cinder_backend = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] image_upload_use_internal_tenant = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] image_volume_cache_enabled = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] image_volume_cache_max_count = 0 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] image_volume_cache_max_size_gb = 0 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] image_volume_cache_promote_across_pools = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] init_host_max_objects_retrieval = 0 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] instance_format = [instance: %(uuid)s] {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] iscsi_target_flags = {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] iscsi_write_cache = on {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] iser_helper = tgtadm {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] iser_ip_address = 192.168.122.95 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] iser_port = 3260 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] log_color = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 02 12:20:36 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.remotefs [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86165) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] log_config_append = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] log_dir = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] log_file = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] log_options = True {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] log_rotate_interval = 1 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] log_rotate_interval_type = days {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] log_rotation_type = none {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] max_age = 0 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] max_logfile_count = 30 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] max_logfile_size_mb = 200 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] max_over_subscription_ratio = 20.0 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] message_reap_interval = 86400 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] message_ttl = 2592000 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] migration_create_volume_timeout_secs = 300 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] monkey_patch = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] monkey_patch_modules = [] {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] my_ip = 192.168.122.95 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] no_snapshot_gb_quota = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] num_iser_scan_tries = 3 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] num_shell_tries = 3 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] num_volume_device_scan_tries = 3 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] nvmeof_conn_info_version = 1 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] nvmet_ns_id = 10 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] nvmet_port_id = 1 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] osapi_max_limit = 1000 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] osapi_volume_ext_list = [] {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] osapi_volume_listen_port = 8776 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] osapi_volume_use_ssl = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] osapi_volume_workers = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] per_volume_size_limit = -1 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] periodic_fuzzy_delay = 60 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] periodic_interval = 60 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] public_endpoint = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] publish_errors = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] quota_backup_gigabytes = 1000 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] quota_backups = 10 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] quota_gigabytes = 1000 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] quota_groups = 10 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] quota_snapshots = 10 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] quota_volumes = 10 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] rate_limit_burst = 0 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] rate_limit_except_level = CRITICAL {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] rate_limit_interval = 0 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] reinit_driver_count = 3 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] replication_device = **** {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] report_discard_supported = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] report_interval = 120 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] reservation_clean_interval = 86400 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] reservation_expire = 86400 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] reserved_image_namespaces = [] {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] reserved_percentage = 0 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] rpc_response_timeout = 120 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] run_external_periodic_tasks = True {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] scst_target_driver = iscsi {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] scst_target_iqn_name = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] service_down_time = 720 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] shell_completion = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] snapshot_name_template = snapshot-%s {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] split_loggers = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] state_path = /opt/stack/data/cinder {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] storage_availability_zone = nova {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] storage_protocol = iSCSI {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] syslog_log_facility = LOG_USER {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] target_helper = lioadm {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] target_ip_address = 192.168.122.95 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] target_port = 3260 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] target_protocol = iscsi {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] target_secondary_ip_addresses = [] {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] trace_flags = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] transport_url = **** {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] until_refresh = 0 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] use_chap_auth = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] use_default_quota_class = True {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] use_journal = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] use_json = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] use_multipath_for_image_xfer = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] use_stderr = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] use_syslog = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] verify_glance_signatures = enabled {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] volume_api_class = cinder.volume.api.API {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] volume_backend_name = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] volume_clear = zero {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] volume_clear_ionice = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] volume_clear_size = 0 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] volume_copy_bps_limit = 0 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] volume_dd_blocksize = 1M {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] volume_name_template = volume-%s {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] volume_service_inithost_offload = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] volume_usage_audit_period = month {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] zoning_mode = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_concurrency.disable_process_locking = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86165) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 02 12:20:36 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.quobyte [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 02 12:20:36 devstack cinder-volume[86165]: WARNING cinder.volume.drivers.quobyte [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] Running cmd (subprocess): mount.quobyte {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.auth_section = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.auth_type = password {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.auth_version = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.cache = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.certfile = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.include_service_catalog = True {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.insecure = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.interface = public {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.keyfile = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.memcache_password = **** {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.memcache_username = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.region_name = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.service_type = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.95/identity {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.backend = dogpile.cache.null {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.backend_argument = **** {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.backend_expiration_time = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.config_prefix = cache.oslo {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.debug_cache_backend = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.enable_retry_client = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.enable_socket_keepalive = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.enabled = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.expiration_time = 600 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.hashclient_retry_attempts = 2 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.memcache_dead_retry = 300 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.memcache_pool_maxsize = 10 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.memcache_sasl_enabled = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.password = **** {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.proxies = [] {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.redis_db = 0 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.redis_server = localhost:6379 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.retry_attempts = 2 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.retry_delay = 0.0 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.socket_keepalive_count = 1 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.socket_keepalive_idle = 1 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.socket_keepalive_interval = 1 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.socket_timeout = 1.0 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.tls_allowed_ciphers = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.tls_cafile = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.tls_certfile = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.tls_enabled = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.tls_keyfile = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cache.username = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] coordination.backend_url = **** {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] database.asyncio_connection = **** {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] database.asyncio_slave_connection = **** {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] database.backend = sqlalchemy {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] database.connection = **** {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] database.connection_debug = 0 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] database.connection_parameters = {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] database.connection_recycle_time = 3600 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] database.connection_trace = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] database.db_inc_retry_interval = True {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] database.db_max_retries = 20 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] database.db_max_retry_interval = 10 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] database.db_retry_interval = 1 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] database.max_overflow = 50 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] database.max_pool_size = 5 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] database.max_retries = 10 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] database.mysql_wsrep_sync_wait = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] database.pool_timeout = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] database.retry_interval = 10 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] database.slave_connection = **** {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] database.sqlite_synchronous = True {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] database.synchronous_reader = True {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] database.use_db_reconnect = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_tracing.insecure = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] profiler.connection_string = messaging:// {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] profiler.enabled = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] profiler.es_doc_type = notification {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] profiler.es_scroll_size = 10000 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] profiler.es_scroll_time = 2m {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] profiler.filter_error_trace = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] profiler.hmac_keys = **** {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] profiler.sentinel_service_name = mymaster {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] profiler.socket_timeout = 0.1 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] profiler.trace_requests = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] profiler.trace_sqlalchemy = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] profiler_jaeger.process_tags = {} {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] profiler_jaeger.service_name_prefix = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] profiler_otlp.service_name_prefix = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_policy.enforce_new_defaults = True {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_policy.policy_default_rule = default {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_policy.policy_file = policy.yaml {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] privsep_osbrick.group = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] privsep_osbrick.helper_command = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] privsep_osbrick.user = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cinder_sys_admin.group = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cinder_sys_admin.helper_command = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] cinder_sys_admin.user = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] service_user.auth_section = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] service_user.auth_type = password {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] service_user.cafile = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] service_user.certfile = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] service_user.collect_timing = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] service_user.insecure = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] service_user.keyfile = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] service_user.send_service_user_token = True {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] service_user.split_loggers = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] service_user.timeout = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] service_user.tls_ciphers = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] service_user.tls_min_version = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] glance.auth_section = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] glance.auth_type = password {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] glance.certfile = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] glance.collect_timing = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] glance.insecure = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] glance.keyfile = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] glance.region_name = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] glance.split_loggers = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] glance.timeout = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] glance.tls_ciphers = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] glance.tls_min_version = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.backend_availability_zone = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.chap_password = **** {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.chap_username = {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.disk_geometry = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.driver_client_cert = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.driver_client_cert_key = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.driver_data_namespace = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack quobyte-client[86166]: Reading configuration file: /etc/quobyte/client.cfg Nov 02 12:20:36 devstack quobyte-client[86166]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.driver_use_ssl = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.extra_capabilities = {} {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.filter_function = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.goodness_function = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.image_volume_cache_promote_across_pools = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] CMD "mount.quobyte" returned: 1 in 0.152s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.iscsi_target_flags = {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.iscsi_write_cache = on {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.iser_helper = tgtadm {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.iser_ip_address = 192.168.122.95 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.iser_port = 3260 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.nas_host = {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[86165]: INFO cinder.volume.drivers.quobyte [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae ... Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.nas_login = admin {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.nas_mount_options = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db -c /etc/quobyte/client-cinder.cfg {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.nas_password = **** {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.nas_private_key = {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.nas_share_path = {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.num_shell_tries = 3 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.quobyte_volume_url = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.replication_device = **** {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.report_discard_supported = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.reserved_percentage = 0 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.target_helper = tgtadm {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.target_ip_address = 192.168.122.95 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.target_port = 3260 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.target_protocol = iscsi {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.trace_flags = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.unique_fqdn_network = True {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.use_chap_auth = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.volume_backend_name = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.volume_clear = zero {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.volume_clear_ionice = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.volume_clear_size = 0 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_reports.file_event_handler = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_reports.log_dir = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.backend_availability_zone = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack sudo[86171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db -c /etc/quobyte/client-cinder.cfg Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.backend_host = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.chap_password = **** {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.chap_username = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.chiscsi_conf = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.disk_geometry = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack sudo[86171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.driver_client_cert = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.driver_data_namespace = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.driver_use_ssl = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.extra_capabilities = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.filter_function = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.goodness_function = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.image_volume_cache_promote_across_pools = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.iser_helper = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.iser_ip_address = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.iser_port = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.iser_target_prefix = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.nas_host = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.nas_login = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.nas_mount_options = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.nas_password = **** {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.nas_private_key = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.nas_share_path = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.nas_ssh_port = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.num_shell_tries = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.nvmet_port_id = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.replication_device = **** {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.report_discard_supported = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.reserved_percentage = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.scst_target_driver = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.storage_protocol = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.target_helper = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.target_ip_address = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.target_port = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.target_prefix = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.target_protocol = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.trace_flags = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.use_chap_auth = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.volume_clear = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.volume_clear_size = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] QuobyteHD.volumes_dir = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.ssl = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_notifications.driver = [] {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_notifications.retry = -1 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] key_manager.fixed_key = **** {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] barbican.barbican_api_version = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] barbican.barbican_endpoint = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] barbican.barbican_endpoint_type = public {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] barbican.barbican_region_name = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] barbican.cafile = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] barbican.certfile = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] barbican.collect_timing = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] barbican.insecure = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] barbican.keyfile = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] barbican.number_of_retries = 60 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] barbican.retry_delay = 1 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] barbican.send_service_user_token = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] barbican.split_loggers = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] barbican.timeout = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] barbican.tls_ciphers = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] barbican.tls_min_version = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] barbican.verify_ssl = True {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] barbican.verify_ssl_path = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] barbican_service_user.auth_section = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] barbican_service_user.auth_type = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] barbican_service_user.cafile = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] barbican_service_user.certfile = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] barbican_service_user.collect_timing = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] barbican_service_user.insecure = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] barbican_service_user.keyfile = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] barbican_service_user.split_loggers = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] barbican_service_user.timeout = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] barbican_service_user.tls_ciphers = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] barbican_service_user.tls_min_version = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] vault.approle_role_id = **** {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] vault.approle_secret_id = **** {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] vault.auth_method = approle {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] vault.auth_path = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] vault.kv_mountpoint = secret {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] vault.kv_path = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] vault.kv_version = 2 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] vault.namespace = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] vault.root_token_id = **** {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] vault.ssl_ca_crt_file = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] vault.timeout = 60.0 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] vault.token_file = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] vault.token_role = None {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] vault.use_ssl = False {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:36 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] ******************************************************************************** {{(pid=85950) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 12:20:37 devstack sudo[86171]: pam_unix(sudo:session): session closed for user root Nov 02 12:20:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.385s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:20:37 devstack cinder-volume[86165]: INFO cinder.volume.drivers.quobyte [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae succeeded Nov 02 12:20:37 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:20:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.396s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:20:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:20:37 devstack sudo[86273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:20:37 devstack sudo[86273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:20:37 devstack sudo[86273]: pam_unix(sudo:session): session closed for user root Nov 02 12:20:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.244s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:20:37 devstack cinder-volume[86165]: INFO cinder.volume.driver [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] Driver hasn't implemented _init_vendor_properties() Nov 02 12:20:37 devstack cinder-volume[86165]: DEBUG cinder.volume.driver [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8458518981934, 'free_capacity_gb': 1773.8458518981934, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86165) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:889}} Nov 02 12:20:37 devstack cinder-volume[86165]: DEBUG oslo_db.sqlalchemy.engines [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86165) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 12:20:37 devstack cinder-volume[86165]: DEBUG dbcounter [-] [86165] Writer thread running {{(pid=86165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 12:20:37 devstack cinder-volume[86165]: DEBUG cinder.db.api [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] Building query based on filter {{(pid=86165) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 02 12:20:37 devstack cinder-volume[86165]: DEBUG cinder.image.image_utils [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86165) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 02 12:20:37 devstack cinder-volume[86165]: INFO cinder.keymgr.migration [None req-08bb9682-5c92-472a-b5ba-c70cd563dd31 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 12:20:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:20:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:20:37 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:20:37 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:20:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:20:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:20:37 devstack sudo[86276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:20:37 devstack sudo[86276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:20:37 devstack sudo[86276]: pam_unix(sudo:session): session closed for user root Nov 02 12:20:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.230s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:20:37 devstack cinder-volume[86165]: DEBUG cinder.manager [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] Notifying Schedulers of capabilities ... {{(pid=86165) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:20:37 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] Driver initialization completed successfully. Nov 02 12:20:37 devstack cinder-volume[86165]: INFO cinder.manager [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] Initiating service 3 cleanup Nov 02 12:20:37 devstack cinder-volume[86165]: INFO cinder.manager [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] Service 3 cleanup completed. Nov 02 12:20:37 devstack cinder-volume[86165]: DEBUG cinder.service [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] Creating RPC server for service cinder-volume {{(pid=86165) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 12:20:37 devstack cinder-volume[86165]: DEBUG cinder.service [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86165) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 12:20:37 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 02 12:20:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:20:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:20:37 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86165) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:20:37 devstack cinder-volume[86165]: DEBUG cinder.volume.drivers.quobyte [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86165) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:20:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86165) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:20:37 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:20:37 devstack sudo[86280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:20:37 devstack sudo[86280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:20:38 devstack sudo[86280]: pam_unix(sudo:session): session closed for user root Nov 02 12:20:38 devstack cinder-volume[86165]: DEBUG oslo_concurrency.processutils [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.267s {{(pid=86165) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:20:38 devstack cinder-volume[86165]: INFO cinder.volume.manager [None req-60fbe0ee-5c6b-45fc-a895-bfb286565353 None None] Driver post RPC initialization completed successfully. Nov 02 12:20:41 devstack cinder-volume[85950]: INFO oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] Caught SIGTERM, stopping children Nov 02 12:20:41 devstack cinder-volume[85950]: DEBUG oslo_concurrency.lockutils [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] Acquiring lock "singleton_lock" {{(pid=85950) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 12:20:41 devstack cinder-volume[85950]: DEBUG oslo_concurrency.lockutils [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] Acquired lock "singleton_lock" {{(pid=85950) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 12:20:41 devstack cinder-volume[85950]: DEBUG oslo_concurrency.lockutils [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] Releasing lock "singleton_lock" {{(pid=85950) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 12:20:41 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] Stop services. {{(pid=85950) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 02 12:20:41 devstack cinder-volume[85950]: DEBUG oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] Killing children. {{(pid=85950) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 02 12:20:41 devstack cinder-volume[85950]: INFO oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] Waiting on 1 children to exit Nov 02 12:20:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] Acquiring lock "singleton_lock" {{(pid=86165) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 12:20:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] Acquired lock "singleton_lock" {{(pid=86165) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 12:20:41 devstack cinder-volume[86165]: DEBUG oslo_concurrency.lockutils [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] Releasing lock "singleton_lock" {{(pid=86165) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 12:20:41 devstack cinder-volume[86165]: WARNING amqp [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 12:20:42 devstack cinder-volume[86165]: WARNING amqp [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 12:20:42 devstack cinder-volume[85950]: INFO oslo_service.backend._eventlet.service [None req-17425169-2d88-4444-a6ed-43e7c7a9ae69 None None] Child 86165 exited with status 0 Nov 02 12:20:42 devstack cinder-volume[86471]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 12:20:42 devstack cinder-volume[86471]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 12:20:42 devstack cinder-volume[86471]: we strongly recommend against using it for new projects. Nov 02 12:20:42 devstack cinder-volume[86471]: If you are already using Eventlet, we recommend migrating to a different Nov 02 12:20:42 devstack cinder-volume[86471]: framework. For more detail see Nov 02 12:20:42 devstack cinder-volume[86471]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 12:20:42 devstack cinder-volume[86471]: import eventlet # noqa Nov 02 12:20:44 devstack cinder-volume[86471]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 12:20:44 devstack cinder-volume[86471]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 12:20:44 devstack cinder-volume[86471]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86471) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 12:20:45 devstack cinder-volume[86471]: INFO dbcounter [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] Registered counter for database cinder Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_db.sqlalchemy.engines [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86471) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG dbcounter [-] [86471] Writer thread running {{(pid=86471) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 12:20:45 devstack cinder-volume[86471]: INFO cinder.rpc [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 12:20:45 devstack cinder-volume[86471]: INFO cinder.rpc [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_db.sqlalchemy.engines [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86471) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 12:20:45 devstack cinder-volume[86471]: INFO cinder.volume.manager [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] Determined volume DB was empty at startup. Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG cinder.volume.manager [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86471) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 12:20:45 devstack cinder-volume[86471]: WARNING stevedore.named [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 12:20:45 devstack cinder-volume[86471]: WARNING castellan.key_manager [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 12:20:45 devstack cinder-volume[86471]: WARNING cinder.keymgr.conf_key_mgr [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 12:20:45 devstack cinder-volume[86471]: INFO cinder.volume.manager [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_db.sqlalchemy.engines [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86471) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 12:20:45 devstack cinder-volume[86471]: INFO oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] Starting 1 workers Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] Started child 86515 {{(pid=86471) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] Full set of CONF: {{(pid=86471) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] ******************************************************************************** {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] Configuration options gathered from: {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] ================================================================================ {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] allow_availability_zone_fallback = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] allow_compression_on_image_upload = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] allowed_direct_url_schemes = [] {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] api_rate_limit = True {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] auth_strategy = keystone {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86515]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_availability_zone = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_host = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_name = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_stats_polling_interval = 60 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backup_api_class = cinder.backup.api.API {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backup_name_template = backup-%s {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backup_use_same_host = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backup_use_temp_snapshot = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] chap_password = **** {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] chap_username = {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cinder_internal_tenant_project_id = f5ca7796b3ac48a39c81c761860e7ead {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cinder_internal_tenant_user_id = e907082faa044005afd633b91ad8ef26 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cluster = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] compression_format = gzip {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] compute_api_class = cinder.compute.nova.API {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] config_dir = [] {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] config_source = [] {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] control_exchange = openstack {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] debug = True {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] default_availability_zone = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] default_group_type = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] default_volume_type = QuobyteHD {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] disk_geometry = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] driver_client_cert = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] driver_client_cert_key = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] driver_data_namespace = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] driver_ssl_cert_path = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] driver_ssl_cert_verify = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] driver_use_ssl = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] enable_new_services = True {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] enable_unsupported_driver = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] enabled_backends = ['QuobyteHD'] {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] enforce_multipath_for_image_xfer = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] filter_function = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] glance_api_insecure = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] glance_api_servers = ['http://192.168.122.95/image'] {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] glance_api_ssl_compression = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] glance_ca_certificates_file = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] glance_catalog_info = image:glance:publicURL {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] glance_certfile = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] glance_keyfile = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] glance_num_retries = 3 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] glance_request_timeout = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] goodness_function = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] graceful_shutdown_timeout = 5 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] group_api_class = cinder.group.api.API {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] host = devstack {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] image_compress_on_upload = True {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] image_conversion_address_space_limit = 1 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] image_conversion_cpu_limit = 60 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] image_conversion_disable = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] image_introspection_address_space_limit = 1 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] image_introspection_cpu_limit = 60 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] image_upload_use_cinder_backend = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] image_upload_use_internal_tenant = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] image_volume_cache_enabled = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] image_volume_cache_max_count = 0 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] image_volume_cache_max_size_gb = 0 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] image_volume_cache_promote_across_pools = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] init_host_max_objects_retrieval = 0 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] instance_format = [instance: %(uuid)s] {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] iscsi_target_flags = {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] iscsi_write_cache = on {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] iser_helper = tgtadm {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] iser_ip_address = 192.168.122.95 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] iser_port = 3260 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] log_color = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] log_config_append = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] log_dir = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] log_file = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] log_options = True {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] log_rotate_interval = 1 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] log_rotate_interval_type = days {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] log_rotation_type = none {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] max_age = 0 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] max_logfile_count = 30 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] max_logfile_size_mb = 200 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] max_over_subscription_ratio = 20.0 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] message_reap_interval = 86400 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] message_ttl = 2592000 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] migration_create_volume_timeout_secs = 300 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] monkey_patch = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] monkey_patch_modules = [] {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] my_ip = 192.168.122.95 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] no_snapshot_gb_quota = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] num_iser_scan_tries = 3 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] num_shell_tries = 3 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] num_volume_device_scan_tries = 3 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] nvmeof_conn_info_version = 1 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] nvmet_ns_id = 10 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] nvmet_port_id = 1 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] osapi_max_limit = 1000 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] osapi_volume_ext_list = [] {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] osapi_volume_listen_port = 8776 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] osapi_volume_use_ssl = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] osapi_volume_workers = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] per_volume_size_limit = -1 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] periodic_fuzzy_delay = 60 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] periodic_interval = 60 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] public_endpoint = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] publish_errors = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] Starting volume driver QuobyteDriver (1.2.1) Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] quota_backup_gigabytes = 1000 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86515) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] quota_backups = 10 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] quota_gigabytes = 1000 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] quota_groups = 10 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] quota_snapshots = 10 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] quota_volumes = 10 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] rate_limit_burst = 0 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] rate_limit_except_level = CRITICAL {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] rate_limit_interval = 0 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] reinit_driver_count = 3 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] replication_device = **** {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] report_discard_supported = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] report_interval = 120 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] reservation_clean_interval = 86400 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] reservation_expire = 86400 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] reserved_image_namespaces = [] {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] reserved_percentage = 0 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] rpc_response_timeout = 120 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] run_external_periodic_tasks = True {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] scst_target_driver = iscsi {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] scst_target_iqn_name = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] service_down_time = 720 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] shell_completion = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] snapshot_name_template = snapshot-%s {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] split_loggers = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] state_path = /opt/stack/data/cinder {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] storage_availability_zone = nova {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] storage_protocol = iSCSI {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] syslog_log_facility = LOG_USER {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] target_helper = lioadm {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] target_ip_address = 192.168.122.95 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] target_port = 3260 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] target_protocol = iscsi {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] target_secondary_ip_addresses = [] {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] trace_flags = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] transport_url = **** {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] until_refresh = 0 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] use_chap_auth = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] use_default_quota_class = True {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] use_journal = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] use_json = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] use_multipath_for_image_xfer = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] use_stderr = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] use_syslog = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] verify_glance_signatures = enabled {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] volume_api_class = cinder.volume.api.API {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] volume_backend_name = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] volume_clear = zero {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] volume_clear_ionice = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] volume_clear_size = 0 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] volume_copy_bps_limit = 0 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] volume_dd_blocksize = 1M {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] volume_name_template = volume-%s {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] volume_service_inithost_offload = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] volume_usage_audit_period = month {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] zoning_mode = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_concurrency.disable_process_locking = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.auth_section = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.auth_type = password {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.auth_version = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.cache = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.certfile = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.include_service_catalog = True {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.insecure = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.interface = public {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.keyfile = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.memcache_password = **** {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.memcache_username = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.region_name = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.service_type = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.95/identity {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.backend = dogpile.cache.null {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.backend_argument = **** {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.backend_expiration_time = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.config_prefix = cache.oslo {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.debug_cache_backend = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.enable_retry_client = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.enable_socket_keepalive = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.enabled = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.expiration_time = 600 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.hashclient_retry_attempts = 2 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.memcache_dead_retry = 300 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.memcache_pool_maxsize = 10 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.memcache_sasl_enabled = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.password = **** {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.proxies = [] {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.redis_db = 0 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.redis_server = localhost:6379 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.retry_attempts = 2 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.retry_delay = 0.0 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.socket_keepalive_count = 1 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.socket_keepalive_idle = 1 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.socket_keepalive_interval = 1 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.socket_timeout = 1.0 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.tls_allowed_ciphers = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.tls_cafile = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.tls_certfile = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.tls_enabled = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.tls_keyfile = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cache.username = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] coordination.backend_url = **** {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] database.asyncio_connection = **** {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] database.asyncio_slave_connection = **** {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] database.backend = sqlalchemy {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] database.connection = **** {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] database.connection_debug = 0 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] database.connection_parameters = {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] database.connection_recycle_time = 3600 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] database.connection_trace = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] database.db_inc_retry_interval = True {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] database.db_max_retries = 20 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] database.db_max_retry_interval = 10 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86515) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 02 12:20:45 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.quobyte [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] database.db_retry_interval = 1 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] database.max_overflow = 50 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] database.max_pool_size = 5 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] database.max_retries = 10 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] database.mysql_wsrep_sync_wait = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] database.pool_timeout = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] database.retry_interval = 10 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] database.slave_connection = **** {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.quobyte [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] database.sqlite_synchronous = True {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] database.synchronous_reader = True {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] database.use_db_reconnect = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] Running cmd (subprocess): mount.quobyte {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_tracing.insecure = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] profiler.connection_string = messaging:// {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] profiler.enabled = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] profiler.es_doc_type = notification {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] profiler.es_scroll_size = 10000 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] profiler.es_scroll_time = 2m {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] profiler.filter_error_trace = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] profiler.hmac_keys = **** {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] profiler.sentinel_service_name = mymaster {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] profiler.socket_timeout = 0.1 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] profiler.trace_requests = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] profiler.trace_sqlalchemy = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] profiler_jaeger.process_tags = {} {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] profiler_jaeger.service_name_prefix = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] profiler_otlp.service_name_prefix = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_policy.enforce_new_defaults = True {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_policy.policy_default_rule = default {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_policy.policy_file = policy.yaml {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] privsep_osbrick.group = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] privsep_osbrick.helper_command = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] privsep_osbrick.user = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cinder_sys_admin.group = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cinder_sys_admin.helper_command = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] cinder_sys_admin.user = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] service_user.auth_section = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] service_user.auth_type = password {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] service_user.cafile = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] service_user.certfile = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] service_user.collect_timing = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] service_user.insecure = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] service_user.keyfile = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] service_user.send_service_user_token = True {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] service_user.split_loggers = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] service_user.timeout = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] service_user.tls_ciphers = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] service_user.tls_min_version = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] glance.auth_section = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] glance.auth_type = password {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] glance.certfile = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] glance.collect_timing = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] glance.insecure = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] glance.keyfile = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] glance.region_name = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] glance.split_loggers = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] glance.timeout = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] glance.tls_ciphers = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] glance.tls_min_version = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.backend_availability_zone = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.chap_password = **** {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.chap_username = {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.disk_geometry = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.driver_client_cert = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.driver_client_cert_key = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.driver_data_namespace = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.driver_use_ssl = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.extra_capabilities = {} {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.filter_function = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.goodness_function = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.image_volume_cache_promote_across_pools = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.iscsi_target_flags = {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.iscsi_write_cache = on {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.iser_helper = tgtadm {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.iser_ip_address = 192.168.122.95 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.iser_port = 3260 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.nas_host = {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.nas_login = admin {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.nas_mount_options = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.nas_password = **** {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.nas_private_key = {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.nas_share_path = {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.num_shell_tries = 3 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.quobyte_volume_url = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.replication_device = **** {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.report_discard_supported = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.reserved_percentage = 0 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.target_helper = tgtadm {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.target_ip_address = 192.168.122.95 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.target_port = 3260 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.target_protocol = iscsi {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.trace_flags = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.unique_fqdn_network = True {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.use_chap_auth = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.volume_backend_name = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.volume_clear = zero {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.volume_clear_ionice = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.volume_clear_size = 0 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_reports.file_event_handler = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_reports.log_dir = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.backend_availability_zone = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.backend_host = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.chap_password = **** {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.chap_username = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.chiscsi_conf = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.disk_geometry = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.driver_client_cert = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.driver_data_namespace = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack quobyte-client[86516]: Reading configuration file: /etc/quobyte/client.cfg Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.driver_use_ssl = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack quobyte-client[86516]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.extra_capabilities = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.filter_function = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.goodness_function = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.image_volume_cache_promote_across_pools = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.iser_helper = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.iser_ip_address = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] CMD "mount.quobyte" returned: 1 in 0.060s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.iser_port = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.iser_target_prefix = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.nas_host = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.nas_login = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.nas_mount_options = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.nas_password = **** {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.nas_private_key = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.nas_share_path = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.nas_ssh_port = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.num_shell_tries = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.nvmet_port_id = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.replication_device = **** {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.report_discard_supported = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.reserved_percentage = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.scst_target_driver = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.storage_protocol = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.target_helper = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.target_ip_address = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.target_port = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.target_prefix = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.target_protocol = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.trace_flags = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.use_chap_auth = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.volume_clear = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.volume_clear_size = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] QuobyteHD.volumes_dir = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.ssl = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_notifications.driver = [] {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_notifications.retry = -1 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] key_manager.fixed_key = **** {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] barbican.barbican_api_version = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack sudo[86517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] barbican.barbican_endpoint = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] barbican.barbican_endpoint_type = public {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] barbican.barbican_region_name = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] barbican.cafile = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] barbican.certfile = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack sudo[86517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] barbican.collect_timing = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] barbican.insecure = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] barbican.keyfile = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] barbican.number_of_retries = 60 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] barbican.retry_delay = 1 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] barbican.send_service_user_token = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] barbican.split_loggers = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] barbican.timeout = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] barbican.tls_ciphers = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] barbican.tls_min_version = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] barbican.verify_ssl = True {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] barbican.verify_ssl_path = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] barbican_service_user.auth_section = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] barbican_service_user.auth_type = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] barbican_service_user.cafile = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] barbican_service_user.certfile = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] barbican_service_user.collect_timing = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] barbican_service_user.insecure = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] barbican_service_user.keyfile = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] barbican_service_user.split_loggers = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] barbican_service_user.timeout = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] barbican_service_user.tls_ciphers = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] barbican_service_user.tls_min_version = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] vault.approle_role_id = **** {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] vault.approle_secret_id = **** {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] vault.auth_method = approle {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] vault.auth_path = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] vault.kv_mountpoint = secret {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] vault.kv_path = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] vault.kv_version = 2 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] vault.namespace = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] vault.root_token_id = **** {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] vault.ssl_ca_crt_file = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] vault.timeout = 60.0 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] vault.token_file = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] vault.token_role = None {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] vault.use_ssl = False {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 12:20:45 devstack cinder-volume[86471]: DEBUG oslo_service.backend._eventlet.service [None req-d0958349-92fb-4a26-9ee9-d16ca847ba83 None None] ******************************************************************************** {{(pid=86471) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 12:20:46 devstack sudo[86517]: pam_unix(sudo:session): session closed for user root Nov 02 12:20:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.241s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:20:46 devstack cinder-volume[86515]: INFO cinder.volume.driver [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] Driver hasn't implemented _init_vendor_properties() Nov 02 12:20:46 devstack cinder-volume[86515]: DEBUG cinder.volume.driver [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8458518981934, 'free_capacity_gb': 1773.8458518981934, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86515) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:889}} Nov 02 12:20:46 devstack cinder-volume[86515]: DEBUG oslo_db.sqlalchemy.engines [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86515) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 12:20:46 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writer thread running {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 12:20:46 devstack cinder-volume[86515]: DEBUG cinder.db.api [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] Building query based on filter {{(pid=86515) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 02 12:20:46 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86515) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 02 12:20:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:20:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:20:46 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:20:46 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:20:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:20:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:20:46 devstack cinder-volume[86515]: INFO cinder.keymgr.migration [None req-97e3faab-a7d2-4550-a24d-3378f203339e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 12:20:46 devstack sudo[86528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:20:46 devstack sudo[86528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:20:46 devstack sudo[86528]: pam_unix(sudo:session): session closed for user root Nov 02 12:20:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.253s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:20:46 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:20:46 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] Driver initialization completed successfully. Nov 02 12:20:46 devstack cinder-volume[86515]: INFO cinder.manager [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] Initiating service 3 cleanup Nov 02 12:20:46 devstack cinder-volume[86515]: INFO cinder.manager [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] Service 3 cleanup completed. Nov 02 12:20:46 devstack cinder-volume[86515]: DEBUG cinder.service [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] Creating RPC server for service cinder-volume {{(pid=86515) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 12:20:46 devstack cinder-volume[86515]: DEBUG cinder.service [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86515) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 12:20:46 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 02 12:20:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:20:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:20:46 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:20:46 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:20:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:20:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:20:46 devstack sudo[86541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:20:46 devstack sudo[86541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:20:46 devstack sudo[86541]: pam_unix(sudo:session): session closed for user root Nov 02 12:20:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.244s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:20:46 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-08758fda-87ac-42f4-9c99-98b18dfff0cb None None] Driver post RPC initialization completed successfully. Nov 02 12:20:55 devstack cinder-volume[86471]: DEBUG dbcounter [-] [86471] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86471) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:20:56 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:20:56 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=3 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:21:43 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager._thread_info {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:21:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread count: 6 {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:21:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread info: [<_MainThread(MainThread, started 129944084402304)>, , , , , ] {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:22:43 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:22:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:22:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:22:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:22:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:22:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:22:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:22:43 devstack sudo[87196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:22:43 devstack sudo[87196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:22:44 devstack sudo[87196]: pam_unix(sudo:session): session closed for user root Nov 02 12:22:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.311s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:22:44 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:22:44 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager._thread_info {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:22:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread count: 6 {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:22:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread info: [<_MainThread(MainThread, started 129944084402304)>, , , , , ] {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:22:56 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=1 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:22:56 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:UPDATE=1 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:23:42 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-d992ee77-78f8-49c9-b20b-7b3a890589ac tempest-DeleteServersTestJSON-63113576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:23:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d992ee77-78f8-49c9-b20b-7b3a890589ac tempest-DeleteServersTestJSON-63113576 None] Flow 'volume_create_manager' (6180f650-9b40-4f98-9d2f-49e1f9c813e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:23:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d992ee77-78f8-49c9-b20b-7b3a890589ac tempest-DeleteServersTestJSON-63113576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c775aef2-2fa1-4f05-9b4c-26c854a7e3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:23:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d992ee77-78f8-49c9-b20b-7b3a890589ac tempest-DeleteServersTestJSON-63113576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c775aef2-2fa1-4f05-9b4c-26c854a7e3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-768788533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71efa313-4999-402e-9fe2-1c0e6748c1a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e07d126bcc346058d20899a12e7fb30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:23:42Z,use_quota=True,user_id='f930f4ebb43f40e4b4dfc06e990b0c08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:23:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d992ee77-78f8-49c9-b20b-7b3a890589ac tempest-DeleteServersTestJSON-63113576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fcd4e87-d166-47a4-9620-04dbadc2be54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:23:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d992ee77-78f8-49c9-b20b-7b3a890589ac tempest-DeleteServersTestJSON-63113576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fcd4e87-d166-47a4-9620-04dbadc2be54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:23:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d992ee77-78f8-49c9-b20b-7b3a890589ac tempest-DeleteServersTestJSON-63113576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47125926-ed15-4a87-9b53-b2f1ffaf676e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:23:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d992ee77-78f8-49c9-b20b-7b3a890589ac tempest-DeleteServersTestJSON-63113576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47125926-ed15-4a87-9b53-b2f1ffaf676e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71efa313-4999-402e-9fe2-1c0e6748c1a8', 'volume_name': 'volume-71efa313-4999-402e-9fe2-1c0e6748c1a8', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:23:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d992ee77-78f8-49c9-b20b-7b3a890589ac tempest-DeleteServersTestJSON-63113576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc0f457-6678-4ea4-9faa-0806b6f1b88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:23:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d992ee77-78f8-49c9-b20b-7b3a890589ac tempest-DeleteServersTestJSON-63113576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc0f457-6678-4ea4-9faa-0806b6f1b88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:23:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d992ee77-78f8-49c9-b20b-7b3a890589ac tempest-DeleteServersTestJSON-63113576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (239708d7-c591-4934-9ff3-adea842edf6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:23:43 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-d992ee77-78f8-49c9-b20b-7b3a890589ac tempest-DeleteServersTestJSON-63113576 None] Volume 71efa313-4999-402e-9fe2-1c0e6748c1a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71efa313-4999-402e-9fe2-1c0e6748c1a8', 'volume_size': 1} Nov 02 12:23:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d992ee77-78f8-49c9-b20b-7b3a890589ac tempest-DeleteServersTestJSON-63113576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:23:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d992ee77-78f8-49c9-b20b-7b3a890589ac tempest-DeleteServersTestJSON-63113576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:23:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d992ee77-78f8-49c9-b20b-7b3a890589ac tempest-DeleteServersTestJSON-63113576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-768788533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71efa313-4999-402e-9fe2-1c0e6748c1a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e07d126bcc346058d20899a12e7fb30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:23:42Z,use_quota=True,user_id='f930f4ebb43f40e4b4dfc06e990b0c08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:23:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-d992ee77-78f8-49c9-b20b-7b3a890589ac tempest-DeleteServersTestJSON-63113576 None] Creating volume 71efa313-4999-402e-9fe2-1c0e6748c1a8 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:23:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d992ee77-78f8-49c9-b20b-7b3a890589ac tempest-DeleteServersTestJSON-63113576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:23:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d992ee77-78f8-49c9-b20b-7b3a890589ac tempest-DeleteServersTestJSON-63113576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:23:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d992ee77-78f8-49c9-b20b-7b3a890589ac tempest-DeleteServersTestJSON-63113576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:23:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d992ee77-78f8-49c9-b20b-7b3a890589ac tempest-DeleteServersTestJSON-63113576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:23:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d992ee77-78f8-49c9-b20b-7b3a890589ac tempest-DeleteServersTestJSON-63113576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:23:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d992ee77-78f8-49c9-b20b-7b3a890589ac tempest-DeleteServersTestJSON-63113576 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:23:43 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-d992ee77-78f8-49c9-b20b-7b3a890589ac tempest-DeleteServersTestJSON-63113576 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:23:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d992ee77-78f8-49c9-b20b-7b3a890589ac tempest-DeleteServersTestJSON-63113576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-71efa313-4999-402e-9fe2-1c0e6748c1a8 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:23:43 devstack sudo[87717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-71efa313-4999-402e-9fe2-1c0e6748c1a8 1073741824 Nov 02 12:23:43 devstack sudo[87717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:23:43 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:23:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:23:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:23:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:23:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:23:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:23:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:23:43 devstack sudo[87755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:23:43 devstack sudo[87755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:23:44 devstack sudo[87755]: pam_unix(sudo:session): session closed for user root Nov 02 12:23:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.829s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:23:44 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:23:44 devstack sudo[87717]: pam_unix(sudo:session): session closed for user root Nov 02 12:23:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d992ee77-78f8-49c9-b20b-7b3a890589ac tempest-DeleteServersTestJSON-63113576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-71efa313-4999-402e-9fe2-1c0e6748c1a8 1073741824" returned: 0 in 1.636s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:23:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d992ee77-78f8-49c9-b20b-7b3a890589ac tempest-DeleteServersTestJSON-63113576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-71efa313-4999-402e-9fe2-1c0e6748c1a8 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:23:45 devstack sudo[88091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-71efa313-4999-402e-9fe2-1c0e6748c1a8 Nov 02 12:23:45 devstack sudo[88091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:23:45 devstack sudo[88091]: pam_unix(sudo:session): session closed for user root Nov 02 12:23:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d992ee77-78f8-49c9-b20b-7b3a890589ac tempest-DeleteServersTestJSON-63113576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-71efa313-4999-402e-9fe2-1c0e6748c1a8" returned: 0 in 0.357s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:23:45 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d992ee77-78f8-49c9-b20b-7b3a890589ac tempest-DeleteServersTestJSON-63113576 None] <== create_volume: return (2132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:23:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d992ee77-78f8-49c9-b20b-7b3a890589ac tempest-DeleteServersTestJSON-63113576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.142s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:23:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d992ee77-78f8-49c9-b20b-7b3a890589ac tempest-DeleteServersTestJSON-63113576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (239708d7-c591-4934-9ff3-adea842edf6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71efa313-4999-402e-9fe2-1c0e6748c1a8', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:23:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d992ee77-78f8-49c9-b20b-7b3a890589ac tempest-DeleteServersTestJSON-63113576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1edcf8ad-f529-4dad-8e8c-99b950701ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:23:45 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-d992ee77-78f8-49c9-b20b-7b3a890589ac tempest-DeleteServersTestJSON-63113576 None] Volume volume-71efa313-4999-402e-9fe2-1c0e6748c1a8 (71efa313-4999-402e-9fe2-1c0e6748c1a8): created successfully Nov 02 12:23:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d992ee77-78f8-49c9-b20b-7b3a890589ac tempest-DeleteServersTestJSON-63113576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1edcf8ad-f529-4dad-8e8c-99b950701ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:23:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d992ee77-78f8-49c9-b20b-7b3a890589ac tempest-DeleteServersTestJSON-63113576 None] Flow 'volume_create_manager' (6180f650-9b40-4f98-9d2f-49e1f9c813e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:23:45 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-d992ee77-78f8-49c9-b20b-7b3a890589ac tempest-DeleteServersTestJSON-63113576 None] Created volume successfully. Nov 02 12:23:54 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-18395770-8287-4e01-965e-b0285f704134 tempest-ServerRescueNegativeTestJSON-1057307613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:23:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-18395770-8287-4e01-965e-b0285f704134 tempest-ServerRescueNegativeTestJSON-1057307613 None] Flow 'volume_create_manager' (7195dfc5-a4a8-430c-85d8-f5b254ce9e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:23:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-18395770-8287-4e01-965e-b0285f704134 tempest-ServerRescueNegativeTestJSON-1057307613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d1995b-1c8d-4516-b146-05540d688ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:23:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-18395770-8287-4e01-965e-b0285f704134 tempest-ServerRescueNegativeTestJSON-1057307613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d1995b-1c8d-4516-b146-05540d688ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-171259613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adb8c99a-9aea-48e5-adae-fde1b3185286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='409ea61990314189a213c0344e78f8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:23:55Z,use_quota=True,user_id='a91635716fe0491c940fc14ea8f93c49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:23:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-18395770-8287-4e01-965e-b0285f704134 tempest-ServerRescueNegativeTestJSON-1057307613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d9cdae7-4613-4e48-8c6a-4846e1492a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:23:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-18395770-8287-4e01-965e-b0285f704134 tempest-ServerRescueNegativeTestJSON-1057307613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d9cdae7-4613-4e48-8c6a-4846e1492a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:23:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-18395770-8287-4e01-965e-b0285f704134 tempest-ServerRescueNegativeTestJSON-1057307613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec3f2601-6510-47b8-909f-0740ff3e2a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:23:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-18395770-8287-4e01-965e-b0285f704134 tempest-ServerRescueNegativeTestJSON-1057307613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec3f2601-6510-47b8-909f-0740ff3e2a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adb8c99a-9aea-48e5-adae-fde1b3185286', 'volume_name': 'volume-adb8c99a-9aea-48e5-adae-fde1b3185286', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:23:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-18395770-8287-4e01-965e-b0285f704134 tempest-ServerRescueNegativeTestJSON-1057307613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (271aaee9-4bee-41af-bd67-c2631dd79f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:23:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-18395770-8287-4e01-965e-b0285f704134 tempest-ServerRescueNegativeTestJSON-1057307613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (271aaee9-4bee-41af-bd67-c2631dd79f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:23:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-18395770-8287-4e01-965e-b0285f704134 tempest-ServerRescueNegativeTestJSON-1057307613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c80f20ac-cca1-45d2-aa2d-28e7e53afe68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:23:54 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-18395770-8287-4e01-965e-b0285f704134 tempest-ServerRescueNegativeTestJSON-1057307613 None] Volume adb8c99a-9aea-48e5-adae-fde1b3185286: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adb8c99a-9aea-48e5-adae-fde1b3185286', 'volume_size': 1} Nov 02 12:23:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-18395770-8287-4e01-965e-b0285f704134 tempest-ServerRescueNegativeTestJSON-1057307613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:23:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-18395770-8287-4e01-965e-b0285f704134 tempest-ServerRescueNegativeTestJSON-1057307613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:23:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-18395770-8287-4e01-965e-b0285f704134 tempest-ServerRescueNegativeTestJSON-1057307613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-171259613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adb8c99a-9aea-48e5-adae-fde1b3185286,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='409ea61990314189a213c0344e78f8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:23:55Z,use_quota=True,user_id='a91635716fe0491c940fc14ea8f93c49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:23:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-18395770-8287-4e01-965e-b0285f704134 tempest-ServerRescueNegativeTestJSON-1057307613 None] Creating volume adb8c99a-9aea-48e5-adae-fde1b3185286 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:23:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-18395770-8287-4e01-965e-b0285f704134 tempest-ServerRescueNegativeTestJSON-1057307613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:23:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-18395770-8287-4e01-965e-b0285f704134 tempest-ServerRescueNegativeTestJSON-1057307613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:23:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-18395770-8287-4e01-965e-b0285f704134 tempest-ServerRescueNegativeTestJSON-1057307613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:23:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-18395770-8287-4e01-965e-b0285f704134 tempest-ServerRescueNegativeTestJSON-1057307613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:23:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-18395770-8287-4e01-965e-b0285f704134 tempest-ServerRescueNegativeTestJSON-1057307613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:23:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-18395770-8287-4e01-965e-b0285f704134 tempest-ServerRescueNegativeTestJSON-1057307613 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:23:54 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-18395770-8287-4e01-965e-b0285f704134 tempest-ServerRescueNegativeTestJSON-1057307613 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:23:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-18395770-8287-4e01-965e-b0285f704134 tempest-ServerRescueNegativeTestJSON-1057307613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-adb8c99a-9aea-48e5-adae-fde1b3185286 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:23:54 devstack sudo[88283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-adb8c99a-9aea-48e5-adae-fde1b3185286 1073741824 Nov 02 12:23:54 devstack sudo[88283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:23:55 devstack sudo[88283]: pam_unix(sudo:session): session closed for user root Nov 02 12:23:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-18395770-8287-4e01-965e-b0285f704134 tempest-ServerRescueNegativeTestJSON-1057307613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-adb8c99a-9aea-48e5-adae-fde1b3185286 1073741824" returned: 0 in 1.001s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:23:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-18395770-8287-4e01-965e-b0285f704134 tempest-ServerRescueNegativeTestJSON-1057307613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-adb8c99a-9aea-48e5-adae-fde1b3185286 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:23:55 devstack sudo[88294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-adb8c99a-9aea-48e5-adae-fde1b3185286 Nov 02 12:23:55 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:23:56 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root Nov 02 12:23:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-18395770-8287-4e01-965e-b0285f704134 tempest-ServerRescueNegativeTestJSON-1057307613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-adb8c99a-9aea-48e5-adae-fde1b3185286" returned: 0 in 0.866s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:23:56 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-18395770-8287-4e01-965e-b0285f704134 tempest-ServerRescueNegativeTestJSON-1057307613 None] <== create_volume: return (1949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:23:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-18395770-8287-4e01-965e-b0285f704134 tempest-ServerRescueNegativeTestJSON-1057307613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.953s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:23:56 devstack cinder-volume[86515]: WARNING py.warnings [req-53cae2c2-e7a5-4d5e-8cef-1b6295e66129 req-b7b6692c-2149-47fe-b76f-3ef95687eb1b tempest-DeleteServersTestJSON-63113576 None] /opt/stack/cinder/cinder/db/api.py:2442: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Nov 02 12:23:56 devstack cinder-volume[86515]: .first() Nov 02 12:23:56 devstack cinder-volume[86515]: Nov 02 12:23:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-53cae2c2-e7a5-4d5e-8cef-1b6295e66129 req-b7b6692c-2149-47fe-b76f-3ef95687eb1b tempest-DeleteServersTestJSON-63113576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:23:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-53cae2c2-e7a5-4d5e-8cef-1b6295e66129 req-b7b6692c-2149-47fe-b76f-3ef95687eb1b tempest-DeleteServersTestJSON-63113576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:23:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-53cae2c2-e7a5-4d5e-8cef-1b6295e66129 req-b7b6692c-2149-47fe-b76f-3ef95687eb1b tempest-DeleteServersTestJSON-63113576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:23:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-18395770-8287-4e01-965e-b0285f704134 tempest-ServerRescueNegativeTestJSON-1057307613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c80f20ac-cca1-45d2-aa2d-28e7e53afe68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adb8c99a-9aea-48e5-adae-fde1b3185286', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:23:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-18395770-8287-4e01-965e-b0285f704134 tempest-ServerRescueNegativeTestJSON-1057307613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c10895-c569-4abb-88e5-a101d4ce39f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:23:57 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-18395770-8287-4e01-965e-b0285f704134 tempest-ServerRescueNegativeTestJSON-1057307613 None] Volume volume-adb8c99a-9aea-48e5-adae-fde1b3185286 (adb8c99a-9aea-48e5-adae-fde1b3185286): created successfully Nov 02 12:23:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-18395770-8287-4e01-965e-b0285f704134 tempest-ServerRescueNegativeTestJSON-1057307613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72c10895-c569-4abb-88e5-a101d4ce39f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:23:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-18395770-8287-4e01-965e-b0285f704134 tempest-ServerRescueNegativeTestJSON-1057307613 None] Flow 'volume_create_manager' (7195dfc5-a4a8-430c-85d8-f5b254ce9e86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:23:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-53cae2c2-e7a5-4d5e-8cef-1b6295e66129 req-b7b6692c-2149-47fe-b76f-3ef95687eb1b tempest-DeleteServersTestJSON-63113576 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae', 'name': 'volume-71efa313-4999-402e-9fe2-1c0e6748c1a8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e8f41e4b-1e06-460a-a73e-874a2c2f49b8', 'enforce_multipath': True} {{(pid=86515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:23:57 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-18395770-8287-4e01-965e-b0285f704134 tempest-ServerRescueNegativeTestJSON-1057307613 None] Created volume successfully. Nov 02 12:23:57 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-53cae2c2-e7a5-4d5e-8cef-1b6295e66129 req-b7b6692c-2149-47fe-b76f-3ef95687eb1b tempest-DeleteServersTestJSON-63113576 None] attachment_update completed successfully. Nov 02 12:23:59 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eaddec8-212c-431c-89bf-176d1c616a2a tempest-VolumesAdminNegativeTest-1343453782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:23:59 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0eaddec8-212c-431c-89bf-176d1c616a2a tempest-VolumesAdminNegativeTest-1343453782 None] Flow 'volume_create_manager' (aaf26540-e24e-4a49-8965-b7733ef88f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:23:59 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0eaddec8-212c-431c-89bf-176d1c616a2a tempest-VolumesAdminNegativeTest-1343453782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de27d9cc-8af0-4072-9638-bbf220f633cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:23:59 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0eaddec8-212c-431c-89bf-176d1c616a2a tempest-VolumesAdminNegativeTest-1343453782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de27d9cc-8af0-4072-9638-bbf220f633cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-772715522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b8d911a-bd68-4c24-bce0-0c2be218fa6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='624c65954e58464f855c508a9c2ebaa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:24:00Z,use_quota=True,user_id='a2663f424480464c85ea87ea5b54f293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:23:59 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0eaddec8-212c-431c-89bf-176d1c616a2a tempest-VolumesAdminNegativeTest-1343453782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90b3be1c-e302-48af-835e-d315d4c0360f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:23:59 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0eaddec8-212c-431c-89bf-176d1c616a2a tempest-VolumesAdminNegativeTest-1343453782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90b3be1c-e302-48af-835e-d315d4c0360f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:24:00 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0eaddec8-212c-431c-89bf-176d1c616a2a tempest-VolumesAdminNegativeTest-1343453782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3371158f-2a23-4f81-902c-153a25672946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:24:00 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0eaddec8-212c-431c-89bf-176d1c616a2a tempest-VolumesAdminNegativeTest-1343453782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3371158f-2a23-4f81-902c-153a25672946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b8d911a-bd68-4c24-bce0-0c2be218fa6a', 'volume_name': 'volume-1b8d911a-bd68-4c24-bce0-0c2be218fa6a', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:24:00 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0eaddec8-212c-431c-89bf-176d1c616a2a tempest-VolumesAdminNegativeTest-1343453782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eba1f83e-9267-4505-8f72-e1d4b62d9af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:24:00 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0eaddec8-212c-431c-89bf-176d1c616a2a tempest-VolumesAdminNegativeTest-1343453782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eba1f83e-9267-4505-8f72-e1d4b62d9af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:24:00 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0eaddec8-212c-431c-89bf-176d1c616a2a tempest-VolumesAdminNegativeTest-1343453782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37727fe3-8efc-4ca8-9f19-9de3a0e36378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:24:00 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-0eaddec8-212c-431c-89bf-176d1c616a2a tempest-VolumesAdminNegativeTest-1343453782 None] Volume 1b8d911a-bd68-4c24-bce0-0c2be218fa6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b8d911a-bd68-4c24-bce0-0c2be218fa6a', 'volume_size': 1} Nov 02 12:24:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0eaddec8-212c-431c-89bf-176d1c616a2a tempest-VolumesAdminNegativeTest-1343453782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:24:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0eaddec8-212c-431c-89bf-176d1c616a2a tempest-VolumesAdminNegativeTest-1343453782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:24:00 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0eaddec8-212c-431c-89bf-176d1c616a2a tempest-VolumesAdminNegativeTest-1343453782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-772715522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b8d911a-bd68-4c24-bce0-0c2be218fa6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='624c65954e58464f855c508a9c2ebaa8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:24:00Z,use_quota=True,user_id='a2663f424480464c85ea87ea5b54f293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:24:00 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-0eaddec8-212c-431c-89bf-176d1c616a2a tempest-VolumesAdminNegativeTest-1343453782 None] Creating volume 1b8d911a-bd68-4c24-bce0-0c2be218fa6a {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:24:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0eaddec8-212c-431c-89bf-176d1c616a2a tempest-VolumesAdminNegativeTest-1343453782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:24:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0eaddec8-212c-431c-89bf-176d1c616a2a tempest-VolumesAdminNegativeTest-1343453782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:24:00 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0eaddec8-212c-431c-89bf-176d1c616a2a tempest-VolumesAdminNegativeTest-1343453782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:24:00 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0eaddec8-212c-431c-89bf-176d1c616a2a tempest-VolumesAdminNegativeTest-1343453782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:24:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0eaddec8-212c-431c-89bf-176d1c616a2a tempest-VolumesAdminNegativeTest-1343453782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:24:00 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0eaddec8-212c-431c-89bf-176d1c616a2a tempest-VolumesAdminNegativeTest-1343453782 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:24:00 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-0eaddec8-212c-431c-89bf-176d1c616a2a tempest-VolumesAdminNegativeTest-1343453782 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:24:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0eaddec8-212c-431c-89bf-176d1c616a2a tempest-VolumesAdminNegativeTest-1343453782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1b8d911a-bd68-4c24-bce0-0c2be218fa6a 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:24:00 devstack sudo[88728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1b8d911a-bd68-4c24-bce0-0c2be218fa6a 1073741824 Nov 02 12:24:00 devstack sudo[88728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:24:01 devstack sudo[88728]: pam_unix(sudo:session): session closed for user root Nov 02 12:24:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0eaddec8-212c-431c-89bf-176d1c616a2a tempest-VolumesAdminNegativeTest-1343453782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1b8d911a-bd68-4c24-bce0-0c2be218fa6a 1073741824" returned: 0 in 1.563s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:24:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0eaddec8-212c-431c-89bf-176d1c616a2a tempest-VolumesAdminNegativeTest-1343453782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1b8d911a-bd68-4c24-bce0-0c2be218fa6a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:24:01 devstack sudo[88735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1b8d911a-bd68-4c24-bce0-0c2be218fa6a Nov 02 12:24:01 devstack sudo[88735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:24:02 devstack sudo[88735]: pam_unix(sudo:session): session closed for user root Nov 02 12:24:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0eaddec8-212c-431c-89bf-176d1c616a2a tempest-VolumesAdminNegativeTest-1343453782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1b8d911a-bd68-4c24-bce0-0c2be218fa6a" returned: 0 in 0.793s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:24:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0eaddec8-212c-431c-89bf-176d1c616a2a tempest-VolumesAdminNegativeTest-1343453782 None] <== create_volume: return (2609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:24:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0eaddec8-212c-431c-89bf-176d1c616a2a tempest-VolumesAdminNegativeTest-1343453782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.614s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:24:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0eaddec8-212c-431c-89bf-176d1c616a2a tempest-VolumesAdminNegativeTest-1343453782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37727fe3-8efc-4ca8-9f19-9de3a0e36378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b8d911a-bd68-4c24-bce0-0c2be218fa6a', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:24:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0eaddec8-212c-431c-89bf-176d1c616a2a tempest-VolumesAdminNegativeTest-1343453782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759375fe-9471-45f6-9ad4-e597129e5348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:24:02 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-0eaddec8-212c-431c-89bf-176d1c616a2a tempest-VolumesAdminNegativeTest-1343453782 None] Volume volume-1b8d911a-bd68-4c24-bce0-0c2be218fa6a (1b8d911a-bd68-4c24-bce0-0c2be218fa6a): created successfully Nov 02 12:24:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0eaddec8-212c-431c-89bf-176d1c616a2a tempest-VolumesAdminNegativeTest-1343453782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759375fe-9471-45f6-9ad4-e597129e5348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:24:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0eaddec8-212c-431c-89bf-176d1c616a2a tempest-VolumesAdminNegativeTest-1343453782 None] Flow 'volume_create_manager' (aaf26540-e24e-4a49-8965-b7733ef88f97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:24:02 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-0eaddec8-212c-431c-89bf-176d1c616a2a tempest-VolumesAdminNegativeTest-1343453782 None] Created volume successfully. Nov 02 12:24:05 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-40b8e089-8e26-4949-8972-9de15d6a7e31 tempest-VolumesAdminNegativeTest-1343453782 None] Acquiring lock "cinder-1b8d911a-bd68-4c24-bce0-0c2be218fa6a-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:24:05 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-40b8e089-8e26-4949-8972-9de15d6a7e31 tempest-VolumesAdminNegativeTest-1343453782 None] Lock "cinder-1b8d911a-bd68-4c24-bce0-0c2be218fa6a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:24:05 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-40b8e089-8e26-4949-8972-9de15d6a7e31 tempest-VolumesAdminNegativeTest-1343453782 None] Acquiring lock "cinder-quobyte-1b8d911a-bd68-4c24-bce0-0c2be218fa6a" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:24:05 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-40b8e089-8e26-4949-8972-9de15d6a7e31 tempest-VolumesAdminNegativeTest-1343453782 None] Lock "cinder-quobyte-1b8d911a-bd68-4c24-bce0-0c2be218fa6a" acquired by "delete_volume" :: waited 0.040s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:24:05 devstack cinder-volume[86515]: INFO oslo.privsep.daemon [None req-40b8e089-8e26-4949-8972-9de15d6a7e31 tempest-VolumesAdminNegativeTest-1343453782 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpcsu0sgef/privsep.sock'] Nov 02 12:24:05 devstack sudo[88857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpcsu0sgef/privsep.sock Nov 02 12:24:05 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:24:06 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-a5cdbefc-ca2c-4ad9-ad92-13bbc832611e req-e12d2c57-7c31-4e88-bdbe-3b3593ba02fa tempest-DeleteServersTestJSON-63113576 None] Terminate volume connection completed successfully. Nov 02 12:24:06 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-a5cdbefc-ca2c-4ad9-ad92-13bbc832611e req-e12d2c57-7c31-4e88-bdbe-3b3593ba02fa tempest-DeleteServersTestJSON-63113576 None] Deleting attachment e8f41e4b-1e06-460a-a73e-874a2c2f49b8. {{(pid=86515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:24:07 devstack cinder-volume[86515]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 02 12:24:07 devstack cinder-volume[86515]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 12:24:07 devstack cinder-volume[86515]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 02 12:24:07 devstack cinder-volume[86515]: WARNING oslo.privsep.daemon [-] privsep log: Nov 02 12:24:07 devstack cinder-volume[86515]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 02 12:24:07 devstack cinder-volume[86515]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 02 12:24:07 devstack cinder-volume[86515]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 12:24:07 devstack cinder-volume[86515]: WARNING oslo.privsep.daemon [-] privsep log: Nov 02 12:24:07 devstack cinder-volume[86515]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 02 12:24:07 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root Nov 02 12:24:07 devstack cinder-volume[86515]: INFO oslo.privsep.daemon [None req-40b8e089-8e26-4949-8972-9de15d6a7e31 tempest-VolumesAdminNegativeTest-1343453782 None] Spawned new privsep daemon via rootwrap Nov 02 12:24:07 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [None req-40b8e089-8e26-4949-8972-9de15d6a7e31 tempest-VolumesAdminNegativeTest-1343453782 None] Accepted privsep connection to /tmp/tmpcsu0sgef/privsep.sock {{(pid=86515) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 02 12:24:07 devstack cinder-volume[86515]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 02 12:24:07 devstack cinder-volume[86515]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 02 12:24:07 devstack cinder-volume[86515]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 02 12:24:07 devstack cinder-volume[86515]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88866 Nov 02 12:24:07 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f36a9d1-392e-47ad-898b-bde053ae59a6]: (2,) {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:24:07 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd56906-2e7d-4771-9766-8d414287cf9d]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:24:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-40b8e089-8e26-4949-8972-9de15d6a7e31 tempest-VolumesAdminNegativeTest-1343453782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1b8d911a-bd68-4c24-bce0-0c2be218fa6a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:24:07 devstack sudo[88868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1b8d911a-bd68-4c24-bce0-0c2be218fa6a Nov 02 12:24:07 devstack sudo[88868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:24:08 devstack sudo[88868]: pam_unix(sudo:session): session closed for user root Nov 02 12:24:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-40b8e089-8e26-4949-8972-9de15d6a7e31 tempest-VolumesAdminNegativeTest-1343453782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1b8d911a-bd68-4c24-bce0-0c2be218fa6a" returned: 0 in 0.612s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:24:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-40b8e089-8e26-4949-8972-9de15d6a7e31 tempest-VolumesAdminNegativeTest-1343453782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1b8d911a-bd68-4c24-bce0-0c2be218fa6a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:24:08 devstack sudo[88874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1b8d911a-bd68-4c24-bce0-0c2be218fa6a Nov 02 12:24:08 devstack sudo[88874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:24:09 devstack sudo[88874]: pam_unix(sudo:session): session closed for user root Nov 02 12:24:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-40b8e089-8e26-4949-8972-9de15d6a7e31 tempest-VolumesAdminNegativeTest-1343453782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1b8d911a-bd68-4c24-bce0-0c2be218fa6a" returned: 0 in 0.752s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:24:09 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-40b8e089-8e26-4949-8972-9de15d6a7e31 tempest-VolumesAdminNegativeTest-1343453782 None] Lock "cinder-quobyte-1b8d911a-bd68-4c24-bce0-0c2be218fa6a" released by "delete_volume" :: held 3.832s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:24:09 devstack cinder-volume[86515]: WARNING cinder.quota [None req-40b8e089-8e26-4949-8972-9de15d6a7e31 tempest-VolumesAdminNegativeTest-1343453782 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:24:09 devstack cinder-volume[86515]: WARNING cinder.quota [None req-40b8e089-8e26-4949-8972-9de15d6a7e31 tempest-VolumesAdminNegativeTest-1343453782 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:24:09 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-65438545-5e96-457b-b4ee-27380e63b4b4 tempest-DeleteServersTestJSON-63113576 None] Acquiring lock "cinder-71efa313-4999-402e-9fe2-1c0e6748c1a8-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:24:09 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-40b8e089-8e26-4949-8972-9de15d6a7e31 tempest-VolumesAdminNegativeTest-1343453782 None] Created reservations ['842a14b5-4f36-4d28-991e-f3727e67b33d', '8224e931-d8e0-4414-880f-65e0f49a212d', '3b6bbe9c-90fe-4694-9225-d68180574837', 'bc4cbbf8-60d6-4ee8-a0b2-0f92a6f6e84f'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:24:09 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-65438545-5e96-457b-b4ee-27380e63b4b4 tempest-DeleteServersTestJSON-63113576 None] Lock "cinder-71efa313-4999-402e-9fe2-1c0e6748c1a8-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:24:09 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-65438545-5e96-457b-b4ee-27380e63b4b4 tempest-DeleteServersTestJSON-63113576 None] Acquiring lock "cinder-quobyte-71efa313-4999-402e-9fe2-1c0e6748c1a8" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:24:09 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-65438545-5e96-457b-b4ee-27380e63b4b4 tempest-DeleteServersTestJSON-63113576 None] Lock "cinder-quobyte-71efa313-4999-402e-9fe2-1c0e6748c1a8" acquired by "delete_volume" :: waited 0.059s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:24:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-40b8e089-8e26-4949-8972-9de15d6a7e31 tempest-VolumesAdminNegativeTest-1343453782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:24:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-40b8e089-8e26-4949-8972-9de15d6a7e31 tempest-VolumesAdminNegativeTest-1343453782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:24:09 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-40b8e089-8e26-4949-8972-9de15d6a7e31 tempest-VolumesAdminNegativeTest-1343453782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:24:09 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-40b8e089-8e26-4949-8972-9de15d6a7e31 tempest-VolumesAdminNegativeTest-1343453782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:24:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-40b8e089-8e26-4949-8972-9de15d6a7e31 tempest-VolumesAdminNegativeTest-1343453782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:24:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-40b8e089-8e26-4949-8972-9de15d6a7e31 tempest-VolumesAdminNegativeTest-1343453782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:24:09 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e45232f-cf9c-465d-b725-125ebf3d40af]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:24:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-65438545-5e96-457b-b4ee-27380e63b4b4 tempest-DeleteServersTestJSON-63113576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-71efa313-4999-402e-9fe2-1c0e6748c1a8 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:24:09 devstack sudo[88878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:24:09 devstack sudo[88878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:24:09 devstack sudo[88879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-71efa313-4999-402e-9fe2-1c0e6748c1a8 Nov 02 12:24:09 devstack sudo[88879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:24:10 devstack sudo[88878]: pam_unix(sudo:session): session closed for user root Nov 02 12:24:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-40b8e089-8e26-4949-8972-9de15d6a7e31 tempest-VolumesAdminNegativeTest-1343453782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.505s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:24:10 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-40b8e089-8e26-4949-8972-9de15d6a7e31 tempest-VolumesAdminNegativeTest-1343453782 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:24:10 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-40b8e089-8e26-4949-8972-9de15d6a7e31 tempest-VolumesAdminNegativeTest-1343453782 None] Deleted volume successfully. Nov 02 12:24:10 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-40b8e089-8e26-4949-8972-9de15d6a7e31 tempest-VolumesAdminNegativeTest-1343453782 None] Lock "cinder-1b8d911a-bd68-4c24-bce0-0c2be218fa6a-delete_volume" released by "delete_volume" :: held 5.005s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:24:10 devstack sudo[88879]: pam_unix(sudo:session): session closed for user root Nov 02 12:24:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-65438545-5e96-457b-b4ee-27380e63b4b4 tempest-DeleteServersTestJSON-63113576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-71efa313-4999-402e-9fe2-1c0e6748c1a8" returned: 0 in 0.821s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:24:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-65438545-5e96-457b-b4ee-27380e63b4b4 tempest-DeleteServersTestJSON-63113576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-71efa313-4999-402e-9fe2-1c0e6748c1a8 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:24:10 devstack sudo[88888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-71efa313-4999-402e-9fe2-1c0e6748c1a8 Nov 02 12:24:10 devstack sudo[88888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:24:10 devstack sudo[88888]: pam_unix(sudo:session): session closed for user root Nov 02 12:24:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-65438545-5e96-457b-b4ee-27380e63b4b4 tempest-DeleteServersTestJSON-63113576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-71efa313-4999-402e-9fe2-1c0e6748c1a8" returned: 0 in 0.371s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:24:10 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-65438545-5e96-457b-b4ee-27380e63b4b4 tempest-DeleteServersTestJSON-63113576 None] Lock "cinder-quobyte-71efa313-4999-402e-9fe2-1c0e6748c1a8" released by "delete_volume" :: held 1.306s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:24:10 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-65438545-5e96-457b-b4ee-27380e63b4b4 tempest-DeleteServersTestJSON-63113576 None] Created reservations ['896e807a-8a2e-4d65-aebd-a273d9d3a440', '7bc50c60-4a9d-4235-b938-b7e08d21cadd', '594da915-09cb-4ed7-96b2-b753eb9bbd2a', '54437d6d-ed52-45d5-95ab-eb2c8f86ceaa'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:24:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-65438545-5e96-457b-b4ee-27380e63b4b4 tempest-DeleteServersTestJSON-63113576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:24:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-65438545-5e96-457b-b4ee-27380e63b4b4 tempest-DeleteServersTestJSON-63113576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:24:11 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-65438545-5e96-457b-b4ee-27380e63b4b4 tempest-DeleteServersTestJSON-63113576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:24:11 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-65438545-5e96-457b-b4ee-27380e63b4b4 tempest-DeleteServersTestJSON-63113576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:24:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-65438545-5e96-457b-b4ee-27380e63b4b4 tempest-DeleteServersTestJSON-63113576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:24:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-65438545-5e96-457b-b4ee-27380e63b4b4 tempest-DeleteServersTestJSON-63113576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:24:11 devstack sudo[88928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:24:11 devstack sudo[88928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:24:11 devstack sudo[88928]: pam_unix(sudo:session): session closed for user root Nov 02 12:24:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-65438545-5e96-457b-b4ee-27380e63b4b4 tempest-DeleteServersTestJSON-63113576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.466s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:24:11 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-65438545-5e96-457b-b4ee-27380e63b4b4 tempest-DeleteServersTestJSON-63113576 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:24:11 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-65438545-5e96-457b-b4ee-27380e63b4b4 tempest-DeleteServersTestJSON-63113576 None] Deleted volume successfully. Nov 02 12:24:11 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-65438545-5e96-457b-b4ee-27380e63b4b4 tempest-DeleteServersTestJSON-63113576 None] Lock "cinder-71efa313-4999-402e-9fe2-1c0e6748c1a8-delete_volume" released by "delete_volume" :: held 2.247s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:24:21 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:UPDATE=31,cinder:SELECT=23,cinder:INSERT=7,cinder:DELETE=2 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:24:21 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=24,cinder:UPDATE=22,cinder:INSERT=4,cinder:DELETE=3 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:24:22 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-2a4e42e4-d229-4588-80b7-6b22ffe19dcc tempest-ServerRescueNegativeTestJSON-1057307613 None] Acquiring lock "cinder-adb8c99a-9aea-48e5-adae-fde1b3185286-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:24:22 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-2a4e42e4-d229-4588-80b7-6b22ffe19dcc tempest-ServerRescueNegativeTestJSON-1057307613 None] Lock "cinder-adb8c99a-9aea-48e5-adae-fde1b3185286-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:24:22 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-2a4e42e4-d229-4588-80b7-6b22ffe19dcc tempest-ServerRescueNegativeTestJSON-1057307613 None] Acquiring lock "cinder-quobyte-adb8c99a-9aea-48e5-adae-fde1b3185286" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:24:22 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-2a4e42e4-d229-4588-80b7-6b22ffe19dcc tempest-ServerRescueNegativeTestJSON-1057307613 None] Lock "cinder-quobyte-adb8c99a-9aea-48e5-adae-fde1b3185286" acquired by "delete_volume" :: waited 0.031s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:24:22 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5f2d0d-c28b-4faf-84c2-4b5076fb10d7]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:24:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2a4e42e4-d229-4588-80b7-6b22ffe19dcc tempest-ServerRescueNegativeTestJSON-1057307613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-adb8c99a-9aea-48e5-adae-fde1b3185286 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:24:22 devstack sudo[88953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-adb8c99a-9aea-48e5-adae-fde1b3185286 Nov 02 12:24:22 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:24:23 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root Nov 02 12:24:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2a4e42e4-d229-4588-80b7-6b22ffe19dcc tempest-ServerRescueNegativeTestJSON-1057307613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-adb8c99a-9aea-48e5-adae-fde1b3185286" returned: 0 in 0.783s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:24:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2a4e42e4-d229-4588-80b7-6b22ffe19dcc tempest-ServerRescueNegativeTestJSON-1057307613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-adb8c99a-9aea-48e5-adae-fde1b3185286 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:24:23 devstack sudo[88958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-adb8c99a-9aea-48e5-adae-fde1b3185286 Nov 02 12:24:23 devstack sudo[88958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:24:24 devstack sudo[88958]: pam_unix(sudo:session): session closed for user root Nov 02 12:24:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2a4e42e4-d229-4588-80b7-6b22ffe19dcc tempest-ServerRescueNegativeTestJSON-1057307613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-adb8c99a-9aea-48e5-adae-fde1b3185286" returned: 0 in 0.508s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:24:24 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-2a4e42e4-d229-4588-80b7-6b22ffe19dcc tempest-ServerRescueNegativeTestJSON-1057307613 None] Lock "cinder-quobyte-adb8c99a-9aea-48e5-adae-fde1b3185286" released by "delete_volume" :: held 1.403s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:24:24 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-2a4e42e4-d229-4588-80b7-6b22ffe19dcc tempest-ServerRescueNegativeTestJSON-1057307613 None] Created reservations ['02d44534-4268-4cd0-b868-769f4510cded', '9363d1a4-3625-4f1d-85cd-b91401ea780e', '70a2428c-4514-4800-92e0-cb1ea1b9936d', '53f20852-6f63-4738-9593-2bf5021b1512'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:24:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2a4e42e4-d229-4588-80b7-6b22ffe19dcc tempest-ServerRescueNegativeTestJSON-1057307613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:24:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2a4e42e4-d229-4588-80b7-6b22ffe19dcc tempest-ServerRescueNegativeTestJSON-1057307613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:24:24 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-2a4e42e4-d229-4588-80b7-6b22ffe19dcc tempest-ServerRescueNegativeTestJSON-1057307613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:24:24 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-2a4e42e4-d229-4588-80b7-6b22ffe19dcc tempest-ServerRescueNegativeTestJSON-1057307613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:24:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2a4e42e4-d229-4588-80b7-6b22ffe19dcc tempest-ServerRescueNegativeTestJSON-1057307613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:24:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2a4e42e4-d229-4588-80b7-6b22ffe19dcc tempest-ServerRescueNegativeTestJSON-1057307613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:24:24 devstack sudo[88962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:24:24 devstack sudo[88962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:24:25 devstack sudo[88962]: pam_unix(sudo:session): session closed for user root Nov 02 12:24:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2a4e42e4-d229-4588-80b7-6b22ffe19dcc tempest-ServerRescueNegativeTestJSON-1057307613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.611s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:24:25 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-2a4e42e4-d229-4588-80b7-6b22ffe19dcc tempest-ServerRescueNegativeTestJSON-1057307613 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:24:25 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-2a4e42e4-d229-4588-80b7-6b22ffe19dcc tempest-ServerRescueNegativeTestJSON-1057307613 None] Deleted volume successfully. Nov 02 12:24:25 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-2a4e42e4-d229-4588-80b7-6b22ffe19dcc tempest-ServerRescueNegativeTestJSON-1057307613 None] Lock "cinder-adb8c99a-9aea-48e5-adae-fde1b3185286-delete_volume" released by "delete_volume" :: held 2.586s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:24:34 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:UPDATE=9,cinder:SELECT=5,cinder:INSERT=2 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:24:35 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:24:41 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-a36d27bd-2a6b-40e0-a171-bec67726c73c tempest-TaggedAttachmentsTest-1731010272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:24:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a36d27bd-2a6b-40e0-a171-bec67726c73c tempest-TaggedAttachmentsTest-1731010272 None] Flow 'volume_create_manager' (18a49de3-d0d0-4aa5-aaaa-fad4242eed2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:24:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a36d27bd-2a6b-40e0-a171-bec67726c73c tempest-TaggedAttachmentsTest-1731010272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d076c5d-882b-40c2-b006-723c62d0da99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:24:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a36d27bd-2a6b-40e0-a171-bec67726c73c tempest-TaggedAttachmentsTest-1731010272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d076c5d-882b-40c2-b006-723c62d0da99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-6889960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d4be753-bd7e-4b0c-bb8d-c1b01a6e4a1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a7440ef7f714f6aacf4f29c585e263b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:24:42Z,use_quota=True,user_id='327b122f89c84f48bba5120e35d57b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:24:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a36d27bd-2a6b-40e0-a171-bec67726c73c tempest-TaggedAttachmentsTest-1731010272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36df3aef-706a-4387-bb82-967ce891b671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:24:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a36d27bd-2a6b-40e0-a171-bec67726c73c tempest-TaggedAttachmentsTest-1731010272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36df3aef-706a-4387-bb82-967ce891b671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:24:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a36d27bd-2a6b-40e0-a171-bec67726c73c tempest-TaggedAttachmentsTest-1731010272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a29e8d84-dd2c-4fac-9b31-ff6db93c24c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:24:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a36d27bd-2a6b-40e0-a171-bec67726c73c tempest-TaggedAttachmentsTest-1731010272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a29e8d84-dd2c-4fac-9b31-ff6db93c24c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d4be753-bd7e-4b0c-bb8d-c1b01a6e4a1c', 'volume_name': 'volume-3d4be753-bd7e-4b0c-bb8d-c1b01a6e4a1c', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:24:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a36d27bd-2a6b-40e0-a171-bec67726c73c tempest-TaggedAttachmentsTest-1731010272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd3db23-1cee-4180-89b7-e78ea5557f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:24:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a36d27bd-2a6b-40e0-a171-bec67726c73c tempest-TaggedAttachmentsTest-1731010272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd3db23-1cee-4180-89b7-e78ea5557f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:24:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a36d27bd-2a6b-40e0-a171-bec67726c73c tempest-TaggedAttachmentsTest-1731010272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c51d85dd-d33f-4384-ae62-767de1c3ee16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:24:42 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-a36d27bd-2a6b-40e0-a171-bec67726c73c tempest-TaggedAttachmentsTest-1731010272 None] Volume 3d4be753-bd7e-4b0c-bb8d-c1b01a6e4a1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d4be753-bd7e-4b0c-bb8d-c1b01a6e4a1c', 'volume_size': 1} Nov 02 12:24:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a36d27bd-2a6b-40e0-a171-bec67726c73c tempest-TaggedAttachmentsTest-1731010272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:24:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a36d27bd-2a6b-40e0-a171-bec67726c73c tempest-TaggedAttachmentsTest-1731010272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:24:42 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a36d27bd-2a6b-40e0-a171-bec67726c73c tempest-TaggedAttachmentsTest-1731010272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-6889960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d4be753-bd7e-4b0c-bb8d-c1b01a6e4a1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a7440ef7f714f6aacf4f29c585e263b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:24:42Z,use_quota=True,user_id='327b122f89c84f48bba5120e35d57b3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:24:42 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-a36d27bd-2a6b-40e0-a171-bec67726c73c tempest-TaggedAttachmentsTest-1731010272 None] Creating volume 3d4be753-bd7e-4b0c-bb8d-c1b01a6e4a1c {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:24:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a36d27bd-2a6b-40e0-a171-bec67726c73c tempest-TaggedAttachmentsTest-1731010272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:24:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a36d27bd-2a6b-40e0-a171-bec67726c73c tempest-TaggedAttachmentsTest-1731010272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:24:42 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a36d27bd-2a6b-40e0-a171-bec67726c73c tempest-TaggedAttachmentsTest-1731010272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:24:42 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a36d27bd-2a6b-40e0-a171-bec67726c73c tempest-TaggedAttachmentsTest-1731010272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:24:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a36d27bd-2a6b-40e0-a171-bec67726c73c tempest-TaggedAttachmentsTest-1731010272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:24:42 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a36d27bd-2a6b-40e0-a171-bec67726c73c tempest-TaggedAttachmentsTest-1731010272 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:24:42 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-a36d27bd-2a6b-40e0-a171-bec67726c73c tempest-TaggedAttachmentsTest-1731010272 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:24:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a36d27bd-2a6b-40e0-a171-bec67726c73c tempest-TaggedAttachmentsTest-1731010272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d4be753-bd7e-4b0c-bb8d-c1b01a6e4a1c 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:24:42 devstack sudo[89074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d4be753-bd7e-4b0c-bb8d-c1b01a6e4a1c 1073741824 Nov 02 12:24:42 devstack sudo[89074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:24:42 devstack sudo[89074]: pam_unix(sudo:session): session closed for user root Nov 02 12:24:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a36d27bd-2a6b-40e0-a171-bec67726c73c tempest-TaggedAttachmentsTest-1731010272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d4be753-bd7e-4b0c-bb8d-c1b01a6e4a1c 1073741824" returned: 0 in 0.558s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:24:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a36d27bd-2a6b-40e0-a171-bec67726c73c tempest-TaggedAttachmentsTest-1731010272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d4be753-bd7e-4b0c-bb8d-c1b01a6e4a1c {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:24:42 devstack sudo[89082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d4be753-bd7e-4b0c-bb8d-c1b01a6e4a1c Nov 02 12:24:42 devstack sudo[89082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:24:42 devstack sudo[89082]: pam_unix(sudo:session): session closed for user root Nov 02 12:24:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a36d27bd-2a6b-40e0-a171-bec67726c73c tempest-TaggedAttachmentsTest-1731010272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d4be753-bd7e-4b0c-bb8d-c1b01a6e4a1c" returned: 0 in 0.331s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:24:42 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a36d27bd-2a6b-40e0-a171-bec67726c73c tempest-TaggedAttachmentsTest-1731010272 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:24:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a36d27bd-2a6b-40e0-a171-bec67726c73c tempest-TaggedAttachmentsTest-1731010272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:24:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a36d27bd-2a6b-40e0-a171-bec67726c73c tempest-TaggedAttachmentsTest-1731010272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c51d85dd-d33f-4384-ae62-767de1c3ee16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d4be753-bd7e-4b0c-bb8d-c1b01a6e4a1c', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:24:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a36d27bd-2a6b-40e0-a171-bec67726c73c tempest-TaggedAttachmentsTest-1731010272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae459b2-2650-4bda-9dca-c9bae3fc35ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:24:43 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-a36d27bd-2a6b-40e0-a171-bec67726c73c tempest-TaggedAttachmentsTest-1731010272 None] Volume volume-3d4be753-bd7e-4b0c-bb8d-c1b01a6e4a1c (3d4be753-bd7e-4b0c-bb8d-c1b01a6e4a1c): created successfully Nov 02 12:24:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a36d27bd-2a6b-40e0-a171-bec67726c73c tempest-TaggedAttachmentsTest-1731010272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae459b2-2650-4bda-9dca-c9bae3fc35ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:24:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a36d27bd-2a6b-40e0-a171-bec67726c73c tempest-TaggedAttachmentsTest-1731010272 None] Flow 'volume_create_manager' (18a49de3-d0d0-4aa5-aaaa-fad4242eed2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:24:43 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-a36d27bd-2a6b-40e0-a171-bec67726c73c tempest-TaggedAttachmentsTest-1731010272 None] Created volume successfully. Nov 02 12:24:43 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:24:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:24:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:24:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:24:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:24:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:24:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:24:43 devstack sudo[89086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:24:43 devstack sudo[89086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:24:44 devstack sudo[89086]: pam_unix(sudo:session): session closed for user root Nov 02 12:24:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.322s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:24:44 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:24:44 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager._thread_info {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:24:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread count: 8 {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:24:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread info: [<_MainThread(MainThread, started 129944084402304)>, , , , , , , ] {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:24:55 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e7085dc8-2d43-444c-b788-b1a480b5ac44 tempest-BackendsCapabilitiesAdminTestsJSON-1017666759 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8458518981934, 'free_capacity_gb': 1773.8458518981934, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86515) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 12:24:56 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-477e65ec-3ab3-4ed8-a1b5-45447b7968da tempest-BackendsCapabilitiesAdminTestsJSON-1017666759 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8458518981934, 'free_capacity_gb': 1773.8458518981934, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86515) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 12:24:56 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:UPDATE=4,cinder:SELECT=3 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:24:56 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:25:08 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-72638d62-2d6d-46f9-89a3-e9b2a3a68bea tempest-GroupSnapshotsTest-1165447445 None] Group tempest-GroupSnapshotsTest-Group-975452354: creating Nov 02 12:25:08 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-72638d62-2d6d-46f9-89a3-e9b2a3a68bea tempest-GroupSnapshotsTest-1165447445 None] Group tempest-GroupSnapshotsTest-Group-975452354: created successfully Nov 02 12:25:08 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-72638d62-2d6d-46f9-89a3-e9b2a3a68bea tempest-GroupSnapshotsTest-1165447445 None] Create group completed successfully. Nov 02 12:25:10 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-00e7abfa-12b0-4805-8863-5b61416540d6 tempest-GroupSnapshotsTest-1165447445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:25:10 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-00e7abfa-12b0-4805-8863-5b61416540d6 tempest-GroupSnapshotsTest-1165447445 None] Flow 'volume_create_manager' (428a8382-c005-4fe4-9ad3-6764a8b81095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:25:10 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-00e7abfa-12b0-4805-8863-5b61416540d6 tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a04bff-b984-468f-a2a8-f4b5ff1b39e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:25:10 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-00e7abfa-12b0-4805-8863-5b61416540d6 tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a04bff-b984-468f-a2a8-f4b5ff1b39e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1217226158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=12e860a8-3e11-4890-8c16-8c535e7db9cc,host='devstack@QuobyteHD#QuobyteHD',id=e0907c60-ebac-43ff-b3cb-896aa9dee640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b48ce9380a846ea89be74e7df3ebac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:25:10Z,use_quota=True,user_id='6c45dc15c9e744cc8b5ed18dbcb28dcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d905c116-8864-4559-8262-90531345d20d),volume_type_id=d905c116-8864-4559-8262-90531345d20d)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:25:10 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-00e7abfa-12b0-4805-8863-5b61416540d6 tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c8c2744-e9c3-4184-ba46-f761dfeda6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:25:10 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-00e7abfa-12b0-4805-8863-5b61416540d6 tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c8c2744-e9c3-4184-ba46-f761dfeda6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:25:10 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-00e7abfa-12b0-4805-8863-5b61416540d6 tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (629ddac0-1781-4561-a57a-40f9d1b2318e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:25:10 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-00e7abfa-12b0-4805-8863-5b61416540d6 tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (629ddac0-1781-4561-a57a-40f9d1b2318e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0907c60-ebac-43ff-b3cb-896aa9dee640', 'volume_name': 'volume-e0907c60-ebac-43ff-b3cb-896aa9dee640', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:25:10 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-00e7abfa-12b0-4805-8863-5b61416540d6 tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da903d87-9d2c-45c2-8871-622ebd97122f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:25:10 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-00e7abfa-12b0-4805-8863-5b61416540d6 tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da903d87-9d2c-45c2-8871-622ebd97122f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:25:10 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-00e7abfa-12b0-4805-8863-5b61416540d6 tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9b668c8-d90d-4309-8243-3bb2493d7550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:25:10 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-00e7abfa-12b0-4805-8863-5b61416540d6 tempest-GroupSnapshotsTest-1165447445 None] Volume e0907c60-ebac-43ff-b3cb-896aa9dee640: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0907c60-ebac-43ff-b3cb-896aa9dee640', 'volume_size': 1} Nov 02 12:25:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-00e7abfa-12b0-4805-8863-5b61416540d6 tempest-GroupSnapshotsTest-1165447445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:25:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-00e7abfa-12b0-4805-8863-5b61416540d6 tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:25:10 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-00e7abfa-12b0-4805-8863-5b61416540d6 tempest-GroupSnapshotsTest-1165447445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=12e860a8-3e11-4890-8c16-8c535e7db9cc,created_at=2026-11-02T11:25:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1217226158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=12e860a8-3e11-4890-8c16-8c535e7db9cc,host='devstack@QuobyteHD#QuobyteHD',id=e0907c60-ebac-43ff-b3cb-896aa9dee640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b48ce9380a846ea89be74e7df3ebac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:25:10Z,use_quota=True,user_id='6c45dc15c9e744cc8b5ed18dbcb28dcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d905c116-8864-4559-8262-90531345d20d),volume_type_id=d905c116-8864-4559-8262-90531345d20d)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:25:10 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-00e7abfa-12b0-4805-8863-5b61416540d6 tempest-GroupSnapshotsTest-1165447445 None] Creating volume e0907c60-ebac-43ff-b3cb-896aa9dee640 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:25:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-00e7abfa-12b0-4805-8863-5b61416540d6 tempest-GroupSnapshotsTest-1165447445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:25:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-00e7abfa-12b0-4805-8863-5b61416540d6 tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:25:10 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-00e7abfa-12b0-4805-8863-5b61416540d6 tempest-GroupSnapshotsTest-1165447445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:25:10 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-00e7abfa-12b0-4805-8863-5b61416540d6 tempest-GroupSnapshotsTest-1165447445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:25:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-00e7abfa-12b0-4805-8863-5b61416540d6 tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:25:10 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-00e7abfa-12b0-4805-8863-5b61416540d6 tempest-GroupSnapshotsTest-1165447445 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:25:10 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-00e7abfa-12b0-4805-8863-5b61416540d6 tempest-GroupSnapshotsTest-1165447445 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:25:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-00e7abfa-12b0-4805-8863-5b61416540d6 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:10 devstack sudo[89628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640 1073741824 Nov 02 12:25:10 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:11 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-00e7abfa-12b0-4805-8863-5b61416540d6 tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640 1073741824" returned: 0 in 0.794s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-00e7abfa-12b0-4805-8863-5b61416540d6 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:11 devstack sudo[89720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640 Nov 02 12:25:11 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:12 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-00e7abfa-12b0-4805-8863-5b61416540d6 tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640" returned: 0 in 0.539s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:12 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-00e7abfa-12b0-4805-8863-5b61416540d6 tempest-GroupSnapshotsTest-1165447445 None] <== create_volume: return (1697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:25:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-00e7abfa-12b0-4805-8863-5b61416540d6 tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:25:12 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-00e7abfa-12b0-4805-8863-5b61416540d6 tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9b668c8-d90d-4309-8243-3bb2493d7550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0907c60-ebac-43ff-b3cb-896aa9dee640', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:25:12 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-00e7abfa-12b0-4805-8863-5b61416540d6 tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba26ce81-b81c-427f-bd15-f3efd6a23097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:25:12 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-00e7abfa-12b0-4805-8863-5b61416540d6 tempest-GroupSnapshotsTest-1165447445 None] Volume volume-e0907c60-ebac-43ff-b3cb-896aa9dee640 (e0907c60-ebac-43ff-b3cb-896aa9dee640): created successfully Nov 02 12:25:12 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-00e7abfa-12b0-4805-8863-5b61416540d6 tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba26ce81-b81c-427f-bd15-f3efd6a23097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:25:12 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-00e7abfa-12b0-4805-8863-5b61416540d6 tempest-GroupSnapshotsTest-1165447445 None] Flow 'volume_create_manager' (428a8382-c005-4fe4-9ad3-6764a8b81095) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:25:12 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-00e7abfa-12b0-4805-8863-5b61416540d6 tempest-GroupSnapshotsTest-1165447445 None] Created volume successfully. Nov 02 12:25:13 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-cf4ccae9-5e6c-4d8d-abd4-d1cb084f5dfe tempest-GroupSnapshotsTest-1165447445 None] GroupSnapshot 4246b48d-e166-451c-be90-f08cf4e93a67: creating. Nov 02 12:25:14 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-cf4ccae9-5e6c-4d8d-abd4-d1cb084f5dfe tempest-GroupSnapshotsTest-1165447445 None] Group snapshot 4246b48d-e166-451c-be90-f08cf4e93a67: creating. {{(pid=86515) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 12:25:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-cf4ccae9-5e6c-4d8d-abd4-d1cb084f5dfe tempest-GroupSnapshotsTest-1165447445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:25:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-cf4ccae9-5e6c-4d8d-abd4-d1cb084f5dfe tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:25:14 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-cf4ccae9-5e6c-4d8d-abd4-d1cb084f5dfe tempest-GroupSnapshotsTest-1165447445 None] Creating offline snapshot 439bd3f3-57a9-4fc6-8ff1-7cc034a58f8b of volume e0907c60-ebac-43ff-b3cb-896aa9dee640 {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:25:14 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf94960a-2348-4d97-922b-4786c98e3c80]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:25:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cf4ccae9-5e6c-4d8d-abd4-d1cb084f5dfe tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:14 devstack sudo[89726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640 Nov 02 12:25:14 devstack sudo[89726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:14 devstack sudo[89726]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cf4ccae9-5e6c-4d8d-abd4-d1cb084f5dfe tempest-GroupSnapshotsTest-1165447445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640" returned: 0 in 0.698s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cf4ccae9-5e6c-4d8d-abd4-d1cb084f5dfe tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640.439bd3f3-57a9-4fc6-8ff1-7cc034a58f8b 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:14 devstack sudo[89754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640.439bd3f3-57a9-4fc6-8ff1-7cc034a58f8b 1G Nov 02 12:25:14 devstack sudo[89754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:15 devstack sudo[89754]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cf4ccae9-5e6c-4d8d-abd4-d1cb084f5dfe tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640.439bd3f3-57a9-4fc6-8ff1-7cc034a58f8b 1G" returned: 0 in 0.504s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cf4ccae9-5e6c-4d8d-abd4-d1cb084f5dfe tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0907c60-ebac-43ff-b3cb-896aa9dee640 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640.439bd3f3-57a9-4fc6-8ff1-7cc034a58f8b {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:15 devstack sudo[89760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0907c60-ebac-43ff-b3cb-896aa9dee640 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640.439bd3f3-57a9-4fc6-8ff1-7cc034a58f8b Nov 02 12:25:15 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:15 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cf4ccae9-5e6c-4d8d-abd4-d1cb084f5dfe tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0907c60-ebac-43ff-b3cb-896aa9dee640 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640.439bd3f3-57a9-4fc6-8ff1-7cc034a58f8b" returned: 0 in 0.322s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:15 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-cf4ccae9-5e6c-4d8d-abd4-d1cb084f5dfe tempest-GroupSnapshotsTest-1165447445 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640.439bd3f3-57a9-4fc6-8ff1-7cc034a58f8b is being set with open permissions: ugo+rw: NotImplementedError Nov 02 12:25:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cf4ccae9-5e6c-4d8d-abd4-d1cb084f5dfe tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640.439bd3f3-57a9-4fc6-8ff1-7cc034a58f8b {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:15 devstack sudo[89766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640.439bd3f3-57a9-4fc6-8ff1-7cc034a58f8b Nov 02 12:25:15 devstack sudo[89766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:16 devstack sudo[89766]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cf4ccae9-5e6c-4d8d-abd4-d1cb084f5dfe tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640.439bd3f3-57a9-4fc6-8ff1-7cc034a58f8b" returned: 0 in 0.276s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cf4ccae9-5e6c-4d8d-abd4-d1cb084f5dfe tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:16 devstack sudo[89769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640.info Nov 02 12:25:16 devstack sudo[89769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:16 devstack sudo[89769]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cf4ccae9-5e6c-4d8d-abd4-d1cb084f5dfe tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640.info" returned: 0 in 0.367s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:16 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-cf4ccae9-5e6c-4d8d-abd4-d1cb084f5dfe tempest-GroupSnapshotsTest-1165447445 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 12:25:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cf4ccae9-5e6c-4d8d-abd4-d1cb084f5dfe tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:16 devstack sudo[89772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640.info Nov 02 12:25:16 devstack sudo[89772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:16 devstack sudo[89772]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cf4ccae9-5e6c-4d8d-abd4-d1cb084f5dfe tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640.info" returned: 0 in 0.286s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-cf4ccae9-5e6c-4d8d-abd4-d1cb084f5dfe tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.626s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:25:16 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-cf4ccae9-5e6c-4d8d-abd4-d1cb084f5dfe tempest-GroupSnapshotsTest-1165447445 None] group_snapshot 4246b48d-e166-451c-be90-f08cf4e93a67: created successfully Nov 02 12:25:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:25:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:25:18 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] Acquiring lock "cinder-quobyte-439bd3f3-57a9-4fc6-8ff1-7cc034a58f8b-3c57abf6-069a-44b1-985f-ee4bb15765df" by "_create_volume_from_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:25:18 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] Lock "cinder-quobyte-439bd3f3-57a9-4fc6-8ff1-7cc034a58f8b-3c57abf6-069a-44b1-985f-ee4bb15765df" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:25:18 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] Creating volume 3c57abf6-069a-44b1-985f-ee4bb15765df from snapshot 439bd3f3-57a9-4fc6-8ff1-7cc034a58f8b {{(pid=86515) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 12:25:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:25:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:25:18 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:25:18 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:25:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:25:18 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:25:18 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] Acquiring lock "cinder-quobyte-3c57abf6-069a-44b1-985f-ee4bb15765df" by "_copy_volume_from_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:25:18 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] Lock "cinder-quobyte-3c57abf6-069a-44b1-985f-ee4bb15765df" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:25:18 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] snapshot: 439bd3f3-57a9-4fc6-8ff1-7cc034a58f8b, volume: 3c57abf6-069a-44b1-985f-ee4bb15765df, {{(pid=86515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 12:25:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:25:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:25:18 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:25:18 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:25:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:25:18 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd13f34a-6178-4162-9a0f-75fa17ab3ff6]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:25:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640.439bd3f3-57a9-4fc6-8ff1-7cc034a58f8b {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:18 devstack sudo[89775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640.439bd3f3-57a9-4fc6-8ff1-7cc034a58f8b Nov 02 12:25:18 devstack sudo[89775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:18 devstack sudo[89775]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640.439bd3f3-57a9-4fc6-8ff1-7cc034a58f8b" returned: 0 in 0.453s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:18 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0907c60-ebac-43ff-b3cb-896aa9dee640(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:25:18 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bc8d81-4fbd-44b2-9259-a2712bd33714]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:25:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:18 devstack sudo[89780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640 Nov 02 12:25:18 devstack sudo[89780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:19 devstack sudo[89780]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640" returned: 0 in 0.394s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:19 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] will copy from snapshot at /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640 {{(pid=86515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 12:25:19 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] Creating direct copy from snapshot {{(pid=86515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 12:25:19 devstack cinder-volume[86515]: DEBUG cinder.utils [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] Path /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3c57abf6-069a-44b1-985f-ee4bb15765df not found in is_blk_device check {{(pid=86515) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 12:25:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3c57abf6-069a-44b1-985f-ee4bb15765df {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:19 devstack sudo[89785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3c57abf6-069a-44b1-985f-ee4bb15765df Nov 02 12:25:19 devstack sudo[89785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:27 devstack sudo[89785]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3c57abf6-069a-44b1-985f-ee4bb15765df" returned: 0 in 8.580s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:27 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] Image conversion details: src /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640, size 1024.00 MB, duration 8.58 sec, destination /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3c57abf6-069a-44b1-985f-ee4bb15765df {{(pid=86515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 12:25:27 devstack cinder-volume[86515]: INFO cinder.image.image_utils [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] Converted 1024.00 MB image at 119.33 MB/s Nov 02 12:25:27 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3c57abf6-069a-44b1-985f-ee4bb15765df is being set with open permissions: ugo+rw: NotImplementedError Nov 02 12:25:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3c57abf6-069a-44b1-985f-ee4bb15765df {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:27 devstack sudo[89865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3c57abf6-069a-44b1-985f-ee4bb15765df Nov 02 12:25:27 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:28 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=14,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:25:28 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3c57abf6-069a-44b1-985f-ee4bb15765df" returned: 0 in 0.428s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] Lock "cinder-quobyte-3c57abf6-069a-44b1-985f-ee4bb15765df" released by "_copy_volume_from_snapshot" :: held 9.961s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:25:28 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0636464-7adf-49d9-86af-3d3a37e2bf27 tempest-AttachVolumeTestJSON-1055770325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:25:28 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b0636464-7adf-49d9-86af-3d3a37e2bf27 tempest-AttachVolumeTestJSON-1055770325 None] Flow 'volume_create_manager' (c434fb00-885a-4b87-b7ef-ccae1431760c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:25:28 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b0636464-7adf-49d9-86af-3d3a37e2bf27 tempest-AttachVolumeTestJSON-1055770325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3920661-54d8-433c-8702-87afa58a2a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:25:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] Lock "cinder-quobyte-439bd3f3-57a9-4fc6-8ff1-7cc034a58f8b-3c57abf6-069a-44b1-985f-ee4bb15765df" released by "_create_volume_from_snapshot" :: held 10.091s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:25:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.115s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:25:28 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b0636464-7adf-49d9-86af-3d3a37e2bf27 tempest-AttachVolumeTestJSON-1055770325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3920661-54d8-433c-8702-87afa58a2a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2138920707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30acd361-29dd-4a4e-af80-aecae3da25e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e2d019c95d40b883211901089255b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:25:28Z,use_quota=True,user_id='a3e91acddbd14ee5b9ad6eec12e35a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:25:28 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b0636464-7adf-49d9-86af-3d3a37e2bf27 tempest-AttachVolumeTestJSON-1055770325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c587a0-17b3-4b4b-b8e8-04ae1bcbc900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:25:28 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b0636464-7adf-49d9-86af-3d3a37e2bf27 tempest-AttachVolumeTestJSON-1055770325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c587a0-17b3-4b4b-b8e8-04ae1bcbc900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:25:28 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b0636464-7adf-49d9-86af-3d3a37e2bf27 tempest-AttachVolumeTestJSON-1055770325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c3028ce-9193-40f4-bdb8-38b692cd5676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:25:28 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b0636464-7adf-49d9-86af-3d3a37e2bf27 tempest-AttachVolumeTestJSON-1055770325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c3028ce-9193-40f4-bdb8-38b692cd5676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30acd361-29dd-4a4e-af80-aecae3da25e5', 'volume_name': 'volume-30acd361-29dd-4a4e-af80-aecae3da25e5', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:25:28 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b0636464-7adf-49d9-86af-3d3a37e2bf27 tempest-AttachVolumeTestJSON-1055770325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf4abf23-152a-4d95-829d-11986d33e9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:25:28 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b0636464-7adf-49d9-86af-3d3a37e2bf27 tempest-AttachVolumeTestJSON-1055770325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf4abf23-152a-4d95-829d-11986d33e9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:25:28 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b0636464-7adf-49d9-86af-3d3a37e2bf27 tempest-AttachVolumeTestJSON-1055770325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a1d8057-2c6c-476b-b105-3fb02d52c3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:25:28 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-b0636464-7adf-49d9-86af-3d3a37e2bf27 tempest-AttachVolumeTestJSON-1055770325 None] Volume 30acd361-29dd-4a4e-af80-aecae3da25e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30acd361-29dd-4a4e-af80-aecae3da25e5', 'volume_size': 1} Nov 02 12:25:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b0636464-7adf-49d9-86af-3d3a37e2bf27 tempest-AttachVolumeTestJSON-1055770325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:25:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b0636464-7adf-49d9-86af-3d3a37e2bf27 tempest-AttachVolumeTestJSON-1055770325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:25:28 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b0636464-7adf-49d9-86af-3d3a37e2bf27 tempest-AttachVolumeTestJSON-1055770325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2138920707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30acd361-29dd-4a4e-af80-aecae3da25e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e2d019c95d40b883211901089255b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:25:28Z,use_quota=True,user_id='a3e91acddbd14ee5b9ad6eec12e35a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:25:28 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-b0636464-7adf-49d9-86af-3d3a37e2bf27 tempest-AttachVolumeTestJSON-1055770325 None] Creating volume 30acd361-29dd-4a4e-af80-aecae3da25e5 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:25:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b0636464-7adf-49d9-86af-3d3a37e2bf27 tempest-AttachVolumeTestJSON-1055770325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:25:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b0636464-7adf-49d9-86af-3d3a37e2bf27 tempest-AttachVolumeTestJSON-1055770325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:25:28 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b0636464-7adf-49d9-86af-3d3a37e2bf27 tempest-AttachVolumeTestJSON-1055770325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:25:28 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b0636464-7adf-49d9-86af-3d3a37e2bf27 tempest-AttachVolumeTestJSON-1055770325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:25:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b0636464-7adf-49d9-86af-3d3a37e2bf27 tempest-AttachVolumeTestJSON-1055770325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:25:28 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b0636464-7adf-49d9-86af-3d3a37e2bf27 tempest-AttachVolumeTestJSON-1055770325 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:25:28 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-b0636464-7adf-49d9-86af-3d3a37e2bf27 tempest-AttachVolumeTestJSON-1055770325 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:25:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b0636464-7adf-49d9-86af-3d3a37e2bf27 tempest-AttachVolumeTestJSON-1055770325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-30acd361-29dd-4a4e-af80-aecae3da25e5 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:28 devstack sudo[89868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-30acd361-29dd-4a4e-af80-aecae3da25e5 1073741824 Nov 02 12:25:28 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:28 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-94fe9162-52c7-456d-9156-3185b3aa61c4 tempest-GroupSnapshotsTest-1165447445 None] Create group from source-snapshot-4246b48d-e166-451c-be90-f08cf4e93a67 completed successfully. Nov 02 12:25:28 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b0636464-7adf-49d9-86af-3d3a37e2bf27 tempest-AttachVolumeTestJSON-1055770325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-30acd361-29dd-4a4e-af80-aecae3da25e5 1073741824" returned: 0 in 0.653s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b0636464-7adf-49d9-86af-3d3a37e2bf27 tempest-AttachVolumeTestJSON-1055770325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-30acd361-29dd-4a4e-af80-aecae3da25e5 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:29 devstack sudo[89876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-30acd361-29dd-4a4e-af80-aecae3da25e5 Nov 02 12:25:29 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:29 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b0636464-7adf-49d9-86af-3d3a37e2bf27 tempest-AttachVolumeTestJSON-1055770325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-30acd361-29dd-4a4e-af80-aecae3da25e5" returned: 0 in 0.290s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:29 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b0636464-7adf-49d9-86af-3d3a37e2bf27 tempest-AttachVolumeTestJSON-1055770325 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:25:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b0636464-7adf-49d9-86af-3d3a37e2bf27 tempest-AttachVolumeTestJSON-1055770325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:25:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b0636464-7adf-49d9-86af-3d3a37e2bf27 tempest-AttachVolumeTestJSON-1055770325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a1d8057-2c6c-476b-b105-3fb02d52c3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30acd361-29dd-4a4e-af80-aecae3da25e5', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:25:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b0636464-7adf-49d9-86af-3d3a37e2bf27 tempest-AttachVolumeTestJSON-1055770325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0da8918c-a74b-49c9-844e-8246f96f203d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:25:29 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-b0636464-7adf-49d9-86af-3d3a37e2bf27 tempest-AttachVolumeTestJSON-1055770325 None] Volume volume-30acd361-29dd-4a4e-af80-aecae3da25e5 (30acd361-29dd-4a4e-af80-aecae3da25e5): created successfully Nov 02 12:25:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b0636464-7adf-49d9-86af-3d3a37e2bf27 tempest-AttachVolumeTestJSON-1055770325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0da8918c-a74b-49c9-844e-8246f96f203d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:25:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b0636464-7adf-49d9-86af-3d3a37e2bf27 tempest-AttachVolumeTestJSON-1055770325 None] Flow 'volume_create_manager' (c434fb00-885a-4b87-b7ef-ccae1431760c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:25:29 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-b0636464-7adf-49d9-86af-3d3a37e2bf27 tempest-AttachVolumeTestJSON-1055770325 None] Created volume successfully. Nov 02 12:25:29 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-05ecd9c1-6ab9-48ea-ad89-acbb3bc1f914 tempest-GroupSnapshotsTest-1165447445 None] Acquiring lock "cinder-quobyte-3c57abf6-069a-44b1-985f-ee4bb15765df" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:25:29 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-05ecd9c1-6ab9-48ea-ad89-acbb3bc1f914 tempest-GroupSnapshotsTest-1165447445 None] Lock "cinder-quobyte-3c57abf6-069a-44b1-985f-ee4bb15765df" acquired by "delete_volume" :: waited 0.039s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:25:30 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c70786-41a9-4795-a241-d0e629567218]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:25:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-05ecd9c1-6ab9-48ea-ad89-acbb3bc1f914 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3c57abf6-069a-44b1-985f-ee4bb15765df {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:30 devstack sudo[89933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3c57abf6-069a-44b1-985f-ee4bb15765df Nov 02 12:25:30 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:30 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-05ecd9c1-6ab9-48ea-ad89-acbb3bc1f914 tempest-GroupSnapshotsTest-1165447445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3c57abf6-069a-44b1-985f-ee4bb15765df" returned: 0 in 0.615s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-05ecd9c1-6ab9-48ea-ad89-acbb3bc1f914 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3c57abf6-069a-44b1-985f-ee4bb15765df {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:30 devstack sudo[89955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3c57abf6-069a-44b1-985f-ee4bb15765df Nov 02 12:25:30 devstack sudo[89955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:31 devstack sudo[89955]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-05ecd9c1-6ab9-48ea-ad89-acbb3bc1f914 tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3c57abf6-069a-44b1-985f-ee4bb15765df" returned: 0 in 0.390s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:31 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-05ecd9c1-6ab9-48ea-ad89-acbb3bc1f914 tempest-GroupSnapshotsTest-1165447445 None] Lock "cinder-quobyte-3c57abf6-069a-44b1-985f-ee4bb15765df" released by "delete_volume" :: held 1.101s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:25:31 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-05ecd9c1-6ab9-48ea-ad89-acbb3bc1f914 tempest-GroupSnapshotsTest-1165447445 None] Created reservations ['62f9dd9d-4ae6-4e58-8466-184d900d0184'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:25:31 devstack cinder-volume[86515]: WARNING cinder.quota [None req-05ecd9c1-6ab9-48ea-ad89-acbb3bc1f914 tempest-GroupSnapshotsTest-1165447445 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2120773110 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2120773110, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:25:31 devstack cinder-volume[86515]: WARNING cinder.quota [None req-05ecd9c1-6ab9-48ea-ad89-acbb3bc1f914 tempest-GroupSnapshotsTest-1165447445 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2120773110 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2120773110, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:25:31 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-05ecd9c1-6ab9-48ea-ad89-acbb3bc1f914 tempest-GroupSnapshotsTest-1165447445 None] Created reservations ['f8415869-5ce9-4398-8a10-392742f1eb06', '17be0647-7aba-48d0-b294-de8f3fbd2279', '1aa7dfa0-dfbb-46c0-8bd6-a0fb83e12f79', '02592fed-1d7d-4685-b04e-8081871e501b'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:25:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-5f6e5380-c5ec-49ff-8b74-cca6a56dc3a5 req-48cdd179-c787-41e8-8a41-8f000543871b tempest-AttachVolumeTestJSON-1055770325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:25:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-5f6e5380-c5ec-49ff-8b74-cca6a56dc3a5 req-48cdd179-c787-41e8-8a41-8f000543871b tempest-AttachVolumeTestJSON-1055770325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:25:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-05ecd9c1-6ab9-48ea-ad89-acbb3bc1f914 tempest-GroupSnapshotsTest-1165447445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:25:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-05ecd9c1-6ab9-48ea-ad89-acbb3bc1f914 tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:25:31 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-05ecd9c1-6ab9-48ea-ad89-acbb3bc1f914 tempest-GroupSnapshotsTest-1165447445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:25:31 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-05ecd9c1-6ab9-48ea-ad89-acbb3bc1f914 tempest-GroupSnapshotsTest-1165447445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:25:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-05ecd9c1-6ab9-48ea-ad89-acbb3bc1f914 tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:25:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-05ecd9c1-6ab9-48ea-ad89-acbb3bc1f914 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-5f6e5380-c5ec-49ff-8b74-cca6a56dc3a5 req-48cdd179-c787-41e8-8a41-8f000543871b tempest-AttachVolumeTestJSON-1055770325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.091s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:25:31 devstack sudo[89987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:25:31 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-5f6e5380-c5ec-49ff-8b74-cca6a56dc3a5 req-48cdd179-c787-41e8-8a41-8f000543871b tempest-AttachVolumeTestJSON-1055770325 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae', 'name': 'volume-30acd361-29dd-4a4e-af80-aecae3da25e5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8910e9de-e409-4b74-afa2-aeb26b227257', 'enforce_multipath': True} {{(pid=86515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:25:31 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-5f6e5380-c5ec-49ff-8b74-cca6a56dc3a5 req-48cdd179-c787-41e8-8a41-8f000543871b tempest-AttachVolumeTestJSON-1055770325 None] attachment_update completed successfully. Nov 02 12:25:31 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-05ecd9c1-6ab9-48ea-ad89-acbb3bc1f914 tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.441s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:31 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-05ecd9c1-6ab9-48ea-ad89-acbb3bc1f914 tempest-GroupSnapshotsTest-1165447445 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:25:31 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-05ecd9c1-6ab9-48ea-ad89-acbb3bc1f914 tempest-GroupSnapshotsTest-1165447445 None] Delete group completed successfully. Nov 02 12:25:32 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-79d6c327-432b-4669-af48-5ece30ca0519 tempest-GroupSnapshotsTest-1165447445 None] group_snapshot 4246b48d-e166-451c-be90-f08cf4e93a67: deleting Nov 02 12:25:32 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-79d6c327-432b-4669-af48-5ece30ca0519 tempest-GroupSnapshotsTest-1165447445 None] group_snapshot 4246b48d-e166-451c-be90-f08cf4e93a67: deleting {{(pid=86515) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 12:25:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-79d6c327-432b-4669-af48-5ece30ca0519 tempest-GroupSnapshotsTest-1165447445 None] Acquiring lock "cinder-quobyte-e0907c60-ebac-43ff-b3cb-896aa9dee640" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:25:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-79d6c327-432b-4669-af48-5ece30ca0519 tempest-GroupSnapshotsTest-1165447445 None] Lock "cinder-quobyte-e0907c60-ebac-43ff-b3cb-896aa9dee640" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:25:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-79d6c327-432b-4669-af48-5ece30ca0519 tempest-GroupSnapshotsTest-1165447445 None] Acquiring lock "cinder-quobyte-439bd3f3-57a9-4fc6-8ff1-7cc034a58f8b" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:25:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-79d6c327-432b-4669-af48-5ece30ca0519 tempest-GroupSnapshotsTest-1165447445 None] Lock "cinder-quobyte-439bd3f3-57a9-4fc6-8ff1-7cc034a58f8b" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:25:32 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-79d6c327-432b-4669-af48-5ece30ca0519 tempest-GroupSnapshotsTest-1165447445 None] Deleting offline snapshot 439bd3f3-57a9-4fc6-8ff1-7cc034a58f8b of volume e0907c60-ebac-43ff-b3cb-896aa9dee640 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:25:32 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-79d6c327-432b-4669-af48-5ece30ca0519 tempest-GroupSnapshotsTest-1165447445 None] snapshot_file for this snap is: volume-e0907c60-ebac-43ff-b3cb-896aa9dee640.439bd3f3-57a9-4fc6-8ff1-7cc034a58f8b {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:25:32 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a92d54e-b7a6-4ce3-85a3-5cf3659f1b8a]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:25:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-79d6c327-432b-4669-af48-5ece30ca0519 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640.439bd3f3-57a9-4fc6-8ff1-7cc034a58f8b {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:32 devstack sudo[90426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640.439bd3f3-57a9-4fc6-8ff1-7cc034a58f8b Nov 02 12:25:32 devstack sudo[90426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:33 devstack sudo[90426]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-79d6c327-432b-4669-af48-5ece30ca0519 tempest-GroupSnapshotsTest-1165447445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640.439bd3f3-57a9-4fc6-8ff1-7cc034a58f8b" returned: 0 in 0.498s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-79d6c327-432b-4669-af48-5ece30ca0519 tempest-GroupSnapshotsTest-1165447445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0907c60-ebac-43ff-b3cb-896aa9dee640(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:25:33 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[db92b4d4-00aa-4c1a-8dad-2b463c84e6ae]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:25:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-79d6c327-432b-4669-af48-5ece30ca0519 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:33 devstack sudo[90434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640 Nov 02 12:25:33 devstack sudo[90434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:34 devstack sudo[90434]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-79d6c327-432b-4669-af48-5ece30ca0519 tempest-GroupSnapshotsTest-1165447445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640" returned: 0 in 0.945s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-79d6c327-432b-4669-af48-5ece30ca0519 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640.439bd3f3-57a9-4fc6-8ff1-7cc034a58f8b {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:34 devstack sudo[90445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640.439bd3f3-57a9-4fc6-8ff1-7cc034a58f8b Nov 02 12:25:34 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:34 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-79d6c327-432b-4669-af48-5ece30ca0519 tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640.439bd3f3-57a9-4fc6-8ff1-7cc034a58f8b" returned: 0 in 0.473s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-79d6c327-432b-4669-af48-5ece30ca0519 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640.439bd3f3-57a9-4fc6-8ff1-7cc034a58f8b {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:34 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640.439bd3f3-57a9-4fc6-8ff1-7cc034a58f8b Nov 02 12:25:34 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:35 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-79d6c327-432b-4669-af48-5ece30ca0519 tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640.439bd3f3-57a9-4fc6-8ff1-7cc034a58f8b" returned: 0 in 0.326s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:35 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-79d6c327-432b-4669-af48-5ece30ca0519 tempest-GroupSnapshotsTest-1165447445 None] Lock "cinder-quobyte-439bd3f3-57a9-4fc6-8ff1-7cc034a58f8b" released by "_delete_snapshot" :: held 2.395s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:25:35 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-79d6c327-432b-4669-af48-5ece30ca0519 tempest-GroupSnapshotsTest-1165447445 None] Lock "cinder-quobyte-e0907c60-ebac-43ff-b3cb-896aa9dee640" released by "delete_snapshot" :: held 2.434s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:25:35 devstack cinder-volume[86515]: WARNING cinder.quota [None req-79d6c327-432b-4669-af48-5ece30ca0519 tempest-GroupSnapshotsTest-1165447445 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2120773110 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2120773110, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:25:35 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-79d6c327-432b-4669-af48-5ece30ca0519 tempest-GroupSnapshotsTest-1165447445 None] Created reservations ['f3b5af1a-bfa3-4071-a2b5-d6f54045ef6d', '4ab1a917-7ab1-4edd-8df7-8ca9b8c93bbd', 'a415a5c5-4559-42ac-a1a0-4c0f8c3f6616', 'd4134793-63fe-4131-9639-b979995c66a7'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:25:35 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-79d6c327-432b-4669-af48-5ece30ca0519 tempest-GroupSnapshotsTest-1165447445 None] group_snapshot 4246b48d-e166-451c-be90-f08cf4e93a67: deleted successfully Nov 02 12:25:36 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-92da10d5-7493-48cb-a8c1-a9c3d91a7eb7 tempest-GroupSnapshotsTest-1165447445 None] Acquiring lock "cinder-quobyte-e0907c60-ebac-43ff-b3cb-896aa9dee640" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:25:36 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-92da10d5-7493-48cb-a8c1-a9c3d91a7eb7 tempest-GroupSnapshotsTest-1165447445 None] Lock "cinder-quobyte-e0907c60-ebac-43ff-b3cb-896aa9dee640" acquired by "delete_volume" :: waited 0.046s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:25:36 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[62688ebd-9513-4e77-b7c5-d985fb78267a]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:25:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-92da10d5-7493-48cb-a8c1-a9c3d91a7eb7 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:36 devstack sudo[90459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640 Nov 02 12:25:36 devstack sudo[90459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:37 devstack sudo[90459]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-92da10d5-7493-48cb-a8c1-a9c3d91a7eb7 tempest-GroupSnapshotsTest-1165447445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640" returned: 0 in 0.445s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-92da10d5-7493-48cb-a8c1-a9c3d91a7eb7 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:37 devstack sudo[90464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640 Nov 02 12:25:37 devstack sudo[90464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:37 devstack sudo[90464]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-92da10d5-7493-48cb-a8c1-a9c3d91a7eb7 tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0907c60-ebac-43ff-b3cb-896aa9dee640" returned: 0 in 0.689s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:37 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-92da10d5-7493-48cb-a8c1-a9c3d91a7eb7 tempest-GroupSnapshotsTest-1165447445 None] Lock "cinder-quobyte-e0907c60-ebac-43ff-b3cb-896aa9dee640" released by "delete_volume" :: held 1.284s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:25:38 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-92da10d5-7493-48cb-a8c1-a9c3d91a7eb7 tempest-GroupSnapshotsTest-1165447445 None] Created reservations ['904db510-b76c-4d4b-84e5-bb8f727e0113'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:25:38 devstack cinder-volume[86515]: WARNING cinder.db.api [None req-92da10d5-7493-48cb-a8c1-a9c3d91a7eb7 tempest-GroupSnapshotsTest-1165447445 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2120773110'] Nov 02 12:25:38 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-92da10d5-7493-48cb-a8c1-a9c3d91a7eb7 tempest-GroupSnapshotsTest-1165447445 None] Created reservations ['e6543dc1-3138-4805-8fa4-924fa563e80c', 'fa915309-90b8-4e25-b6d9-8530ad6655e0', 'a63b5a4c-f5c3-484e-b716-a7694c0b9275', 'f1c5b526-1b22-4af1-b0df-1b41dec8c06a'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:25:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-92da10d5-7493-48cb-a8c1-a9c3d91a7eb7 tempest-GroupSnapshotsTest-1165447445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:25:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-92da10d5-7493-48cb-a8c1-a9c3d91a7eb7 tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:25:38 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-92da10d5-7493-48cb-a8c1-a9c3d91a7eb7 tempest-GroupSnapshotsTest-1165447445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:25:38 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-92da10d5-7493-48cb-a8c1-a9c3d91a7eb7 tempest-GroupSnapshotsTest-1165447445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:25:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-92da10d5-7493-48cb-a8c1-a9c3d91a7eb7 tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:25:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-92da10d5-7493-48cb-a8c1-a9c3d91a7eb7 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:38 devstack sudo[90613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:25:38 devstack sudo[90613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:38 devstack sudo[90613]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-92da10d5-7493-48cb-a8c1-a9c3d91a7eb7 tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.376s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:38 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-92da10d5-7493-48cb-a8c1-a9c3d91a7eb7 tempest-GroupSnapshotsTest-1165447445 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:25:38 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-92da10d5-7493-48cb-a8c1-a9c3d91a7eb7 tempest-GroupSnapshotsTest-1165447445 None] Delete group completed successfully. Nov 02 12:25:40 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-c69ca1fc-33cc-4e29-b714-b75679db72a8 tempest-GroupSnapshotsTest-1165447445 None] Group tempest-GroupSnapshotsTest-Group-67464116: creating Nov 02 12:25:40 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-c69ca1fc-33cc-4e29-b714-b75679db72a8 tempest-GroupSnapshotsTest-1165447445 None] Group tempest-GroupSnapshotsTest-Group-67464116: created successfully Nov 02 12:25:40 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-c69ca1fc-33cc-4e29-b714-b75679db72a8 tempest-GroupSnapshotsTest-1165447445 None] Create group completed successfully. Nov 02 12:25:43 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f461c17-0a3e-4a03-8c5a-93c32ecd180a tempest-GroupSnapshotsTest-1165447445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:25:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2f461c17-0a3e-4a03-8c5a-93c32ecd180a tempest-GroupSnapshotsTest-1165447445 None] Flow 'volume_create_manager' (935bb0e9-e2f3-48c7-8531-209a069a541a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:25:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2f461c17-0a3e-4a03-8c5a-93c32ecd180a tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b23feea7-65ed-462f-8d36-9eea1571e7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:25:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2f461c17-0a3e-4a03-8c5a-93c32ecd180a tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b23feea7-65ed-462f-8d36-9eea1571e7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-35331226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ac13c1ec-b257-40f1-95c7-4417d3eb6117,host='devstack@QuobyteHD#QuobyteHD',id=0855bb53-e0d2-42a6-901d-2b4d7c4442a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b48ce9380a846ea89be74e7df3ebac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:25:43Z,use_quota=True,user_id='6c45dc15c9e744cc8b5ed18dbcb28dcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(968dacab-78c6-42b5-a8ac-3b9e73649d02),volume_type_id=968dacab-78c6-42b5-a8ac-3b9e73649d02)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:25:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2f461c17-0a3e-4a03-8c5a-93c32ecd180a tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ed631e8-c74f-4aef-a5b4-2f8b621a3d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:25:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2f461c17-0a3e-4a03-8c5a-93c32ecd180a tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ed631e8-c74f-4aef-a5b4-2f8b621a3d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:25:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2f461c17-0a3e-4a03-8c5a-93c32ecd180a tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (832d0ead-243b-43b1-b873-813f11f1d154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:25:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2f461c17-0a3e-4a03-8c5a-93c32ecd180a tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (832d0ead-243b-43b1-b873-813f11f1d154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0855bb53-e0d2-42a6-901d-2b4d7c4442a9', 'volume_name': 'volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:25:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2f461c17-0a3e-4a03-8c5a-93c32ecd180a tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (764ead17-db24-4479-ab76-6e5e85b0b86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:25:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2f461c17-0a3e-4a03-8c5a-93c32ecd180a tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (764ead17-db24-4479-ab76-6e5e85b0b86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:25:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2f461c17-0a3e-4a03-8c5a-93c32ecd180a tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a362db-f531-4645-b6ba-851f098e0b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:25:43 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-2f461c17-0a3e-4a03-8c5a-93c32ecd180a tempest-GroupSnapshotsTest-1165447445 None] Volume 0855bb53-e0d2-42a6-901d-2b4d7c4442a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9', 'volume_size': 1} Nov 02 12:25:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2f461c17-0a3e-4a03-8c5a-93c32ecd180a tempest-GroupSnapshotsTest-1165447445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:25:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2f461c17-0a3e-4a03-8c5a-93c32ecd180a tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:25:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-2f461c17-0a3e-4a03-8c5a-93c32ecd180a tempest-GroupSnapshotsTest-1165447445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ac13c1ec-b257-40f1-95c7-4417d3eb6117,created_at=2026-11-02T11:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-35331226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ac13c1ec-b257-40f1-95c7-4417d3eb6117,host='devstack@QuobyteHD#QuobyteHD',id=0855bb53-e0d2-42a6-901d-2b4d7c4442a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b48ce9380a846ea89be74e7df3ebac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:25:43Z,use_quota=True,user_id='6c45dc15c9e744cc8b5ed18dbcb28dcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(968dacab-78c6-42b5-a8ac-3b9e73649d02),volume_type_id=968dacab-78c6-42b5-a8ac-3b9e73649d02)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:25:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-2f461c17-0a3e-4a03-8c5a-93c32ecd180a tempest-GroupSnapshotsTest-1165447445 None] Creating volume 0855bb53-e0d2-42a6-901d-2b4d7c4442a9 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:25:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2f461c17-0a3e-4a03-8c5a-93c32ecd180a tempest-GroupSnapshotsTest-1165447445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:25:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2f461c17-0a3e-4a03-8c5a-93c32ecd180a tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:25:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-2f461c17-0a3e-4a03-8c5a-93c32ecd180a tempest-GroupSnapshotsTest-1165447445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:25:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-2f461c17-0a3e-4a03-8c5a-93c32ecd180a tempest-GroupSnapshotsTest-1165447445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:25:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2f461c17-0a3e-4a03-8c5a-93c32ecd180a tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:25:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-2f461c17-0a3e-4a03-8c5a-93c32ecd180a tempest-GroupSnapshotsTest-1165447445 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:25:43 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-2f461c17-0a3e-4a03-8c5a-93c32ecd180a tempest-GroupSnapshotsTest-1165447445 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:25:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2f461c17-0a3e-4a03-8c5a-93c32ecd180a tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:43 devstack sudo[91066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9 1073741824 Nov 02 12:25:43 devstack sudo[91066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:43 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:25:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:25:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:25:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:25:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:25:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:25:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:43 devstack sudo[91068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:25:43 devstack sudo[91068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:44 devstack sudo[91068]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.521s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:44 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:25:44 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager._thread_info {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:25:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread count: 8 {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:25:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread info: [<_MainThread(MainThread, started 129944084402304)>, , , , , , , ] {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:25:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-0a74cf30-f449-478e-bc5e-0aca8ca352b7 req-bc92bf39-3de9-4cc5-8a44-021ec8b8a173 tempest-TaggedAttachmentsTest-1731010272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:25:44 devstack sudo[91066]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2f461c17-0a3e-4a03-8c5a-93c32ecd180a tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9 1073741824" returned: 0 in 0.980s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2f461c17-0a3e-4a03-8c5a-93c32ecd180a tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:44 devstack sudo[91109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9 Nov 02 12:25:44 devstack sudo[91109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:45 devstack sudo[91109]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2f461c17-0a3e-4a03-8c5a-93c32ecd180a tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9" returned: 0 in 0.313s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:45 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-2f461c17-0a3e-4a03-8c5a-93c32ecd180a tempest-GroupSnapshotsTest-1165447445 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:25:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2f461c17-0a3e-4a03-8c5a-93c32ecd180a tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:25:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-0a74cf30-f449-478e-bc5e-0aca8ca352b7 req-bc92bf39-3de9-4cc5-8a44-021ec8b8a173 tempest-TaggedAttachmentsTest-1731010272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.386s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:25:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2f461c17-0a3e-4a03-8c5a-93c32ecd180a tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a362db-f531-4645-b6ba-851f098e0b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:25:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2f461c17-0a3e-4a03-8c5a-93c32ecd180a tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (508c5b52-fee5-44fa-9e69-5e828325019c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:25:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-0a74cf30-f449-478e-bc5e-0aca8ca352b7 req-bc92bf39-3de9-4cc5-8a44-021ec8b8a173 tempest-TaggedAttachmentsTest-1731010272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:25:45 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-2f461c17-0a3e-4a03-8c5a-93c32ecd180a tempest-GroupSnapshotsTest-1165447445 None] Volume volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9 (0855bb53-e0d2-42a6-901d-2b4d7c4442a9): created successfully Nov 02 12:25:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2f461c17-0a3e-4a03-8c5a-93c32ecd180a tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (508c5b52-fee5-44fa-9e69-5e828325019c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:25:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2f461c17-0a3e-4a03-8c5a-93c32ecd180a tempest-GroupSnapshotsTest-1165447445 None] Flow 'volume_create_manager' (935bb0e9-e2f3-48c7-8531-209a069a541a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:25:45 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-2f461c17-0a3e-4a03-8c5a-93c32ecd180a tempest-GroupSnapshotsTest-1165447445 None] Created volume successfully. Nov 02 12:25:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-0a74cf30-f449-478e-bc5e-0aca8ca352b7 req-bc92bf39-3de9-4cc5-8a44-021ec8b8a173 tempest-TaggedAttachmentsTest-1731010272 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae', 'name': 'volume-3d4be753-bd7e-4b0c-bb8d-c1b01a6e4a1c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f2307493-2af9-41c2-8eef-5a3ac992a136', 'enforce_multipath': True} {{(pid=86515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:25:45 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-0a74cf30-f449-478e-bc5e-0aca8ca352b7 req-bc92bf39-3de9-4cc5-8a44-021ec8b8a173 tempest-TaggedAttachmentsTest-1731010272 None] attachment_update completed successfully. Nov 02 12:25:46 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7d3894a-5e1f-4fb4-9ad4-13f1b4496733 tempest-GroupSnapshotsTest-1165447445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:25:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e7d3894a-5e1f-4fb4-9ad4-13f1b4496733 tempest-GroupSnapshotsTest-1165447445 None] Flow 'volume_create_manager' (ae296463-73ea-4024-a094-a55ddf759736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:25:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e7d3894a-5e1f-4fb4-9ad4-13f1b4496733 tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fb8b3e0-2e17-47a4-8d1f-23b4fa23d0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:25:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e7d3894a-5e1f-4fb4-9ad4-13f1b4496733 tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fb8b3e0-2e17-47a4-8d1f-23b4fa23d0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2016026482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ac13c1ec-b257-40f1-95c7-4417d3eb6117,host='devstack@QuobyteHD#QuobyteHD',id=977920a5-109a-426e-90bc-600d5593be60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b48ce9380a846ea89be74e7df3ebac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:25:47Z,use_quota=True,user_id='6c45dc15c9e744cc8b5ed18dbcb28dcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(968dacab-78c6-42b5-a8ac-3b9e73649d02),volume_type_id=968dacab-78c6-42b5-a8ac-3b9e73649d02)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:25:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e7d3894a-5e1f-4fb4-9ad4-13f1b4496733 tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04a20839-0f61-44e6-89f5-18e13c165a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:25:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e7d3894a-5e1f-4fb4-9ad4-13f1b4496733 tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04a20839-0f61-44e6-89f5-18e13c165a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:25:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e7d3894a-5e1f-4fb4-9ad4-13f1b4496733 tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e600c08-e3f4-45dc-b2a6-47e564479687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:25:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e7d3894a-5e1f-4fb4-9ad4-13f1b4496733 tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e600c08-e3f4-45dc-b2a6-47e564479687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '977920a5-109a-426e-90bc-600d5593be60', 'volume_name': 'volume-977920a5-109a-426e-90bc-600d5593be60', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:25:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e7d3894a-5e1f-4fb4-9ad4-13f1b4496733 tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e924b519-75e9-433a-9ee3-063a2e5b19b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:25:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e7d3894a-5e1f-4fb4-9ad4-13f1b4496733 tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e924b519-75e9-433a-9ee3-063a2e5b19b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:25:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e7d3894a-5e1f-4fb4-9ad4-13f1b4496733 tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d8d04aa-f8a5-410e-9b01-8226131b53c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:25:46 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-e7d3894a-5e1f-4fb4-9ad4-13f1b4496733 tempest-GroupSnapshotsTest-1165447445 None] Volume 977920a5-109a-426e-90bc-600d5593be60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-977920a5-109a-426e-90bc-600d5593be60', 'volume_size': 1} Nov 02 12:25:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e7d3894a-5e1f-4fb4-9ad4-13f1b4496733 tempest-GroupSnapshotsTest-1165447445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:25:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e7d3894a-5e1f-4fb4-9ad4-13f1b4496733 tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:25:46 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e7d3894a-5e1f-4fb4-9ad4-13f1b4496733 tempest-GroupSnapshotsTest-1165447445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ac13c1ec-b257-40f1-95c7-4417d3eb6117,created_at=2026-11-02T11:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2016026482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ac13c1ec-b257-40f1-95c7-4417d3eb6117,host='devstack@QuobyteHD#QuobyteHD',id=977920a5-109a-426e-90bc-600d5593be60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b48ce9380a846ea89be74e7df3ebac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:25:47Z,use_quota=True,user_id='6c45dc15c9e744cc8b5ed18dbcb28dcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(968dacab-78c6-42b5-a8ac-3b9e73649d02),volume_type_id=968dacab-78c6-42b5-a8ac-3b9e73649d02)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:25:46 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-e7d3894a-5e1f-4fb4-9ad4-13f1b4496733 tempest-GroupSnapshotsTest-1165447445 None] Creating volume 977920a5-109a-426e-90bc-600d5593be60 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:25:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e7d3894a-5e1f-4fb4-9ad4-13f1b4496733 tempest-GroupSnapshotsTest-1165447445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:25:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e7d3894a-5e1f-4fb4-9ad4-13f1b4496733 tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:25:46 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e7d3894a-5e1f-4fb4-9ad4-13f1b4496733 tempest-GroupSnapshotsTest-1165447445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:25:46 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e7d3894a-5e1f-4fb4-9ad4-13f1b4496733 tempest-GroupSnapshotsTest-1165447445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:25:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e7d3894a-5e1f-4fb4-9ad4-13f1b4496733 tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:25:46 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e7d3894a-5e1f-4fb4-9ad4-13f1b4496733 tempest-GroupSnapshotsTest-1165447445 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:25:46 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-e7d3894a-5e1f-4fb4-9ad4-13f1b4496733 tempest-GroupSnapshotsTest-1165447445 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:25:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e7d3894a-5e1f-4fb4-9ad4-13f1b4496733 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:46 devstack sudo[91128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60 1073741824 Nov 02 12:25:46 devstack sudo[91128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:47 devstack sudo[91128]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e7d3894a-5e1f-4fb4-9ad4-13f1b4496733 tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60 1073741824" returned: 0 in 0.535s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e7d3894a-5e1f-4fb4-9ad4-13f1b4496733 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:47 devstack sudo[91134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60 Nov 02 12:25:47 devstack sudo[91134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:47 devstack sudo[91134]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e7d3894a-5e1f-4fb4-9ad4-13f1b4496733 tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60" returned: 0 in 0.256s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:47 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e7d3894a-5e1f-4fb4-9ad4-13f1b4496733 tempest-GroupSnapshotsTest-1165447445 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:25:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e7d3894a-5e1f-4fb4-9ad4-13f1b4496733 tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:25:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e7d3894a-5e1f-4fb4-9ad4-13f1b4496733 tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d8d04aa-f8a5-410e-9b01-8226131b53c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-977920a5-109a-426e-90bc-600d5593be60', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:25:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e7d3894a-5e1f-4fb4-9ad4-13f1b4496733 tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b57f25f-c574-46b0-8a05-bfc84f4f83f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:25:47 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-e7d3894a-5e1f-4fb4-9ad4-13f1b4496733 tempest-GroupSnapshotsTest-1165447445 None] Volume volume-977920a5-109a-426e-90bc-600d5593be60 (977920a5-109a-426e-90bc-600d5593be60): created successfully Nov 02 12:25:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e7d3894a-5e1f-4fb4-9ad4-13f1b4496733 tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b57f25f-c574-46b0-8a05-bfc84f4f83f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:25:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e7d3894a-5e1f-4fb4-9ad4-13f1b4496733 tempest-GroupSnapshotsTest-1165447445 None] Flow 'volume_create_manager' (ae296463-73ea-4024-a094-a55ddf759736) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:25:47 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-e7d3894a-5e1f-4fb4-9ad4-13f1b4496733 tempest-GroupSnapshotsTest-1165447445 None] Created volume successfully. Nov 02 12:25:47 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-0eee3ded-d79c-491c-9ac1-8a84aa1cfc39 req-d46e343e-0bab-4c69-9e3a-85466618e304 tempest-TaggedAttachmentsTest-1731010272 None] Terminate volume connection completed successfully. Nov 02 12:25:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-0eee3ded-d79c-491c-9ac1-8a84aa1cfc39 req-d46e343e-0bab-4c69-9e3a-85466618e304 tempest-TaggedAttachmentsTest-1731010272 None] Deleting attachment f2307493-2af9-41c2-8eef-5a3ac992a136. {{(pid=86515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:25:48 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-6c322dc1-f784-45c2-8ea1-04ab5592036c tempest-GroupSnapshotsTest-1165447445 None] Update group completed successfully. Nov 02 12:25:49 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-0fab1982-ef2d-4844-a6a7-3cd9687bcfb8 tempest-GroupSnapshotsTest-1165447445 None] Update group completed successfully. Nov 02 12:25:50 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-c0fd8f0b-8eff-4a06-9611-9e9ca5243548 tempest-GroupSnapshotsTest-1165447445 None] Update group completed successfully. Nov 02 12:25:51 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-23fd8ccf-0af5-4011-babe-28b2ea3cca98 tempest-GroupSnapshotsTest-1165447445 None] Update group completed successfully. Nov 02 12:25:53 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] GroupSnapshot 7c3b5e55-26b5-4cea-acdb-ad48b508c070: creating. Nov 02 12:25:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] Group snapshot 7c3b5e55-26b5-4cea-acdb-ad48b508c070: creating. {{(pid=86515) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 12:25:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:25:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:25:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] Creating offline snapshot 270a50de-3aac-44c6-a085-2b158cb62b3f of volume 977920a5-109a-426e-90bc-600d5593be60 {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:25:54 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5497fd3-12c6-44e9-b4f0-fb817fa41b61]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:25:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:54 devstack sudo[91212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60 Nov 02 12:25:54 devstack sudo[91212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:54 devstack sudo[91212]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60" returned: 0 in 0.433s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60.270a50de-3aac-44c6-a085-2b158cb62b3f 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:54 devstack sudo[91218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60.270a50de-3aac-44c6-a085-2b158cb62b3f 1G Nov 02 12:25:54 devstack sudo[91218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:55 devstack sudo[91218]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60.270a50de-3aac-44c6-a085-2b158cb62b3f 1G" returned: 0 in 0.648s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-977920a5-109a-426e-90bc-600d5593be60 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60.270a50de-3aac-44c6-a085-2b158cb62b3f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:55 devstack sudo[91227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-977920a5-109a-426e-90bc-600d5593be60 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60.270a50de-3aac-44c6-a085-2b158cb62b3f Nov 02 12:25:55 devstack sudo[91227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:55 devstack sudo[91227]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-977920a5-109a-426e-90bc-600d5593be60 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60.270a50de-3aac-44c6-a085-2b158cb62b3f" returned: 0 in 0.442s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:55 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60.270a50de-3aac-44c6-a085-2b158cb62b3f is being set with open permissions: ugo+rw: NotImplementedError Nov 02 12:25:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60.270a50de-3aac-44c6-a085-2b158cb62b3f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:55 devstack sudo[91232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60.270a50de-3aac-44c6-a085-2b158cb62b3f Nov 02 12:25:55 devstack sudo[91232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:55 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-552895c3-3317-431c-b2cc-889f05227ff9 tempest-AttachVolumeShelveTestJSON-1652644983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:25:55 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-552895c3-3317-431c-b2cc-889f05227ff9 tempest-AttachVolumeShelveTestJSON-1652644983 None] Flow 'volume_create_manager' (9f87be68-e7a4-4fbb-8ca4-345792bd0424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:25:55 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-552895c3-3317-431c-b2cc-889f05227ff9 tempest-AttachVolumeShelveTestJSON-1652644983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adc1e3f9-5aca-41e2-9f48-49ce6698b61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:25:55 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-552895c3-3317-431c-b2cc-889f05227ff9 tempest-AttachVolumeShelveTestJSON-1652644983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adc1e3f9-5aca-41e2-9f48-49ce6698b61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1275164769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7dc1e89-c009-4640-8a37-d65fa999e2a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bebc4676ab9a4c91b8abace0be810fde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:25:56Z,use_quota=True,user_id='4208052f221d42e2adc56aed98a221aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:25:55 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-552895c3-3317-431c-b2cc-889f05227ff9 tempest-AttachVolumeShelveTestJSON-1652644983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ffa8e8-6bbe-4891-884f-97248cc7bae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:25:55 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-552895c3-3317-431c-b2cc-889f05227ff9 tempest-AttachVolumeShelveTestJSON-1652644983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ffa8e8-6bbe-4891-884f-97248cc7bae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:25:55 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-552895c3-3317-431c-b2cc-889f05227ff9 tempest-AttachVolumeShelveTestJSON-1652644983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f80ad4-3bc8-43b9-8a09-5067a87a6752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:25:55 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-552895c3-3317-431c-b2cc-889f05227ff9 tempest-AttachVolumeShelveTestJSON-1652644983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f80ad4-3bc8-43b9-8a09-5067a87a6752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7dc1e89-c009-4640-8a37-d65fa999e2a1', 'volume_name': 'volume-a7dc1e89-c009-4640-8a37-d65fa999e2a1', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:25:55 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-552895c3-3317-431c-b2cc-889f05227ff9 tempest-AttachVolumeShelveTestJSON-1652644983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d07ee45e-20e6-4eca-a2f2-2eff43a6258d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:25:55 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-552895c3-3317-431c-b2cc-889f05227ff9 tempest-AttachVolumeShelveTestJSON-1652644983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d07ee45e-20e6-4eca-a2f2-2eff43a6258d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:25:55 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-552895c3-3317-431c-b2cc-889f05227ff9 tempest-AttachVolumeShelveTestJSON-1652644983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (700fd117-0633-425c-a466-6806d17d3de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:25:55 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-552895c3-3317-431c-b2cc-889f05227ff9 tempest-AttachVolumeShelveTestJSON-1652644983 None] Volume a7dc1e89-c009-4640-8a37-d65fa999e2a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7dc1e89-c009-4640-8a37-d65fa999e2a1', 'volume_size': 1} Nov 02 12:25:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-552895c3-3317-431c-b2cc-889f05227ff9 tempest-AttachVolumeShelveTestJSON-1652644983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:25:56 devstack sudo[91232]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60.270a50de-3aac-44c6-a085-2b158cb62b3f" returned: 0 in 0.342s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:56 devstack sudo[91250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60.info Nov 02 12:25:56 devstack sudo[91250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:56 devstack sudo[91250]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60.info" returned: 0 in 0.281s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:56 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 12:25:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:56 devstack sudo[91253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60.info Nov 02 12:25:56 devstack sudo[91253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:56 devstack sudo[91253]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60.info" returned: 0 in 0.261s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.548s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:25:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:25:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:25:56 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] Creating offline snapshot e96af6b3-60f7-44c3-b33a-ce6ce4cbc6b6 of volume 0855bb53-e0d2-42a6-901d-2b4d7c4442a9 {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:25:56 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b47705-3966-4867-b28f-556d5fcd6438]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:25:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:56 devstack sudo[91256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9 Nov 02 12:25:56 devstack sudo[91256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:57 devstack sudo[91256]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9" returned: 0 in 0.388s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9.e96af6b3-60f7-44c3-b33a-ce6ce4cbc6b6 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:57 devstack sudo[91261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9.e96af6b3-60f7-44c3-b33a-ce6ce4cbc6b6 1G Nov 02 12:25:57 devstack sudo[91261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:57 devstack sudo[91261]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9.e96af6b3-60f7-44c3-b33a-ce6ce4cbc6b6 1G" returned: 0 in 0.420s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9.e96af6b3-60f7-44c3-b33a-ce6ce4cbc6b6 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:57 devstack sudo[91268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9.e96af6b3-60f7-44c3-b33a-ce6ce4cbc6b6 Nov 02 12:25:57 devstack sudo[91268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:57 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a2bd6401-e301-4775-b460-eda9de5d6893 tempest-TaggedAttachmentsTest-1731010272 None] Acquiring lock "cinder-3d4be753-bd7e-4b0c-bb8d-c1b01a6e4a1c-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:25:57 devstack sudo[91268]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9.e96af6b3-60f7-44c3-b33a-ce6ce4cbc6b6" returned: 0 in 0.360s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:57 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9.e96af6b3-60f7-44c3-b33a-ce6ce4cbc6b6 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 12:25:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9.e96af6b3-60f7-44c3-b33a-ce6ce4cbc6b6 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:57 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a2bd6401-e301-4775-b460-eda9de5d6893 tempest-TaggedAttachmentsTest-1731010272 None] Lock "cinder-3d4be753-bd7e-4b0c-bb8d-c1b01a6e4a1c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:25:57 devstack sudo[91273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9.e96af6b3-60f7-44c3-b33a-ce6ce4cbc6b6 Nov 02 12:25:57 devstack sudo[91273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:57 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a2bd6401-e301-4775-b460-eda9de5d6893 tempest-TaggedAttachmentsTest-1731010272 None] Acquiring lock "cinder-quobyte-3d4be753-bd7e-4b0c-bb8d-c1b01a6e4a1c" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:25:57 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a2bd6401-e301-4775-b460-eda9de5d6893 tempest-TaggedAttachmentsTest-1731010272 None] Lock "cinder-quobyte-3d4be753-bd7e-4b0c-bb8d-c1b01a6e4a1c" acquired by "delete_volume" :: waited 0.021s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:25:57 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9e5f01-a3a7-41d6-8a42-1c8d26944d1a]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:25:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a2bd6401-e301-4775-b460-eda9de5d6893 tempest-TaggedAttachmentsTest-1731010272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d4be753-bd7e-4b0c-bb8d-c1b01a6e4a1c {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:58 devstack sudo[91275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d4be753-bd7e-4b0c-bb8d-c1b01a6e4a1c Nov 02 12:25:58 devstack sudo[91275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:58 devstack sudo[91273]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9.e96af6b3-60f7-44c3-b33a-ce6ce4cbc6b6" returned: 0 in 0.276s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:58 devstack sudo[91302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9.info Nov 02 12:25:58 devstack sudo[91302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:58 devstack sudo[91275]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a2bd6401-e301-4775-b460-eda9de5d6893 tempest-TaggedAttachmentsTest-1731010272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d4be753-bd7e-4b0c-bb8d-c1b01a6e4a1c" returned: 0 in 0.368s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a2bd6401-e301-4775-b460-eda9de5d6893 tempest-TaggedAttachmentsTest-1731010272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d4be753-bd7e-4b0c-bb8d-c1b01a6e4a1c {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:58 devstack sudo[91307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d4be753-bd7e-4b0c-bb8d-c1b01a6e4a1c Nov 02 12:25:58 devstack sudo[91307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:58 devstack sudo[91302]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9.info" returned: 0 in 0.259s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:58 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 12:25:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:58 devstack sudo[91310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9.info Nov 02 12:25:58 devstack sudo[91310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:58 devstack sudo[91307]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a2bd6401-e301-4775-b460-eda9de5d6893 tempest-TaggedAttachmentsTest-1731010272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d4be753-bd7e-4b0c-bb8d-c1b01a6e4a1c" returned: 0 in 0.252s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:58 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a2bd6401-e301-4775-b460-eda9de5d6893 tempest-TaggedAttachmentsTest-1731010272 None] Lock "cinder-quobyte-3d4be753-bd7e-4b0c-bb8d-c1b01a6e4a1c" released by "delete_volume" :: held 0.667s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:25:58 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-a2bd6401-e301-4775-b460-eda9de5d6893 tempest-TaggedAttachmentsTest-1731010272 None] Created reservations ['cc655d04-6620-43e9-99df-13491100bcb3', 'c01ca9da-f72d-4f27-9815-2927a18133c3', 'd69a763d-8bc7-4508-bb96-89278fb7814c', '740584c2-da55-44e1-92b6-e443d960f274'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:25:58 devstack sudo[91310]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9.info" returned: 0 in 0.252s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.056s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:25:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-552895c3-3317-431c-b2cc-889f05227ff9 tempest-AttachVolumeShelveTestJSON-1652644983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.757s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:25:58 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-552895c3-3317-431c-b2cc-889f05227ff9 tempest-AttachVolumeShelveTestJSON-1652644983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1275164769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7dc1e89-c009-4640-8a37-d65fa999e2a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bebc4676ab9a4c91b8abace0be810fde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:25:56Z,use_quota=True,user_id='4208052f221d42e2adc56aed98a221aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:25:58 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-552895c3-3317-431c-b2cc-889f05227ff9 tempest-AttachVolumeShelveTestJSON-1652644983 None] Creating volume a7dc1e89-c009-4640-8a37-d65fa999e2a1 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:25:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-552895c3-3317-431c-b2cc-889f05227ff9 tempest-AttachVolumeShelveTestJSON-1652644983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:25:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-552895c3-3317-431c-b2cc-889f05227ff9 tempest-AttachVolumeShelveTestJSON-1652644983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:25:58 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-552895c3-3317-431c-b2cc-889f05227ff9 tempest-AttachVolumeShelveTestJSON-1652644983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:25:58 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-552895c3-3317-431c-b2cc-889f05227ff9 tempest-AttachVolumeShelveTestJSON-1652644983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:25:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-552895c3-3317-431c-b2cc-889f05227ff9 tempest-AttachVolumeShelveTestJSON-1652644983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:25:58 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-552895c3-3317-431c-b2cc-889f05227ff9 tempest-AttachVolumeShelveTestJSON-1652644983 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:25:58 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-552895c3-3317-431c-b2cc-889f05227ff9 tempest-AttachVolumeShelveTestJSON-1652644983 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:25:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-552895c3-3317-431c-b2cc-889f05227ff9 tempest-AttachVolumeShelveTestJSON-1652644983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a7dc1e89-c009-4640-8a37-d65fa999e2a1 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:58 devstack sudo[91314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a7dc1e89-c009-4640-8a37-d65fa999e2a1 1073741824 Nov 02 12:25:58 devstack sudo[91314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a2bd6401-e301-4775-b460-eda9de5d6893 tempest-TaggedAttachmentsTest-1731010272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:25:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a2bd6401-e301-4775-b460-eda9de5d6893 tempest-TaggedAttachmentsTest-1731010272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:25:58 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a2bd6401-e301-4775-b460-eda9de5d6893 tempest-TaggedAttachmentsTest-1731010272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:25:58 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a2bd6401-e301-4775-b460-eda9de5d6893 tempest-TaggedAttachmentsTest-1731010272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:25:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a2bd6401-e301-4775-b460-eda9de5d6893 tempest-TaggedAttachmentsTest-1731010272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:25:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a2bd6401-e301-4775-b460-eda9de5d6893 tempest-TaggedAttachmentsTest-1731010272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:58 devstack sudo[91316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:25:58 devstack sudo[91316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:58 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-b6deda34-4fab-47c5-8bad-641237010eff tempest-GroupSnapshotsTest-1165447445 None] group_snapshot 7c3b5e55-26b5-4cea-acdb-ad48b508c070: created successfully Nov 02 12:25:59 devstack sudo[91316]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a2bd6401-e301-4775-b460-eda9de5d6893 tempest-TaggedAttachmentsTest-1731010272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.290s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:59 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-a2bd6401-e301-4775-b460-eda9de5d6893 tempest-TaggedAttachmentsTest-1731010272 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:25:59 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-a2bd6401-e301-4775-b460-eda9de5d6893 tempest-TaggedAttachmentsTest-1731010272 None] Deleted volume successfully. Nov 02 12:25:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a2bd6401-e301-4775-b460-eda9de5d6893 tempest-TaggedAttachmentsTest-1731010272 None] Lock "cinder-3d4be753-bd7e-4b0c-bb8d-c1b01a6e4a1c-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:25:59 devstack sudo[91314]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-552895c3-3317-431c-b2cc-889f05227ff9 tempest-AttachVolumeShelveTestJSON-1652644983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a7dc1e89-c009-4640-8a37-d65fa999e2a1 1073741824" returned: 0 in 0.499s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-552895c3-3317-431c-b2cc-889f05227ff9 tempest-AttachVolumeShelveTestJSON-1652644983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a7dc1e89-c009-4640-8a37-d65fa999e2a1 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:59 devstack sudo[91323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a7dc1e89-c009-4640-8a37-d65fa999e2a1 Nov 02 12:25:59 devstack sudo[91323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:25:59 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] group_snapshot 7c3b5e55-26b5-4cea-acdb-ad48b508c070: deleting Nov 02 12:25:59 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] group_snapshot 7c3b5e55-26b5-4cea-acdb-ad48b508c070: deleting {{(pid=86515) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 12:25:59 devstack sudo[91323]: pam_unix(sudo:session): session closed for user root Nov 02 12:25:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-552895c3-3317-431c-b2cc-889f05227ff9 tempest-AttachVolumeShelveTestJSON-1652644983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a7dc1e89-c009-4640-8a37-d65fa999e2a1" returned: 0 in 0.266s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:25:59 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-552895c3-3317-431c-b2cc-889f05227ff9 tempest-AttachVolumeShelveTestJSON-1652644983 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:25:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-552895c3-3317-431c-b2cc-889f05227ff9 tempest-AttachVolumeShelveTestJSON-1652644983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:25:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] Acquiring lock "cinder-quobyte-977920a5-109a-426e-90bc-600d5593be60" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:25:59 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-552895c3-3317-431c-b2cc-889f05227ff9 tempest-AttachVolumeShelveTestJSON-1652644983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (700fd117-0633-425c-a466-6806d17d3de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7dc1e89-c009-4640-8a37-d65fa999e2a1', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:25:59 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-552895c3-3317-431c-b2cc-889f05227ff9 tempest-AttachVolumeShelveTestJSON-1652644983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30b99a67-a109-4a44-b602-365a1bb26804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:25:59 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-552895c3-3317-431c-b2cc-889f05227ff9 tempest-AttachVolumeShelveTestJSON-1652644983 None] Volume volume-a7dc1e89-c009-4640-8a37-d65fa999e2a1 (a7dc1e89-c009-4640-8a37-d65fa999e2a1): created successfully Nov 02 12:25:59 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-552895c3-3317-431c-b2cc-889f05227ff9 tempest-AttachVolumeShelveTestJSON-1652644983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30b99a67-a109-4a44-b602-365a1bb26804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:25:59 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-552895c3-3317-431c-b2cc-889f05227ff9 tempest-AttachVolumeShelveTestJSON-1652644983 None] Flow 'volume_create_manager' (9f87be68-e7a4-4fbb-8ca4-345792bd0424) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:25:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] Lock "cinder-quobyte-977920a5-109a-426e-90bc-600d5593be60" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:25:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] Acquiring lock "cinder-quobyte-270a50de-3aac-44c6-a085-2b158cb62b3f" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:25:59 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-552895c3-3317-431c-b2cc-889f05227ff9 tempest-AttachVolumeShelveTestJSON-1652644983 None] Created volume successfully. Nov 02 12:25:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] Lock "cinder-quobyte-270a50de-3aac-44c6-a085-2b158cb62b3f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:25:59 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] Deleting offline snapshot 270a50de-3aac-44c6-a085-2b158cb62b3f of volume 977920a5-109a-426e-90bc-600d5593be60 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:25:59 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] snapshot_file for this snap is: volume-977920a5-109a-426e-90bc-600d5593be60.270a50de-3aac-44c6-a085-2b158cb62b3f {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:25:59 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d150bb0-4fca-44f1-ab1a-ac1d74a83ef5]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:25:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60.270a50de-3aac-44c6-a085-2b158cb62b3f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:25:59 devstack sudo[91326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60.270a50de-3aac-44c6-a085-2b158cb62b3f Nov 02 12:25:59 devstack sudo[91326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:26:00 devstack sudo[91326]: pam_unix(sudo:session): session closed for user root Nov 02 12:26:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60.270a50de-3aac-44c6-a085-2b158cb62b3f" returned: 0 in 0.446s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:26:00 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-977920a5-109a-426e-90bc-600d5593be60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:26:00 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbc1c8a-519d-4b23-bc28-4433b1cd0f48]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:26:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:26:00 devstack sudo[91335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60 Nov 02 12:26:00 devstack sudo[91335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:26:00 devstack sudo[91335]: pam_unix(sudo:session): session closed for user root Nov 02 12:26:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60" returned: 0 in 0.432s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:26:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60.270a50de-3aac-44c6-a085-2b158cb62b3f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:26:00 devstack sudo[91342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60.270a50de-3aac-44c6-a085-2b158cb62b3f Nov 02 12:26:00 devstack sudo[91342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:26:00 devstack sudo[91342]: pam_unix(sudo:session): session closed for user root Nov 02 12:26:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60.270a50de-3aac-44c6-a085-2b158cb62b3f" returned: 0 in 0.410s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:26:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60.270a50de-3aac-44c6-a085-2b158cb62b3f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:26:01 devstack sudo[91348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60.270a50de-3aac-44c6-a085-2b158cb62b3f Nov 02 12:26:01 devstack sudo[91348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:26:01 devstack sudo[91348]: pam_unix(sudo:session): session closed for user root Nov 02 12:26:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60.270a50de-3aac-44c6-a085-2b158cb62b3f" returned: 0 in 0.287s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:26:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] Lock "cinder-quobyte-270a50de-3aac-44c6-a085-2b158cb62b3f" released by "_delete_snapshot" :: held 1.712s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:26:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] Lock "cinder-quobyte-977920a5-109a-426e-90bc-600d5593be60" released by "delete_snapshot" :: held 1.745s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:26:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] Acquiring lock "cinder-quobyte-0855bb53-e0d2-42a6-901d-2b4d7c4442a9" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:26:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] Lock "cinder-quobyte-0855bb53-e0d2-42a6-901d-2b4d7c4442a9" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:26:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] Acquiring lock "cinder-quobyte-e96af6b3-60f7-44c3-b33a-ce6ce4cbc6b6" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:26:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] Lock "cinder-quobyte-e96af6b3-60f7-44c3-b33a-ce6ce4cbc6b6" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:26:01 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] Deleting offline snapshot e96af6b3-60f7-44c3-b33a-ce6ce4cbc6b6 of volume 0855bb53-e0d2-42a6-901d-2b4d7c4442a9 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:26:01 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] snapshot_file for this snap is: volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9.e96af6b3-60f7-44c3-b33a-ce6ce4cbc6b6 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:26:01 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d658c381-6f0e-4e4d-bbe3-ce278a3ed398]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:26:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9.e96af6b3-60f7-44c3-b33a-ce6ce4cbc6b6 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:26:01 devstack sudo[91353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9.e96af6b3-60f7-44c3-b33a-ce6ce4cbc6b6 Nov 02 12:26:01 devstack sudo[91353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:26:01 devstack sudo[91353]: pam_unix(sudo:session): session closed for user root Nov 02 12:26:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9.e96af6b3-60f7-44c3-b33a-ce6ce4cbc6b6" returned: 0 in 0.502s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:26:01 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:26:02 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[74305f41-b7e1-4472-a369-1830b5c8afbe]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:26:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:26:02 devstack sudo[91363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9 Nov 02 12:26:02 devstack sudo[91363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:26:02 devstack sudo[91363]: pam_unix(sudo:session): session closed for user root Nov 02 12:26:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9" returned: 0 in 0.371s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:26:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9.e96af6b3-60f7-44c3-b33a-ce6ce4cbc6b6 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:26:02 devstack sudo[91375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9.e96af6b3-60f7-44c3-b33a-ce6ce4cbc6b6 Nov 02 12:26:02 devstack sudo[91375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:26:02 devstack sudo[91375]: pam_unix(sudo:session): session closed for user root Nov 02 12:26:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9.e96af6b3-60f7-44c3-b33a-ce6ce4cbc6b6" returned: 0 in 0.397s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:26:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9.e96af6b3-60f7-44c3-b33a-ce6ce4cbc6b6 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:26:02 devstack sudo[91380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9.e96af6b3-60f7-44c3-b33a-ce6ce4cbc6b6 Nov 02 12:26:02 devstack sudo[91380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:26:03 devstack sudo[91380]: pam_unix(sudo:session): session closed for user root Nov 02 12:26:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9.e96af6b3-60f7-44c3-b33a-ce6ce4cbc6b6" returned: 0 in 0.419s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:26:03 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] Lock "cinder-quobyte-e96af6b3-60f7-44c3-b33a-ce6ce4cbc6b6" released by "_delete_snapshot" :: held 1.873s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:26:03 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] Lock "cinder-quobyte-0855bb53-e0d2-42a6-901d-2b4d7c4442a9" released by "delete_snapshot" :: held 1.909s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:26:03 devstack cinder-volume[86515]: WARNING cinder.quota [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-588857108 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-588857108, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:26:03 devstack cinder-volume[86515]: WARNING cinder.quota [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-588857108 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-588857108, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:26:03 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] Created reservations ['2bb1c62b-f3e4-4337-80eb-f8b45be83b80', '971706ea-9202-4b67-ac4f-5708a1575dd7', 'bb898651-ce10-4248-889c-09a625260336', '8c46e84e-6ed0-415a-88ff-1be981c90a7e'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:26:03 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] Created reservations ['b9365137-e960-49da-831d-8d02a05a1330', 'a3efcf07-9e74-45ed-b1c5-6476ff182434', '848dfd21-8a02-4f98-b5e3-a396d38872ab', 'f15a8c24-eb9b-4b73-aac1-21eaf5286eab'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:26:03 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-a4df91ed-0087-4816-b51c-b376cc65c916 tempest-GroupSnapshotsTest-1165447445 None] group_snapshot 7c3b5e55-26b5-4cea-acdb-ad48b508c070: deleted successfully Nov 02 12:26:04 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9cc4314a-9014-46e0-b736-42b08df07b97 tempest-GroupSnapshotsTest-1165447445 None] Acquiring lock "cinder-quobyte-0855bb53-e0d2-42a6-901d-2b4d7c4442a9" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:26:04 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9cc4314a-9014-46e0-b736-42b08df07b97 tempest-GroupSnapshotsTest-1165447445 None] Lock "cinder-quobyte-0855bb53-e0d2-42a6-901d-2b4d7c4442a9" acquired by "delete_volume" :: waited 0.026s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:26:04 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f4f53a-97f4-4277-934b-e789346535e5]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:26:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9cc4314a-9014-46e0-b736-42b08df07b97 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:26:04 devstack sudo[91384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9 Nov 02 12:26:04 devstack sudo[91384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:26:05 devstack sudo[91384]: pam_unix(sudo:session): session closed for user root Nov 02 12:26:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9cc4314a-9014-46e0-b736-42b08df07b97 tempest-GroupSnapshotsTest-1165447445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9" returned: 0 in 0.451s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:26:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9cc4314a-9014-46e0-b736-42b08df07b97 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:26:05 devstack sudo[91389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9 Nov 02 12:26:05 devstack sudo[91389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:26:05 devstack sudo[91389]: pam_unix(sudo:session): session closed for user root Nov 02 12:26:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9cc4314a-9014-46e0-b736-42b08df07b97 tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0855bb53-e0d2-42a6-901d-2b4d7c4442a9" returned: 0 in 0.317s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:26:05 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9cc4314a-9014-46e0-b736-42b08df07b97 tempest-GroupSnapshotsTest-1165447445 None] Lock "cinder-quobyte-0855bb53-e0d2-42a6-901d-2b4d7c4442a9" released by "delete_volume" :: held 0.858s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:26:05 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9cc4314a-9014-46e0-b736-42b08df07b97 tempest-GroupSnapshotsTest-1165447445 None] Acquiring lock "cinder-quobyte-977920a5-109a-426e-90bc-600d5593be60" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:26:05 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9cc4314a-9014-46e0-b736-42b08df07b97 tempest-GroupSnapshotsTest-1165447445 None] Lock "cinder-quobyte-977920a5-109a-426e-90bc-600d5593be60" acquired by "delete_volume" :: waited 0.021s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:26:05 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[253d215f-f550-4ece-9713-6f9f56c55f8a]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:26:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9cc4314a-9014-46e0-b736-42b08df07b97 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:26:05 devstack sudo[91392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60 Nov 02 12:26:05 devstack sudo[91392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:26:06 devstack sudo[91392]: pam_unix(sudo:session): session closed for user root Nov 02 12:26:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9cc4314a-9014-46e0-b736-42b08df07b97 tempest-GroupSnapshotsTest-1165447445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60" returned: 0 in 0.454s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:26:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9cc4314a-9014-46e0-b736-42b08df07b97 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:26:06 devstack sudo[91398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60 Nov 02 12:26:06 devstack sudo[91398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:26:06 devstack sudo[91398]: pam_unix(sudo:session): session closed for user root Nov 02 12:26:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9cc4314a-9014-46e0-b736-42b08df07b97 tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-977920a5-109a-426e-90bc-600d5593be60" returned: 0 in 0.319s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:26:06 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9cc4314a-9014-46e0-b736-42b08df07b97 tempest-GroupSnapshotsTest-1165447445 None] Lock "cinder-quobyte-977920a5-109a-426e-90bc-600d5593be60" released by "delete_volume" :: held 0.845s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:26:06 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-9cc4314a-9014-46e0-b736-42b08df07b97 tempest-GroupSnapshotsTest-1165447445 None] Created reservations ['21a5a95f-c090-4798-a4d5-cf695e2f3577'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:26:06 devstack cinder-volume[86515]: WARNING cinder.quota [None req-9cc4314a-9014-46e0-b736-42b08df07b97 tempest-GroupSnapshotsTest-1165447445 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-588857108 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-588857108, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:26:06 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-9cc4314a-9014-46e0-b736-42b08df07b97 tempest-GroupSnapshotsTest-1165447445 None] Created reservations ['36dfcc40-6e30-43ad-afd0-d78b5723c909', '097fb81a-d4ef-402a-8ac0-f9ca7756906c', 'aab55445-2b52-4d90-8204-dfb1981d1beb', 'd02c8844-0256-494a-a5a1-600e578c0fa1'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:26:06 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-9cc4314a-9014-46e0-b736-42b08df07b97 tempest-GroupSnapshotsTest-1165447445 None] Created reservations ['6a39815c-dbe5-49e9-81a3-c7250994e76c', '6edca4aa-f95b-4d5b-afcc-88778defff53', '326f026c-5d2d-45ba-9456-c2f9a7b511c1', 'dfb7c44d-70c4-40bf-b4d8-770adea6e89e'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:26:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-9cc4314a-9014-46e0-b736-42b08df07b97 tempest-GroupSnapshotsTest-1165447445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:26:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-9cc4314a-9014-46e0-b736-42b08df07b97 tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:26:06 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-9cc4314a-9014-46e0-b736-42b08df07b97 tempest-GroupSnapshotsTest-1165447445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:26:06 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-9cc4314a-9014-46e0-b736-42b08df07b97 tempest-GroupSnapshotsTest-1165447445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:26:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-9cc4314a-9014-46e0-b736-42b08df07b97 tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:26:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9cc4314a-9014-46e0-b736-42b08df07b97 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:26:06 devstack sudo[91403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:26:06 devstack sudo[91403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:26:07 devstack sudo[91403]: pam_unix(sudo:session): session closed for user root Nov 02 12:26:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9cc4314a-9014-46e0-b736-42b08df07b97 tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.266s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:26:07 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-9cc4314a-9014-46e0-b736-42b08df07b97 tempest-GroupSnapshotsTest-1165447445 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:26:07 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-9cc4314a-9014-46e0-b736-42b08df07b97 tempest-GroupSnapshotsTest-1165447445 None] Delete group completed successfully. Nov 02 12:26:07 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-d774b079-ea58-4717-9995-b6e2d01fe8f2 tempest-GroupSnapshotsTest-1165447445 None] Group tempest-GroupSnapshotsTest-Group-1956293483: creating Nov 02 12:26:07 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=98,cinder:UPDATE=99,cinder:DELETE=2,cinder:INSERT=23 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:26:07 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-d774b079-ea58-4717-9995-b6e2d01fe8f2 tempest-GroupSnapshotsTest-1165447445 None] Group tempest-GroupSnapshotsTest-Group-1956293483: created successfully Nov 02 12:26:07 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-d774b079-ea58-4717-9995-b6e2d01fe8f2 tempest-GroupSnapshotsTest-1165447445 None] Create group completed successfully. Nov 02 12:26:09 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-ada1d2c9-107c-47f6-8d4e-6ea720dfbc28 tempest-GroupSnapshotsTest-1165447445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:26:09 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ada1d2c9-107c-47f6-8d4e-6ea720dfbc28 tempest-GroupSnapshotsTest-1165447445 None] Flow 'volume_create_manager' (7a8384a8-8d0a-4c63-ad22-ab4aee8e1b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:26:09 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ada1d2c9-107c-47f6-8d4e-6ea720dfbc28 tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7d91b30-771b-45dd-8f1b-53a5f493ee1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:26:09 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ada1d2c9-107c-47f6-8d4e-6ea720dfbc28 tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7d91b30-771b-45dd-8f1b-53a5f493ee1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-301425471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=43f81e01-a065-4eb7-90c3-ff157570ea23,host='devstack@QuobyteHD#QuobyteHD',id=d7078594-cead-42a2-8c2a-948c89107c4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b48ce9380a846ea89be74e7df3ebac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:26:09Z,use_quota=True,user_id='6c45dc15c9e744cc8b5ed18dbcb28dcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e937219d-1a10-465c-9145-03020bcfbb41),volume_type_id=e937219d-1a10-465c-9145-03020bcfbb41)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:26:09 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ada1d2c9-107c-47f6-8d4e-6ea720dfbc28 tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec0cfbfd-bb18-4253-9ff7-7c2f7507d338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:26:09 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ada1d2c9-107c-47f6-8d4e-6ea720dfbc28 tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec0cfbfd-bb18-4253-9ff7-7c2f7507d338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:26:09 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ada1d2c9-107c-47f6-8d4e-6ea720dfbc28 tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4644af8a-d5ff-4a8d-9808-fa27d6bec708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:26:09 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ada1d2c9-107c-47f6-8d4e-6ea720dfbc28 tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4644af8a-d5ff-4a8d-9808-fa27d6bec708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7078594-cead-42a2-8c2a-948c89107c4a', 'volume_name': 'volume-d7078594-cead-42a2-8c2a-948c89107c4a', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:26:09 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ada1d2c9-107c-47f6-8d4e-6ea720dfbc28 tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a91afa8-3f1d-48f1-bf3a-abe95359a242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:26:09 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ada1d2c9-107c-47f6-8d4e-6ea720dfbc28 tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a91afa8-3f1d-48f1-bf3a-abe95359a242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:26:09 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ada1d2c9-107c-47f6-8d4e-6ea720dfbc28 tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97336933-c1bc-4ca9-bfd6-08fc3a3a5ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:26:09 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-ada1d2c9-107c-47f6-8d4e-6ea720dfbc28 tempest-GroupSnapshotsTest-1165447445 None] Volume d7078594-cead-42a2-8c2a-948c89107c4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7078594-cead-42a2-8c2a-948c89107c4a', 'volume_size': 1} Nov 02 12:26:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ada1d2c9-107c-47f6-8d4e-6ea720dfbc28 tempest-GroupSnapshotsTest-1165447445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:26:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ada1d2c9-107c-47f6-8d4e-6ea720dfbc28 tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:26:09 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ada1d2c9-107c-47f6-8d4e-6ea720dfbc28 tempest-GroupSnapshotsTest-1165447445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=43f81e01-a065-4eb7-90c3-ff157570ea23,created_at=2026-11-02T11:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-301425471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=43f81e01-a065-4eb7-90c3-ff157570ea23,host='devstack@QuobyteHD#QuobyteHD',id=d7078594-cead-42a2-8c2a-948c89107c4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b48ce9380a846ea89be74e7df3ebac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:26:09Z,use_quota=True,user_id='6c45dc15c9e744cc8b5ed18dbcb28dcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e937219d-1a10-465c-9145-03020bcfbb41),volume_type_id=e937219d-1a10-465c-9145-03020bcfbb41)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:26:09 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-ada1d2c9-107c-47f6-8d4e-6ea720dfbc28 tempest-GroupSnapshotsTest-1165447445 None] Creating volume d7078594-cead-42a2-8c2a-948c89107c4a {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:26:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ada1d2c9-107c-47f6-8d4e-6ea720dfbc28 tempest-GroupSnapshotsTest-1165447445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:26:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ada1d2c9-107c-47f6-8d4e-6ea720dfbc28 tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:26:09 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ada1d2c9-107c-47f6-8d4e-6ea720dfbc28 tempest-GroupSnapshotsTest-1165447445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:26:09 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ada1d2c9-107c-47f6-8d4e-6ea720dfbc28 tempest-GroupSnapshotsTest-1165447445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:26:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ada1d2c9-107c-47f6-8d4e-6ea720dfbc28 tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:26:09 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ada1d2c9-107c-47f6-8d4e-6ea720dfbc28 tempest-GroupSnapshotsTest-1165447445 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:26:09 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-ada1d2c9-107c-47f6-8d4e-6ea720dfbc28 tempest-GroupSnapshotsTest-1165447445 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:26:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ada1d2c9-107c-47f6-8d4e-6ea720dfbc28 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:26:09 devstack sudo[91428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a 1073741824 Nov 02 12:26:09 devstack sudo[91428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:26:10 devstack sudo[91428]: pam_unix(sudo:session): session closed for user root Nov 02 12:26:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ada1d2c9-107c-47f6-8d4e-6ea720dfbc28 tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a 1073741824" returned: 0 in 0.585s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:26:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ada1d2c9-107c-47f6-8d4e-6ea720dfbc28 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:26:10 devstack sudo[91434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a Nov 02 12:26:10 devstack sudo[91434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:26:10 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-7f51450f-3b38-4ddf-9259-f951dbc55cff req-341ade8d-dee3-4b1b-af0c-816ec495c9f3 tempest-AttachVolumeShelveTestJSON-1652644983 None] No connector for attachment 12da7248-a1e8-41e4-b9b8-b4ce4f011bad; skipping storage backend terminate_connection call. {{(pid=86515) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 02 12:26:10 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-7f51450f-3b38-4ddf-9259-f951dbc55cff req-341ade8d-dee3-4b1b-af0c-816ec495c9f3 tempest-AttachVolumeShelveTestJSON-1652644983 None] Deleting attachment 12da7248-a1e8-41e4-b9b8-b4ce4f011bad. {{(pid=86515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:26:10 devstack sudo[91434]: pam_unix(sudo:session): session closed for user root Nov 02 12:26:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ada1d2c9-107c-47f6-8d4e-6ea720dfbc28 tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a" returned: 0 in 0.299s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:26:10 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ada1d2c9-107c-47f6-8d4e-6ea720dfbc28 tempest-GroupSnapshotsTest-1165447445 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:26:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ada1d2c9-107c-47f6-8d4e-6ea720dfbc28 tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:26:10 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ada1d2c9-107c-47f6-8d4e-6ea720dfbc28 tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97336933-c1bc-4ca9-bfd6-08fc3a3a5ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7078594-cead-42a2-8c2a-948c89107c4a', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:26:10 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ada1d2c9-107c-47f6-8d4e-6ea720dfbc28 tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f178a7ea-1ae8-4cd3-b2bb-75e25164d647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:26:10 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-ada1d2c9-107c-47f6-8d4e-6ea720dfbc28 tempest-GroupSnapshotsTest-1165447445 None] Volume volume-d7078594-cead-42a2-8c2a-948c89107c4a (d7078594-cead-42a2-8c2a-948c89107c4a): created successfully Nov 02 12:26:10 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ada1d2c9-107c-47f6-8d4e-6ea720dfbc28 tempest-GroupSnapshotsTest-1165447445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f178a7ea-1ae8-4cd3-b2bb-75e25164d647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:26:10 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ada1d2c9-107c-47f6-8d4e-6ea720dfbc28 tempest-GroupSnapshotsTest-1165447445 None] Flow 'volume_create_manager' (7a8384a8-8d0a-4c63-ad22-ab4aee8e1b23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:26:10 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-ada1d2c9-107c-47f6-8d4e-6ea720dfbc28 tempest-GroupSnapshotsTest-1165447445 None] Created volume successfully. Nov 02 12:26:12 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-438e6552-5282-4ba2-8623-d8382441cfc8 tempest-GroupSnapshotsTest-1165447445 None] GroupSnapshot b285f88c-13f5-429e-a806-975f2f48a5ce: creating. Nov 02 12:26:12 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-438e6552-5282-4ba2-8623-d8382441cfc8 tempest-GroupSnapshotsTest-1165447445 None] Group snapshot b285f88c-13f5-429e-a806-975f2f48a5ce: creating. {{(pid=86515) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 12:26:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-438e6552-5282-4ba2-8623-d8382441cfc8 tempest-GroupSnapshotsTest-1165447445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:26:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-438e6552-5282-4ba2-8623-d8382441cfc8 tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:26:12 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-438e6552-5282-4ba2-8623-d8382441cfc8 tempest-GroupSnapshotsTest-1165447445 None] Creating offline snapshot 011e5464-9a3b-43bf-bb6b-f8cff4272586 of volume d7078594-cead-42a2-8c2a-948c89107c4a {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:26:12 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[0361c2b4-670b-458d-ad94-fc06edc1d5e1]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:26:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-438e6552-5282-4ba2-8623-d8382441cfc8 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:26:12 devstack sudo[91441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a Nov 02 12:26:12 devstack sudo[91441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:26:12 devstack sudo[91441]: pam_unix(sudo:session): session closed for user root Nov 02 12:26:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-438e6552-5282-4ba2-8623-d8382441cfc8 tempest-GroupSnapshotsTest-1165447445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a" returned: 0 in 0.499s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:26:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-438e6552-5282-4ba2-8623-d8382441cfc8 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a.011e5464-9a3b-43bf-bb6b-f8cff4272586 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:26:12 devstack sudo[91447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a.011e5464-9a3b-43bf-bb6b-f8cff4272586 1G Nov 02 12:26:12 devstack sudo[91447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:26:13 devstack sudo[91447]: pam_unix(sudo:session): session closed for user root Nov 02 12:26:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-438e6552-5282-4ba2-8623-d8382441cfc8 tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a.011e5464-9a3b-43bf-bb6b-f8cff4272586 1G" returned: 0 in 0.490s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:26:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-438e6552-5282-4ba2-8623-d8382441cfc8 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7078594-cead-42a2-8c2a-948c89107c4a -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a.011e5464-9a3b-43bf-bb6b-f8cff4272586 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:26:13 devstack sudo[91454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7078594-cead-42a2-8c2a-948c89107c4a -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a.011e5464-9a3b-43bf-bb6b-f8cff4272586 Nov 02 12:26:13 devstack sudo[91454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:26:13 devstack sudo[91454]: pam_unix(sudo:session): session closed for user root Nov 02 12:26:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-438e6552-5282-4ba2-8623-d8382441cfc8 tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7078594-cead-42a2-8c2a-948c89107c4a -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a.011e5464-9a3b-43bf-bb6b-f8cff4272586" returned: 0 in 0.343s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:26:13 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-438e6552-5282-4ba2-8623-d8382441cfc8 tempest-GroupSnapshotsTest-1165447445 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a.011e5464-9a3b-43bf-bb6b-f8cff4272586 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 12:26:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-438e6552-5282-4ba2-8623-d8382441cfc8 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a.011e5464-9a3b-43bf-bb6b-f8cff4272586 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:26:13 devstack sudo[91460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a.011e5464-9a3b-43bf-bb6b-f8cff4272586 Nov 02 12:26:13 devstack sudo[91460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:26:13 devstack sudo[91460]: pam_unix(sudo:session): session closed for user root Nov 02 12:26:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-438e6552-5282-4ba2-8623-d8382441cfc8 tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a.011e5464-9a3b-43bf-bb6b-f8cff4272586" returned: 0 in 0.322s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:26:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-438e6552-5282-4ba2-8623-d8382441cfc8 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:26:13 devstack sudo[91463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a.info Nov 02 12:26:13 devstack sudo[91463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:26:14 devstack sudo[91463]: pam_unix(sudo:session): session closed for user root Nov 02 12:26:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-438e6552-5282-4ba2-8623-d8382441cfc8 tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a.info" returned: 0 in 0.308s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:26:14 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-438e6552-5282-4ba2-8623-d8382441cfc8 tempest-GroupSnapshotsTest-1165447445 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 12:26:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-438e6552-5282-4ba2-8623-d8382441cfc8 tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:26:14 devstack sudo[91466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a.info Nov 02 12:26:14 devstack sudo[91466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:26:14 devstack sudo[91466]: pam_unix(sudo:session): session closed for user root Nov 02 12:26:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-438e6552-5282-4ba2-8623-d8382441cfc8 tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a.info" returned: 0 in 0.288s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:26:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-438e6552-5282-4ba2-8623-d8382441cfc8 tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.375s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:26:14 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-438e6552-5282-4ba2-8623-d8382441cfc8 tempest-GroupSnapshotsTest-1165447445 None] group_snapshot b285f88c-13f5-429e-a806-975f2f48a5ce: created successfully Nov 02 12:26:15 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-deeff405-54d6-4192-871b-4bacec25588d tempest-GroupSnapshotsTest-1165447445 None] group_snapshot b285f88c-13f5-429e-a806-975f2f48a5ce: deleting Nov 02 12:26:15 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-deeff405-54d6-4192-871b-4bacec25588d tempest-GroupSnapshotsTest-1165447445 None] group_snapshot b285f88c-13f5-429e-a806-975f2f48a5ce: deleting {{(pid=86515) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 12:26:15 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-deeff405-54d6-4192-871b-4bacec25588d tempest-GroupSnapshotsTest-1165447445 None] Acquiring lock "cinder-quobyte-d7078594-cead-42a2-8c2a-948c89107c4a" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:26:15 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-deeff405-54d6-4192-871b-4bacec25588d tempest-GroupSnapshotsTest-1165447445 None] Lock "cinder-quobyte-d7078594-cead-42a2-8c2a-948c89107c4a" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:26:15 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-deeff405-54d6-4192-871b-4bacec25588d tempest-GroupSnapshotsTest-1165447445 None] Acquiring lock "cinder-quobyte-011e5464-9a3b-43bf-bb6b-f8cff4272586" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:26:15 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-deeff405-54d6-4192-871b-4bacec25588d tempest-GroupSnapshotsTest-1165447445 None] Lock "cinder-quobyte-011e5464-9a3b-43bf-bb6b-f8cff4272586" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:26:15 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-deeff405-54d6-4192-871b-4bacec25588d tempest-GroupSnapshotsTest-1165447445 None] Deleting offline snapshot 011e5464-9a3b-43bf-bb6b-f8cff4272586 of volume d7078594-cead-42a2-8c2a-948c89107c4a {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:26:15 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-deeff405-54d6-4192-871b-4bacec25588d tempest-GroupSnapshotsTest-1165447445 None] snapshot_file for this snap is: volume-d7078594-cead-42a2-8c2a-948c89107c4a.011e5464-9a3b-43bf-bb6b-f8cff4272586 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:26:15 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fc2335-4bd2-4edd-991e-1369ac598883]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:26:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-deeff405-54d6-4192-871b-4bacec25588d tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a.011e5464-9a3b-43bf-bb6b-f8cff4272586 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:26:16 devstack sudo[91471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a.011e5464-9a3b-43bf-bb6b-f8cff4272586 Nov 02 12:26:16 devstack sudo[91471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:26:16 devstack sudo[91471]: pam_unix(sudo:session): session closed for user root Nov 02 12:26:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-deeff405-54d6-4192-871b-4bacec25588d tempest-GroupSnapshotsTest-1165447445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a.011e5464-9a3b-43bf-bb6b-f8cff4272586" returned: 0 in 0.558s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:26:16 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-deeff405-54d6-4192-871b-4bacec25588d tempest-GroupSnapshotsTest-1165447445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7078594-cead-42a2-8c2a-948c89107c4a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:26:16 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d63b1b-9b88-420b-96d4-b39c759aceec]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:26:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-deeff405-54d6-4192-871b-4bacec25588d tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:26:16 devstack sudo[91476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a Nov 02 12:26:16 devstack sudo[91476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:26:16 devstack sudo[91476]: pam_unix(sudo:session): session closed for user root Nov 02 12:26:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-deeff405-54d6-4192-871b-4bacec25588d tempest-GroupSnapshotsTest-1165447445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a" returned: 0 in 0.429s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:26:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-deeff405-54d6-4192-871b-4bacec25588d tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a.011e5464-9a3b-43bf-bb6b-f8cff4272586 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:26:17 devstack sudo[91481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a.011e5464-9a3b-43bf-bb6b-f8cff4272586 Nov 02 12:26:17 devstack sudo[91481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:26:17 devstack sudo[91481]: pam_unix(sudo:session): session closed for user root Nov 02 12:26:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-deeff405-54d6-4192-871b-4bacec25588d tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a.011e5464-9a3b-43bf-bb6b-f8cff4272586" returned: 0 in 0.484s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:26:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-deeff405-54d6-4192-871b-4bacec25588d tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a.011e5464-9a3b-43bf-bb6b-f8cff4272586 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:26:17 devstack sudo[91497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a.011e5464-9a3b-43bf-bb6b-f8cff4272586 Nov 02 12:26:17 devstack sudo[91497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:26:17 devstack sudo[91497]: pam_unix(sudo:session): session closed for user root Nov 02 12:26:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-deeff405-54d6-4192-871b-4bacec25588d tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a.011e5464-9a3b-43bf-bb6b-f8cff4272586" returned: 0 in 0.261s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:26:17 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-deeff405-54d6-4192-871b-4bacec25588d tempest-GroupSnapshotsTest-1165447445 None] Lock "cinder-quobyte-011e5464-9a3b-43bf-bb6b-f8cff4272586" released by "_delete_snapshot" :: held 1.927s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:26:17 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-deeff405-54d6-4192-871b-4bacec25588d tempest-GroupSnapshotsTest-1165447445 None] Lock "cinder-quobyte-d7078594-cead-42a2-8c2a-948c89107c4a" released by "delete_snapshot" :: held 1.981s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:26:17 devstack cinder-volume[86515]: WARNING cinder.quota [None req-deeff405-54d6-4192-871b-4bacec25588d tempest-GroupSnapshotsTest-1165447445 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-325515455 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-325515455, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:26:17 devstack cinder-volume[86515]: WARNING cinder.quota [None req-deeff405-54d6-4192-871b-4bacec25588d tempest-GroupSnapshotsTest-1165447445 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-325515455 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-325515455, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:26:17 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-deeff405-54d6-4192-871b-4bacec25588d tempest-GroupSnapshotsTest-1165447445 None] Created reservations ['dd889f7b-0d6c-499b-84b4-94b9454d29f8', '98e599e5-ecc5-4c05-9467-8be19a742c6d', 'a9271455-fbe3-44a1-85ba-8283596460b6', 'b5d67605-751b-4976-b808-cb1a83f8cf10'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:26:17 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-deeff405-54d6-4192-871b-4bacec25588d tempest-GroupSnapshotsTest-1165447445 None] group_snapshot b285f88c-13f5-429e-a806-975f2f48a5ce: deleted successfully Nov 02 12:26:18 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-30f867be-70d3-4b6a-a97f-28b91de66c7d tempest-GroupSnapshotsTest-1165447445 None] Acquiring lock "cinder-quobyte-d7078594-cead-42a2-8c2a-948c89107c4a" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:26:18 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-30f867be-70d3-4b6a-a97f-28b91de66c7d tempest-GroupSnapshotsTest-1165447445 None] Lock "cinder-quobyte-d7078594-cead-42a2-8c2a-948c89107c4a" acquired by "delete_volume" :: waited 0.027s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:26:18 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[427ec723-f5a9-445e-9ece-4b01ba1fc901]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:26:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-30f867be-70d3-4b6a-a97f-28b91de66c7d tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:26:18 devstack sudo[91523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a Nov 02 12:26:18 devstack sudo[91523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:26:19 devstack sudo[91523]: pam_unix(sudo:session): session closed for user root Nov 02 12:26:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-30f867be-70d3-4b6a-a97f-28b91de66c7d tempest-GroupSnapshotsTest-1165447445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a" returned: 0 in 0.428s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:26:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-30f867be-70d3-4b6a-a97f-28b91de66c7d tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:26:19 devstack sudo[91529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a Nov 02 12:26:19 devstack sudo[91529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:26:19 devstack sudo[91529]: pam_unix(sudo:session): session closed for user root Nov 02 12:26:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-30f867be-70d3-4b6a-a97f-28b91de66c7d tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7078594-cead-42a2-8c2a-948c89107c4a" returned: 0 in 0.314s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:26:19 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-30f867be-70d3-4b6a-a97f-28b91de66c7d tempest-GroupSnapshotsTest-1165447445 None] Lock "cinder-quobyte-d7078594-cead-42a2-8c2a-948c89107c4a" released by "delete_volume" :: held 0.883s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:26:19 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-30f867be-70d3-4b6a-a97f-28b91de66c7d tempest-GroupSnapshotsTest-1165447445 None] Created reservations ['7f9a2fdf-6a88-4cc9-8ed1-ff5784163024'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:26:19 devstack cinder-volume[86515]: WARNING cinder.quota [None req-30f867be-70d3-4b6a-a97f-28b91de66c7d tempest-GroupSnapshotsTest-1165447445 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-325515455 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-325515455, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:26:19 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-30f867be-70d3-4b6a-a97f-28b91de66c7d tempest-GroupSnapshotsTest-1165447445 None] Created reservations ['b967f5bf-c095-48da-8171-abce2dabff1e', 'dc4f23d7-1f9b-4e73-ac43-51699af46a9d', '58331848-dde1-42ec-94b9-20ab315759c1', 'df50f699-1d77-43e3-8040-92216e4de04f'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:26:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-30f867be-70d3-4b6a-a97f-28b91de66c7d tempest-GroupSnapshotsTest-1165447445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:26:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-30f867be-70d3-4b6a-a97f-28b91de66c7d tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:26:19 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-30f867be-70d3-4b6a-a97f-28b91de66c7d tempest-GroupSnapshotsTest-1165447445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:26:19 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-30f867be-70d3-4b6a-a97f-28b91de66c7d tempest-GroupSnapshotsTest-1165447445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:26:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-30f867be-70d3-4b6a-a97f-28b91de66c7d tempest-GroupSnapshotsTest-1165447445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:26:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-30f867be-70d3-4b6a-a97f-28b91de66c7d tempest-GroupSnapshotsTest-1165447445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:26:19 devstack sudo[91534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:26:19 devstack sudo[91534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:26:20 devstack sudo[91534]: pam_unix(sudo:session): session closed for user root Nov 02 12:26:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-30f867be-70d3-4b6a-a97f-28b91de66c7d tempest-GroupSnapshotsTest-1165447445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.463s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:26:20 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-30f867be-70d3-4b6a-a97f-28b91de66c7d tempest-GroupSnapshotsTest-1165447445 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:26:20 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-30f867be-70d3-4b6a-a97f-28b91de66c7d tempest-GroupSnapshotsTest-1165447445 None] Delete group completed successfully. Nov 02 12:26:20 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-2452c16a-cfda-41f0-bd82-9894ef3b7ed1 req-fa582d63-6533-445a-8614-f3b366bbda9d tempest-AttachVolumeTestJSON-1055770325 None] Terminate volume connection completed successfully. Nov 02 12:26:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-2452c16a-cfda-41f0-bd82-9894ef3b7ed1 req-fa582d63-6533-445a-8614-f3b366bbda9d tempest-AttachVolumeTestJSON-1055770325 None] Deleting attachment 8910e9de-e409-4b74-afa2-aeb26b227257. {{(pid=86515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:26:30 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:UPDATE=22,cinder:SELECT=23,cinder:INSERT=4 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:26:30 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:INSERT=27,cinder:SELECT=134,cinder:UPDATE=115,cinder:DELETE=5 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:26:40 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-5de629e7-bf88-4bc1-be16-8664eb3216fa tempest-GroupsV320Test-1260773876 None] Group tempest-GroupsV320Test-Group-205021719: creating Nov 02 12:26:40 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-5de629e7-bf88-4bc1-be16-8664eb3216fa tempest-GroupsV320Test-1260773876 None] Group tempest-GroupsV320Test-Group-205021719: created successfully Nov 02 12:26:40 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-5de629e7-bf88-4bc1-be16-8664eb3216fa tempest-GroupsV320Test-1260773876 None] Create group completed successfully. Nov 02 12:26:42 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-54ada476-83e3-4965-9024-b620aee68a9d tempest-GroupsV320Test-1260773876 None] Created reservations ['e293830f-a0be-4a37-b8fe-e9a055757b9f'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:26:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-54ada476-83e3-4965-9024-b620aee68a9d tempest-GroupsV320Test-1260773876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:26:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-54ada476-83e3-4965-9024-b620aee68a9d tempest-GroupsV320Test-1260773876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:26:42 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-54ada476-83e3-4965-9024-b620aee68a9d tempest-GroupsV320Test-1260773876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:26:42 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-54ada476-83e3-4965-9024-b620aee68a9d tempest-GroupsV320Test-1260773876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:26:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-54ada476-83e3-4965-9024-b620aee68a9d tempest-GroupsV320Test-1260773876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:26:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-54ada476-83e3-4965-9024-b620aee68a9d tempest-GroupsV320Test-1260773876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:26:42 devstack sudo[91861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:26:42 devstack sudo[91861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:26:42 devstack sudo[91861]: pam_unix(sudo:session): session closed for user root Nov 02 12:26:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-54ada476-83e3-4965-9024-b620aee68a9d tempest-GroupsV320Test-1260773876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.256s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:26:42 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-54ada476-83e3-4965-9024-b620aee68a9d tempest-GroupsV320Test-1260773876 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:26:42 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-54ada476-83e3-4965-9024-b620aee68a9d tempest-GroupsV320Test-1260773876 None] Delete group completed successfully. Nov 02 12:26:43 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:26:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:26:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:26:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:26:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:26:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:26:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:26:43 devstack sudo[91865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:26:43 devstack sudo[91865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:26:44 devstack sudo[91865]: pam_unix(sudo:session): session closed for user root Nov 02 12:26:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.554s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:26:44 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:26:44 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager._thread_info {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:26:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread count: 8 {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:26:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread info: [<_MainThread(MainThread, started 129944084402304)>, , , , , , , ] {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:26:49 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c7f42d8a-48ea-4ed3-949d-7cc310437654 tempest-AttachVolumeShelveTestJSON-1652644983 None] Acquiring lock "cinder-a7dc1e89-c009-4640-8a37-d65fa999e2a1-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:26:49 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c7f42d8a-48ea-4ed3-949d-7cc310437654 tempest-AttachVolumeShelveTestJSON-1652644983 None] Lock "cinder-a7dc1e89-c009-4640-8a37-d65fa999e2a1-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:26:50 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c7f42d8a-48ea-4ed3-949d-7cc310437654 tempest-AttachVolumeShelveTestJSON-1652644983 None] Acquiring lock "cinder-quobyte-a7dc1e89-c009-4640-8a37-d65fa999e2a1" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:26:50 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c7f42d8a-48ea-4ed3-949d-7cc310437654 tempest-AttachVolumeShelveTestJSON-1652644983 None] Lock "cinder-quobyte-a7dc1e89-c009-4640-8a37-d65fa999e2a1" acquired by "delete_volume" :: waited 0.046s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:26:50 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edb7c17-8295-4bbd-90d6-a56aabb124b6]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:26:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c7f42d8a-48ea-4ed3-949d-7cc310437654 tempest-AttachVolumeShelveTestJSON-1652644983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a7dc1e89-c009-4640-8a37-d65fa999e2a1 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:26:50 devstack sudo[91925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a7dc1e89-c009-4640-8a37-d65fa999e2a1 Nov 02 12:26:50 devstack sudo[91925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:26:50 devstack sudo[91925]: pam_unix(sudo:session): session closed for user root Nov 02 12:26:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c7f42d8a-48ea-4ed3-949d-7cc310437654 tempest-AttachVolumeShelveTestJSON-1652644983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a7dc1e89-c009-4640-8a37-d65fa999e2a1" returned: 0 in 0.462s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:26:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c7f42d8a-48ea-4ed3-949d-7cc310437654 tempest-AttachVolumeShelveTestJSON-1652644983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a7dc1e89-c009-4640-8a37-d65fa999e2a1 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:26:50 devstack sudo[91933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a7dc1e89-c009-4640-8a37-d65fa999e2a1 Nov 02 12:26:50 devstack sudo[91933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:26:50 devstack sudo[91933]: pam_unix(sudo:session): session closed for user root Nov 02 12:26:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c7f42d8a-48ea-4ed3-949d-7cc310437654 tempest-AttachVolumeShelveTestJSON-1652644983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a7dc1e89-c009-4640-8a37-d65fa999e2a1" returned: 0 in 0.270s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:26:50 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c7f42d8a-48ea-4ed3-949d-7cc310437654 tempest-AttachVolumeShelveTestJSON-1652644983 None] Lock "cinder-quobyte-a7dc1e89-c009-4640-8a37-d65fa999e2a1" released by "delete_volume" :: held 0.807s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:26:50 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-c7f42d8a-48ea-4ed3-949d-7cc310437654 tempest-AttachVolumeShelveTestJSON-1652644983 None] Created reservations ['c9fc834e-034d-4b69-9a42-1a026cfe6ac7', 'e210022e-bb51-4519-a339-847272fcfe1d', '6d450bf4-dd7f-4de8-98a4-9876e9e715e2', '83fdf6ba-620c-4630-a7fb-1be943cab0f1'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:26:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c7f42d8a-48ea-4ed3-949d-7cc310437654 tempest-AttachVolumeShelveTestJSON-1652644983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:26:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c7f42d8a-48ea-4ed3-949d-7cc310437654 tempest-AttachVolumeShelveTestJSON-1652644983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:26:51 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-c7f42d8a-48ea-4ed3-949d-7cc310437654 tempest-AttachVolumeShelveTestJSON-1652644983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:26:51 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-c7f42d8a-48ea-4ed3-949d-7cc310437654 tempest-AttachVolumeShelveTestJSON-1652644983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:26:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c7f42d8a-48ea-4ed3-949d-7cc310437654 tempest-AttachVolumeShelveTestJSON-1652644983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:26:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c7f42d8a-48ea-4ed3-949d-7cc310437654 tempest-AttachVolumeShelveTestJSON-1652644983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:26:51 devstack sudo[91937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:26:51 devstack sudo[91937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:26:51 devstack sudo[91937]: pam_unix(sudo:session): session closed for user root Nov 02 12:26:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c7f42d8a-48ea-4ed3-949d-7cc310437654 tempest-AttachVolumeShelveTestJSON-1652644983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.435s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:26:51 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-c7f42d8a-48ea-4ed3-949d-7cc310437654 tempest-AttachVolumeShelveTestJSON-1652644983 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:26:51 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-c7f42d8a-48ea-4ed3-949d-7cc310437654 tempest-AttachVolumeShelveTestJSON-1652644983 None] Deleted volume successfully. Nov 02 12:26:51 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c7f42d8a-48ea-4ed3-949d-7cc310437654 tempest-AttachVolumeShelveTestJSON-1652644983 None] Lock "cinder-a7dc1e89-c009-4640-8a37-d65fa999e2a1-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:27:01 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=12,cinder:UPDATE=11,cinder:INSERT=3 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:27:01 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=12,cinder:UPDATE=13,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:27:02 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-578b5175-fbb6-459a-8bf2-963a6be3d98f tempest-VolumesTestJSON-581134695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:27:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-578b5175-fbb6-459a-8bf2-963a6be3d98f tempest-VolumesTestJSON-581134695 None] Flow 'volume_create_manager' (fba3c210-1e31-4e20-8601-cb6ccfa96362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:27:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-578b5175-fbb6-459a-8bf2-963a6be3d98f tempest-VolumesTestJSON-581134695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bed735e-ff43-4414-9844-72add7def196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-578b5175-fbb6-459a-8bf2-963a6be3d98f tempest-VolumesTestJSON-581134695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bed735e-ff43-4414-9844-72add7def196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-556714603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66016057-6d47-4a9c-ad94-1fadc9d24615,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1fe187606ee1411196a86b5b60eaeaf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:27:02Z,use_quota=True,user_id='a238d58028cd48c2987f5b5c494d97cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-578b5175-fbb6-459a-8bf2-963a6be3d98f tempest-VolumesTestJSON-581134695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (984f626d-795e-4a66-b80f-e21a84144ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-578b5175-fbb6-459a-8bf2-963a6be3d98f tempest-VolumesTestJSON-581134695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (984f626d-795e-4a66-b80f-e21a84144ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-578b5175-fbb6-459a-8bf2-963a6be3d98f tempest-VolumesTestJSON-581134695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0219593a-40b4-48c3-8af6-efc08242c1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-578b5175-fbb6-459a-8bf2-963a6be3d98f tempest-VolumesTestJSON-581134695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0219593a-40b4-48c3-8af6-efc08242c1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66016057-6d47-4a9c-ad94-1fadc9d24615', 'volume_name': 'volume-66016057-6d47-4a9c-ad94-1fadc9d24615', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-578b5175-fbb6-459a-8bf2-963a6be3d98f tempest-VolumesTestJSON-581134695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777a408c-505f-4fbf-8da3-8c58618d692e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-578b5175-fbb6-459a-8bf2-963a6be3d98f tempest-VolumesTestJSON-581134695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777a408c-505f-4fbf-8da3-8c58618d692e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-578b5175-fbb6-459a-8bf2-963a6be3d98f tempest-VolumesTestJSON-581134695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de39db13-488a-4d80-b440-f5fe848ec037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:02 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-578b5175-fbb6-459a-8bf2-963a6be3d98f tempest-VolumesTestJSON-581134695 None] Volume 66016057-6d47-4a9c-ad94-1fadc9d24615: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66016057-6d47-4a9c-ad94-1fadc9d24615', 'volume_size': 1} Nov 02 12:27:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-578b5175-fbb6-459a-8bf2-963a6be3d98f tempest-VolumesTestJSON-581134695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:27:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-578b5175-fbb6-459a-8bf2-963a6be3d98f tempest-VolumesTestJSON-581134695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:27:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-578b5175-fbb6-459a-8bf2-963a6be3d98f tempest-VolumesTestJSON-581134695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-556714603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66016057-6d47-4a9c-ad94-1fadc9d24615,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1fe187606ee1411196a86b5b60eaeaf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:27:02Z,use_quota=True,user_id='a238d58028cd48c2987f5b5c494d97cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:27:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-578b5175-fbb6-459a-8bf2-963a6be3d98f tempest-VolumesTestJSON-581134695 None] Creating volume 66016057-6d47-4a9c-ad94-1fadc9d24615 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:27:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-578b5175-fbb6-459a-8bf2-963a6be3d98f tempest-VolumesTestJSON-581134695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:27:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-578b5175-fbb6-459a-8bf2-963a6be3d98f tempest-VolumesTestJSON-581134695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:27:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-578b5175-fbb6-459a-8bf2-963a6be3d98f tempest-VolumesTestJSON-581134695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:27:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-578b5175-fbb6-459a-8bf2-963a6be3d98f tempest-VolumesTestJSON-581134695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:27:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-578b5175-fbb6-459a-8bf2-963a6be3d98f tempest-VolumesTestJSON-581134695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:27:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-578b5175-fbb6-459a-8bf2-963a6be3d98f tempest-VolumesTestJSON-581134695 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:27:02 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-578b5175-fbb6-459a-8bf2-963a6be3d98f tempest-VolumesTestJSON-581134695 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:27:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-578b5175-fbb6-459a-8bf2-963a6be3d98f tempest-VolumesTestJSON-581134695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-66016057-6d47-4a9c-ad94-1fadc9d24615 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:02 devstack sudo[91993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-66016057-6d47-4a9c-ad94-1fadc9d24615 1073741824 Nov 02 12:27:02 devstack sudo[91993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:03 devstack sudo[91993]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-578b5175-fbb6-459a-8bf2-963a6be3d98f tempest-VolumesTestJSON-581134695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-66016057-6d47-4a9c-ad94-1fadc9d24615 1073741824" returned: 0 in 0.535s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-578b5175-fbb6-459a-8bf2-963a6be3d98f tempest-VolumesTestJSON-581134695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-66016057-6d47-4a9c-ad94-1fadc9d24615 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:03 devstack sudo[91999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-66016057-6d47-4a9c-ad94-1fadc9d24615 Nov 02 12:27:03 devstack sudo[91999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:03 devstack sudo[91999]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-578b5175-fbb6-459a-8bf2-963a6be3d98f tempest-VolumesTestJSON-581134695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-66016057-6d47-4a9c-ad94-1fadc9d24615" returned: 0 in 0.384s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:03 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-578b5175-fbb6-459a-8bf2-963a6be3d98f tempest-VolumesTestJSON-581134695 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:27:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-578b5175-fbb6-459a-8bf2-963a6be3d98f tempest-VolumesTestJSON-581134695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:27:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-578b5175-fbb6-459a-8bf2-963a6be3d98f tempest-VolumesTestJSON-581134695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de39db13-488a-4d80-b440-f5fe848ec037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66016057-6d47-4a9c-ad94-1fadc9d24615', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-578b5175-fbb6-459a-8bf2-963a6be3d98f tempest-VolumesTestJSON-581134695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (693ccb1e-30c3-4ded-809e-41733336d951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:03 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-578b5175-fbb6-459a-8bf2-963a6be3d98f tempest-VolumesTestJSON-581134695 None] Volume volume-66016057-6d47-4a9c-ad94-1fadc9d24615 (66016057-6d47-4a9c-ad94-1fadc9d24615): created successfully Nov 02 12:27:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-578b5175-fbb6-459a-8bf2-963a6be3d98f tempest-VolumesTestJSON-581134695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (693ccb1e-30c3-4ded-809e-41733336d951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-578b5175-fbb6-459a-8bf2-963a6be3d98f tempest-VolumesTestJSON-581134695 None] Flow 'volume_create_manager' (fba3c210-1e31-4e20-8601-cb6ccfa96362) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:27:03 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-578b5175-fbb6-459a-8bf2-963a6be3d98f tempest-VolumesTestJSON-581134695 None] Created volume successfully. Nov 02 12:27:05 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-761d4b18-0dcd-4bfd-981a-3d3085087569 tempest-VolumesTestJSON-581134695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:27:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-761d4b18-0dcd-4bfd-981a-3d3085087569 tempest-VolumesTestJSON-581134695 None] Flow 'volume_create_manager' (3213f0b4-c527-4847-8927-2ad245ff95ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:27:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-761d4b18-0dcd-4bfd-981a-3d3085087569 tempest-VolumesTestJSON-581134695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (636df129-b2b2-47f3-94df-35663b7d9108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-761d4b18-0dcd-4bfd-981a-3d3085087569 tempest-VolumesTestJSON-581134695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (636df129-b2b2-47f3-94df-35663b7d9108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-364387962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91ce9c85-0da7-465f-bd2e-c492e6912c6a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1fe187606ee1411196a86b5b60eaeaf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:27:05Z,use_quota=True,user_id='a238d58028cd48c2987f5b5c494d97cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-761d4b18-0dcd-4bfd-981a-3d3085087569 tempest-VolumesTestJSON-581134695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b51e917-3faa-47be-b287-26d1ba1641a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-761d4b18-0dcd-4bfd-981a-3d3085087569 tempest-VolumesTestJSON-581134695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b51e917-3faa-47be-b287-26d1ba1641a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-761d4b18-0dcd-4bfd-981a-3d3085087569 tempest-VolumesTestJSON-581134695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0028e5a2-4582-46b1-a0a9-12d6a3fefc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-761d4b18-0dcd-4bfd-981a-3d3085087569 tempest-VolumesTestJSON-581134695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0028e5a2-4582-46b1-a0a9-12d6a3fefc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91ce9c85-0da7-465f-bd2e-c492e6912c6a', 'volume_name': 'volume-91ce9c85-0da7-465f-bd2e-c492e6912c6a', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-761d4b18-0dcd-4bfd-981a-3d3085087569 tempest-VolumesTestJSON-581134695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b56824f5-8a25-480e-9fa8-a072139c9a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-761d4b18-0dcd-4bfd-981a-3d3085087569 tempest-VolumesTestJSON-581134695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b56824f5-8a25-480e-9fa8-a072139c9a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-761d4b18-0dcd-4bfd-981a-3d3085087569 tempest-VolumesTestJSON-581134695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f042050d-f6d7-480d-a7a0-cdc3ae4ffeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:05 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-761d4b18-0dcd-4bfd-981a-3d3085087569 tempest-VolumesTestJSON-581134695 None] Volume 91ce9c85-0da7-465f-bd2e-c492e6912c6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91ce9c85-0da7-465f-bd2e-c492e6912c6a', 'volume_size': 1} Nov 02 12:27:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-761d4b18-0dcd-4bfd-981a-3d3085087569 tempest-VolumesTestJSON-581134695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:27:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-761d4b18-0dcd-4bfd-981a-3d3085087569 tempest-VolumesTestJSON-581134695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:27:05 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-761d4b18-0dcd-4bfd-981a-3d3085087569 tempest-VolumesTestJSON-581134695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-364387962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91ce9c85-0da7-465f-bd2e-c492e6912c6a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1fe187606ee1411196a86b5b60eaeaf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:27:05Z,use_quota=True,user_id='a238d58028cd48c2987f5b5c494d97cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:27:05 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-761d4b18-0dcd-4bfd-981a-3d3085087569 tempest-VolumesTestJSON-581134695 None] Creating volume 91ce9c85-0da7-465f-bd2e-c492e6912c6a {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:27:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-761d4b18-0dcd-4bfd-981a-3d3085087569 tempest-VolumesTestJSON-581134695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:27:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-761d4b18-0dcd-4bfd-981a-3d3085087569 tempest-VolumesTestJSON-581134695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:27:05 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-761d4b18-0dcd-4bfd-981a-3d3085087569 tempest-VolumesTestJSON-581134695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:27:05 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-761d4b18-0dcd-4bfd-981a-3d3085087569 tempest-VolumesTestJSON-581134695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:27:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-761d4b18-0dcd-4bfd-981a-3d3085087569 tempest-VolumesTestJSON-581134695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:27:05 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-761d4b18-0dcd-4bfd-981a-3d3085087569 tempest-VolumesTestJSON-581134695 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:27:05 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-761d4b18-0dcd-4bfd-981a-3d3085087569 tempest-VolumesTestJSON-581134695 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:27:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-761d4b18-0dcd-4bfd-981a-3d3085087569 tempest-VolumesTestJSON-581134695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-91ce9c85-0da7-465f-bd2e-c492e6912c6a 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:05 devstack sudo[92016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-91ce9c85-0da7-465f-bd2e-c492e6912c6a 1073741824 Nov 02 12:27:05 devstack sudo[92016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:06 devstack sudo[92016]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-761d4b18-0dcd-4bfd-981a-3d3085087569 tempest-VolumesTestJSON-581134695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-91ce9c85-0da7-465f-bd2e-c492e6912c6a 1073741824" returned: 0 in 0.852s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-761d4b18-0dcd-4bfd-981a-3d3085087569 tempest-VolumesTestJSON-581134695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-91ce9c85-0da7-465f-bd2e-c492e6912c6a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:06 devstack sudo[92034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-91ce9c85-0da7-465f-bd2e-c492e6912c6a Nov 02 12:27:06 devstack sudo[92034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:06 devstack sudo[92034]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-761d4b18-0dcd-4bfd-981a-3d3085087569 tempest-VolumesTestJSON-581134695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-91ce9c85-0da7-465f-bd2e-c492e6912c6a" returned: 0 in 0.342s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:06 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-761d4b18-0dcd-4bfd-981a-3d3085087569 tempest-VolumesTestJSON-581134695 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:27:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-761d4b18-0dcd-4bfd-981a-3d3085087569 tempest-VolumesTestJSON-581134695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:27:06 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-761d4b18-0dcd-4bfd-981a-3d3085087569 tempest-VolumesTestJSON-581134695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f042050d-f6d7-480d-a7a0-cdc3ae4ffeb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91ce9c85-0da7-465f-bd2e-c492e6912c6a', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:06 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-761d4b18-0dcd-4bfd-981a-3d3085087569 tempest-VolumesTestJSON-581134695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a856a9-2157-4eed-a0ac-b556e0d672f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:06 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-761d4b18-0dcd-4bfd-981a-3d3085087569 tempest-VolumesTestJSON-581134695 None] Volume volume-91ce9c85-0da7-465f-bd2e-c492e6912c6a (91ce9c85-0da7-465f-bd2e-c492e6912c6a): created successfully Nov 02 12:27:06 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-761d4b18-0dcd-4bfd-981a-3d3085087569 tempest-VolumesTestJSON-581134695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a856a9-2157-4eed-a0ac-b556e0d672f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:06 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-761d4b18-0dcd-4bfd-981a-3d3085087569 tempest-VolumesTestJSON-581134695 None] Flow 'volume_create_manager' (3213f0b4-c527-4847-8927-2ad245ff95ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:27:06 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-761d4b18-0dcd-4bfd-981a-3d3085087569 tempest-VolumesTestJSON-581134695 None] Created volume successfully. Nov 02 12:27:07 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-5406358b-8d41-49f1-98b5-001881247d9e tempest-ServerActionsTestOtherA-618205716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:27:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5406358b-8d41-49f1-98b5-001881247d9e tempest-ServerActionsTestOtherA-618205716 None] Flow 'volume_create_manager' (784d0f1d-636b-4321-b69f-e2db473ab51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:27:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5406358b-8d41-49f1-98b5-001881247d9e tempest-ServerActionsTestOtherA-618205716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ae3596-9524-4bba-8238-2d9f8cc861f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5406358b-8d41-49f1-98b5-001881247d9e tempest-ServerActionsTestOtherA-618205716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ae3596-9524-4bba-8238-2d9f8cc861f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-721652531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8233902-5c8d-4b35-99a8-43664013f760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c704877a3edb4a9281410edc16ee6bc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:27:07Z,use_quota=True,user_id='5473d145237447cabc808f954175afbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5406358b-8d41-49f1-98b5-001881247d9e tempest-ServerActionsTestOtherA-618205716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (117e069c-baee-4943-9de5-bd1d084a74e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5406358b-8d41-49f1-98b5-001881247d9e tempest-ServerActionsTestOtherA-618205716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (117e069c-baee-4943-9de5-bd1d084a74e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5406358b-8d41-49f1-98b5-001881247d9e tempest-ServerActionsTestOtherA-618205716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5059c17d-ee85-4d9a-8374-c66287eedb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5406358b-8d41-49f1-98b5-001881247d9e tempest-ServerActionsTestOtherA-618205716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5059c17d-ee85-4d9a-8374-c66287eedb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8233902-5c8d-4b35-99a8-43664013f760', 'volume_name': 'volume-d8233902-5c8d-4b35-99a8-43664013f760', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5406358b-8d41-49f1-98b5-001881247d9e tempest-ServerActionsTestOtherA-618205716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34122928-f794-4c96-ae32-d92d2cc0570a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5406358b-8d41-49f1-98b5-001881247d9e tempest-ServerActionsTestOtherA-618205716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34122928-f794-4c96-ae32-d92d2cc0570a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5406358b-8d41-49f1-98b5-001881247d9e tempest-ServerActionsTestOtherA-618205716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82a96f45-9b7c-4493-9dfd-27a90bfedb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:07 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-5406358b-8d41-49f1-98b5-001881247d9e tempest-ServerActionsTestOtherA-618205716 None] Volume d8233902-5c8d-4b35-99a8-43664013f760: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8233902-5c8d-4b35-99a8-43664013f760', 'volume_size': 1} Nov 02 12:27:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5406358b-8d41-49f1-98b5-001881247d9e tempest-ServerActionsTestOtherA-618205716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:27:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5406358b-8d41-49f1-98b5-001881247d9e tempest-ServerActionsTestOtherA-618205716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:27:07 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5406358b-8d41-49f1-98b5-001881247d9e tempest-ServerActionsTestOtherA-618205716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-721652531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8233902-5c8d-4b35-99a8-43664013f760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c704877a3edb4a9281410edc16ee6bc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:27:07Z,use_quota=True,user_id='5473d145237447cabc808f954175afbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:27:07 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-5406358b-8d41-49f1-98b5-001881247d9e tempest-ServerActionsTestOtherA-618205716 None] Creating volume d8233902-5c8d-4b35-99a8-43664013f760 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:27:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5406358b-8d41-49f1-98b5-001881247d9e tempest-ServerActionsTestOtherA-618205716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:27:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5406358b-8d41-49f1-98b5-001881247d9e tempest-ServerActionsTestOtherA-618205716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:27:07 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5406358b-8d41-49f1-98b5-001881247d9e tempest-ServerActionsTestOtherA-618205716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:27:07 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5406358b-8d41-49f1-98b5-001881247d9e tempest-ServerActionsTestOtherA-618205716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:27:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5406358b-8d41-49f1-98b5-001881247d9e tempest-ServerActionsTestOtherA-618205716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:27:07 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5406358b-8d41-49f1-98b5-001881247d9e tempest-ServerActionsTestOtherA-618205716 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:27:07 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-5406358b-8d41-49f1-98b5-001881247d9e tempest-ServerActionsTestOtherA-618205716 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:27:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5406358b-8d41-49f1-98b5-001881247d9e tempest-ServerActionsTestOtherA-618205716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d8233902-5c8d-4b35-99a8-43664013f760 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:07 devstack sudo[92037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d8233902-5c8d-4b35-99a8-43664013f760 1073741824 Nov 02 12:27:07 devstack sudo[92037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:08 devstack sudo[92037]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5406358b-8d41-49f1-98b5-001881247d9e tempest-ServerActionsTestOtherA-618205716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d8233902-5c8d-4b35-99a8-43664013f760 1073741824" returned: 0 in 0.874s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5406358b-8d41-49f1-98b5-001881247d9e tempest-ServerActionsTestOtherA-618205716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d8233902-5c8d-4b35-99a8-43664013f760 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:08 devstack sudo[92043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d8233902-5c8d-4b35-99a8-43664013f760 Nov 02 12:27:08 devstack sudo[92043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:08 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0960c63-b628-4530-8618-d48f93f1f554 tempest-VolumesTestJSON-581134695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:27:08 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d0960c63-b628-4530-8618-d48f93f1f554 tempest-VolumesTestJSON-581134695 None] Flow 'volume_create_manager' (8ad8c147-4ff5-49db-a316-f2eb2a49e3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:27:08 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d0960c63-b628-4530-8618-d48f93f1f554 tempest-VolumesTestJSON-581134695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06fb1db7-626b-4eed-b56c-39e639b21519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:08 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d0960c63-b628-4530-8618-d48f93f1f554 tempest-VolumesTestJSON-581134695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06fb1db7-626b-4eed-b56c-39e639b21519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-951883607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e110eb00-debe-4202-9ad4-822360d69070,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1fe187606ee1411196a86b5b60eaeaf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:27:09Z,use_quota=True,user_id='a238d58028cd48c2987f5b5c494d97cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:08 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d0960c63-b628-4530-8618-d48f93f1f554 tempest-VolumesTestJSON-581134695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec52ae80-7c1e-4e71-8044-5e6d38d25947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:08 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d0960c63-b628-4530-8618-d48f93f1f554 tempest-VolumesTestJSON-581134695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec52ae80-7c1e-4e71-8044-5e6d38d25947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:08 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d0960c63-b628-4530-8618-d48f93f1f554 tempest-VolumesTestJSON-581134695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28160326-3b4e-486e-88e1-fc8e765870d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:08 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d0960c63-b628-4530-8618-d48f93f1f554 tempest-VolumesTestJSON-581134695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28160326-3b4e-486e-88e1-fc8e765870d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e110eb00-debe-4202-9ad4-822360d69070', 'volume_name': 'volume-e110eb00-debe-4202-9ad4-822360d69070', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:08 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d0960c63-b628-4530-8618-d48f93f1f554 tempest-VolumesTestJSON-581134695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9d66318-2ac7-4b06-9df2-64477b0c65a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:08 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d0960c63-b628-4530-8618-d48f93f1f554 tempest-VolumesTestJSON-581134695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9d66318-2ac7-4b06-9df2-64477b0c65a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:08 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d0960c63-b628-4530-8618-d48f93f1f554 tempest-VolumesTestJSON-581134695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (354e062a-d80a-4a9d-9073-9c52a7f46b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:08 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-d0960c63-b628-4530-8618-d48f93f1f554 tempest-VolumesTestJSON-581134695 None] Volume e110eb00-debe-4202-9ad4-822360d69070: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e110eb00-debe-4202-9ad4-822360d69070', 'volume_size': 1} Nov 02 12:27:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d0960c63-b628-4530-8618-d48f93f1f554 tempest-VolumesTestJSON-581134695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:27:08 devstack sudo[92043]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5406358b-8d41-49f1-98b5-001881247d9e tempest-ServerActionsTestOtherA-618205716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d8233902-5c8d-4b35-99a8-43664013f760" returned: 0 in 0.493s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:08 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5406358b-8d41-49f1-98b5-001881247d9e tempest-ServerActionsTestOtherA-618205716 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:27:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5406358b-8d41-49f1-98b5-001881247d9e tempest-ServerActionsTestOtherA-618205716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:27:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d0960c63-b628-4530-8618-d48f93f1f554 tempest-VolumesTestJSON-581134695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.071s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:27:08 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d0960c63-b628-4530-8618-d48f93f1f554 tempest-VolumesTestJSON-581134695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-951883607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e110eb00-debe-4202-9ad4-822360d69070,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1fe187606ee1411196a86b5b60eaeaf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:27:09Z,use_quota=True,user_id='a238d58028cd48c2987f5b5c494d97cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:27:08 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-d0960c63-b628-4530-8618-d48f93f1f554 tempest-VolumesTestJSON-581134695 None] Creating volume e110eb00-debe-4202-9ad4-822360d69070 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:27:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d0960c63-b628-4530-8618-d48f93f1f554 tempest-VolumesTestJSON-581134695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:27:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d0960c63-b628-4530-8618-d48f93f1f554 tempest-VolumesTestJSON-581134695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:27:08 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d0960c63-b628-4530-8618-d48f93f1f554 tempest-VolumesTestJSON-581134695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:27:08 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d0960c63-b628-4530-8618-d48f93f1f554 tempest-VolumesTestJSON-581134695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:27:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d0960c63-b628-4530-8618-d48f93f1f554 tempest-VolumesTestJSON-581134695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:27:08 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d0960c63-b628-4530-8618-d48f93f1f554 tempest-VolumesTestJSON-581134695 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:27:08 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-d0960c63-b628-4530-8618-d48f93f1f554 tempest-VolumesTestJSON-581134695 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:27:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d0960c63-b628-4530-8618-d48f93f1f554 tempest-VolumesTestJSON-581134695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e110eb00-debe-4202-9ad4-822360d69070 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:08 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5406358b-8d41-49f1-98b5-001881247d9e tempest-ServerActionsTestOtherA-618205716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82a96f45-9b7c-4493-9dfd-27a90bfedb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8233902-5c8d-4b35-99a8-43664013f760', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:08 devstack sudo[92048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e110eb00-debe-4202-9ad4-822360d69070 1073741824 Nov 02 12:27:08 devstack sudo[92048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:08 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5406358b-8d41-49f1-98b5-001881247d9e tempest-ServerActionsTestOtherA-618205716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ff9e6a0-5cd8-46f8-bc54-0f9cf2b45c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:08 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-5406358b-8d41-49f1-98b5-001881247d9e tempest-ServerActionsTestOtherA-618205716 None] Volume volume-d8233902-5c8d-4b35-99a8-43664013f760 (d8233902-5c8d-4b35-99a8-43664013f760): created successfully Nov 02 12:27:08 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5406358b-8d41-49f1-98b5-001881247d9e tempest-ServerActionsTestOtherA-618205716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ff9e6a0-5cd8-46f8-bc54-0f9cf2b45c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:08 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5406358b-8d41-49f1-98b5-001881247d9e tempest-ServerActionsTestOtherA-618205716 None] Flow 'volume_create_manager' (784d0f1d-636b-4321-b69f-e2db473ab51b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:27:08 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-5406358b-8d41-49f1-98b5-001881247d9e tempest-ServerActionsTestOtherA-618205716 None] Created volume successfully. Nov 02 12:27:09 devstack sudo[92048]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d0960c63-b628-4530-8618-d48f93f1f554 tempest-VolumesTestJSON-581134695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e110eb00-debe-4202-9ad4-822360d69070 1073741824" returned: 0 in 0.792s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d0960c63-b628-4530-8618-d48f93f1f554 tempest-VolumesTestJSON-581134695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e110eb00-debe-4202-9ad4-822360d69070 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:09 devstack sudo[92071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e110eb00-debe-4202-9ad4-822360d69070 Nov 02 12:27:09 devstack sudo[92071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:10 devstack sudo[92071]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d0960c63-b628-4530-8618-d48f93f1f554 tempest-VolumesTestJSON-581134695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e110eb00-debe-4202-9ad4-822360d69070" returned: 0 in 0.487s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:10 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d0960c63-b628-4530-8618-d48f93f1f554 tempest-VolumesTestJSON-581134695 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:27:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d0960c63-b628-4530-8618-d48f93f1f554 tempest-VolumesTestJSON-581134695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:27:10 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d0960c63-b628-4530-8618-d48f93f1f554 tempest-VolumesTestJSON-581134695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (354e062a-d80a-4a9d-9073-9c52a7f46b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e110eb00-debe-4202-9ad4-822360d69070', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:10 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d0960c63-b628-4530-8618-d48f93f1f554 tempest-VolumesTestJSON-581134695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff36cdd5-639e-4cc4-9c2b-74033f81cea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:10 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-d0960c63-b628-4530-8618-d48f93f1f554 tempest-VolumesTestJSON-581134695 None] Volume volume-e110eb00-debe-4202-9ad4-822360d69070 (e110eb00-debe-4202-9ad4-822360d69070): created successfully Nov 02 12:27:10 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d0960c63-b628-4530-8618-d48f93f1f554 tempest-VolumesTestJSON-581134695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff36cdd5-639e-4cc4-9c2b-74033f81cea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:10 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d0960c63-b628-4530-8618-d48f93f1f554 tempest-VolumesTestJSON-581134695 None] Flow 'volume_create_manager' (8ad8c147-4ff5-49db-a316-f2eb2a49e3e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:27:10 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-d0960c63-b628-4530-8618-d48f93f1f554 tempest-VolumesTestJSON-581134695 None] Created volume successfully. Nov 02 12:27:12 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a4e6c329-4c80-4b99-9856-dc44f376648b tempest-VolumesTestJSON-581134695 None] Acquiring lock "cinder-e110eb00-debe-4202-9ad4-822360d69070-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:27:12 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a4e6c329-4c80-4b99-9856-dc44f376648b tempest-VolumesTestJSON-581134695 None] Lock "cinder-e110eb00-debe-4202-9ad4-822360d69070-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:27:12 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a4e6c329-4c80-4b99-9856-dc44f376648b tempest-VolumesTestJSON-581134695 None] Acquiring lock "cinder-quobyte-e110eb00-debe-4202-9ad4-822360d69070" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:27:12 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a4e6c329-4c80-4b99-9856-dc44f376648b tempest-VolumesTestJSON-581134695 None] Lock "cinder-quobyte-e110eb00-debe-4202-9ad4-822360d69070" acquired by "delete_volume" :: waited 0.029s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:27:12 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eff0413-725c-4567-b8e1-021986163cfc]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:27:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a4e6c329-4c80-4b99-9856-dc44f376648b tempest-VolumesTestJSON-581134695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e110eb00-debe-4202-9ad4-822360d69070 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:12 devstack sudo[92127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e110eb00-debe-4202-9ad4-822360d69070 Nov 02 12:27:12 devstack sudo[92127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:13 devstack sudo[92127]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a4e6c329-4c80-4b99-9856-dc44f376648b tempest-VolumesTestJSON-581134695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e110eb00-debe-4202-9ad4-822360d69070" returned: 0 in 0.581s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a4e6c329-4c80-4b99-9856-dc44f376648b tempest-VolumesTestJSON-581134695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e110eb00-debe-4202-9ad4-822360d69070 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:13 devstack sudo[92136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e110eb00-debe-4202-9ad4-822360d69070 Nov 02 12:27:13 devstack sudo[92136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:13 devstack sudo[92136]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a4e6c329-4c80-4b99-9856-dc44f376648b tempest-VolumesTestJSON-581134695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e110eb00-debe-4202-9ad4-822360d69070" returned: 0 in 0.460s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:13 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a4e6c329-4c80-4b99-9856-dc44f376648b tempest-VolumesTestJSON-581134695 None] Lock "cinder-quobyte-e110eb00-debe-4202-9ad4-822360d69070" released by "delete_volume" :: held 1.140s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:27:13 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-a4e6c329-4c80-4b99-9856-dc44f376648b tempest-VolumesTestJSON-581134695 None] Created reservations ['05922001-dbd1-49d9-a6b6-64babf39d726', '2be8501e-d681-4a7c-ad7e-5b14ccedbe6f', '45351495-5d2c-4392-a34a-739ee694ba0f', '59f93f2e-931e-4e22-bfcf-0b5dbaf86d56'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:27:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a4e6c329-4c80-4b99-9856-dc44f376648b tempest-VolumesTestJSON-581134695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:27:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a4e6c329-4c80-4b99-9856-dc44f376648b tempest-VolumesTestJSON-581134695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:27:14 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a4e6c329-4c80-4b99-9856-dc44f376648b tempest-VolumesTestJSON-581134695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:27:14 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a4e6c329-4c80-4b99-9856-dc44f376648b tempest-VolumesTestJSON-581134695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:27:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a4e6c329-4c80-4b99-9856-dc44f376648b tempest-VolumesTestJSON-581134695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:27:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a4e6c329-4c80-4b99-9856-dc44f376648b tempest-VolumesTestJSON-581134695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:14 devstack sudo[92139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:27:14 devstack sudo[92139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:14 devstack sudo[92139]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a4e6c329-4c80-4b99-9856-dc44f376648b tempest-VolumesTestJSON-581134695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.517s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:14 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-a4e6c329-4c80-4b99-9856-dc44f376648b tempest-VolumesTestJSON-581134695 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:27:14 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-a4e6c329-4c80-4b99-9856-dc44f376648b tempest-VolumesTestJSON-581134695 None] Deleted volume successfully. Nov 02 12:27:14 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a4e6c329-4c80-4b99-9856-dc44f376648b tempest-VolumesTestJSON-581134695 None] Lock "cinder-e110eb00-debe-4202-9ad4-822360d69070-delete_volume" released by "delete_volume" :: held 2.072s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:27:15 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-75d04b7b-2982-446a-b62c-18705f60bb25 tempest-VolumesTestJSON-581134695 None] Acquiring lock "cinder-91ce9c85-0da7-465f-bd2e-c492e6912c6a-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:27:15 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-75d04b7b-2982-446a-b62c-18705f60bb25 tempest-VolumesTestJSON-581134695 None] Lock "cinder-91ce9c85-0da7-465f-bd2e-c492e6912c6a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:27:15 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-75d04b7b-2982-446a-b62c-18705f60bb25 tempest-VolumesTestJSON-581134695 None] Acquiring lock "cinder-quobyte-91ce9c85-0da7-465f-bd2e-c492e6912c6a" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:27:15 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-75d04b7b-2982-446a-b62c-18705f60bb25 tempest-VolumesTestJSON-581134695 None] Lock "cinder-quobyte-91ce9c85-0da7-465f-bd2e-c492e6912c6a" acquired by "delete_volume" :: waited 0.056s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:27:15 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[0907fcf3-65b8-4211-8091-eda2de237c7d]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:27:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-75d04b7b-2982-446a-b62c-18705f60bb25 tempest-VolumesTestJSON-581134695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-91ce9c85-0da7-465f-bd2e-c492e6912c6a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:15 devstack sudo[92145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-91ce9c85-0da7-465f-bd2e-c492e6912c6a Nov 02 12:27:15 devstack sudo[92145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:16 devstack sudo[92145]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-75d04b7b-2982-446a-b62c-18705f60bb25 tempest-VolumesTestJSON-581134695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-91ce9c85-0da7-465f-bd2e-c492e6912c6a" returned: 0 in 0.845s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-75d04b7b-2982-446a-b62c-18705f60bb25 tempest-VolumesTestJSON-581134695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-91ce9c85-0da7-465f-bd2e-c492e6912c6a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:16 devstack sudo[92160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-91ce9c85-0da7-465f-bd2e-c492e6912c6a Nov 02 12:27:16 devstack sudo[92160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:16 devstack sudo[92160]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-75d04b7b-2982-446a-b62c-18705f60bb25 tempest-VolumesTestJSON-581134695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-91ce9c85-0da7-465f-bd2e-c492e6912c6a" returned: 0 in 0.527s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:16 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-75d04b7b-2982-446a-b62c-18705f60bb25 tempest-VolumesTestJSON-581134695 None] Lock "cinder-quobyte-91ce9c85-0da7-465f-bd2e-c492e6912c6a" released by "delete_volume" :: held 1.508s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:27:16 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-75d04b7b-2982-446a-b62c-18705f60bb25 tempest-VolumesTestJSON-581134695 None] Created reservations ['78f526b2-ee6a-4411-85a8-8f804688cfb7', '8ceb97a0-b057-42f8-a4aa-b2c887827900', '02d4abbe-d08e-4b93-a0cd-63d88aa0907b', '2469ac72-493b-4cf6-a276-5dc41e5c09b4'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:27:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-75d04b7b-2982-446a-b62c-18705f60bb25 tempest-VolumesTestJSON-581134695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:27:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-75d04b7b-2982-446a-b62c-18705f60bb25 tempest-VolumesTestJSON-581134695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:27:16 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-75d04b7b-2982-446a-b62c-18705f60bb25 tempest-VolumesTestJSON-581134695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:27:16 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-75d04b7b-2982-446a-b62c-18705f60bb25 tempest-VolumesTestJSON-581134695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:27:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-75d04b7b-2982-446a-b62c-18705f60bb25 tempest-VolumesTestJSON-581134695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:27:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-75d04b7b-2982-446a-b62c-18705f60bb25 tempest-VolumesTestJSON-581134695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:17 devstack sudo[92169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:27:17 devstack sudo[92169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:17 devstack sudo[92169]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-75d04b7b-2982-446a-b62c-18705f60bb25 tempest-VolumesTestJSON-581134695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.335s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:17 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-75d04b7b-2982-446a-b62c-18705f60bb25 tempest-VolumesTestJSON-581134695 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:27:17 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-75d04b7b-2982-446a-b62c-18705f60bb25 tempest-VolumesTestJSON-581134695 None] Deleted volume successfully. Nov 02 12:27:17 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-75d04b7b-2982-446a-b62c-18705f60bb25 tempest-VolumesTestJSON-581134695 None] Lock "cinder-91ce9c85-0da7-465f-bd2e-c492e6912c6a-delete_volume" released by "delete_volume" :: held 2.329s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:27:17 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5b3902b0-2bb3-4ad4-a7a6-c10a640acd9f tempest-VolumesTestJSON-581134695 None] Acquiring lock "cinder-66016057-6d47-4a9c-ad94-1fadc9d24615-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:27:17 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5b3902b0-2bb3-4ad4-a7a6-c10a640acd9f tempest-VolumesTestJSON-581134695 None] Lock "cinder-66016057-6d47-4a9c-ad94-1fadc9d24615-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:27:17 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5b3902b0-2bb3-4ad4-a7a6-c10a640acd9f tempest-VolumesTestJSON-581134695 None] Acquiring lock "cinder-quobyte-66016057-6d47-4a9c-ad94-1fadc9d24615" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:27:17 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5b3902b0-2bb3-4ad4-a7a6-c10a640acd9f tempest-VolumesTestJSON-581134695 None] Lock "cinder-quobyte-66016057-6d47-4a9c-ad94-1fadc9d24615" acquired by "delete_volume" :: waited 0.021s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:27:17 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc337756-7638-4946-b09d-c6c39d089a87]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:27:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5b3902b0-2bb3-4ad4-a7a6-c10a640acd9f tempest-VolumesTestJSON-581134695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-66016057-6d47-4a9c-ad94-1fadc9d24615 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:17 devstack sudo[92172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-66016057-6d47-4a9c-ad94-1fadc9d24615 Nov 02 12:27:17 devstack sudo[92172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:18 devstack sudo[92172]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5b3902b0-2bb3-4ad4-a7a6-c10a640acd9f tempest-VolumesTestJSON-581134695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-66016057-6d47-4a9c-ad94-1fadc9d24615" returned: 0 in 0.544s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5b3902b0-2bb3-4ad4-a7a6-c10a640acd9f tempest-VolumesTestJSON-581134695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-66016057-6d47-4a9c-ad94-1fadc9d24615 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:18 devstack sudo[92177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-66016057-6d47-4a9c-ad94-1fadc9d24615 Nov 02 12:27:18 devstack sudo[92177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:18 devstack sudo[92177]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5b3902b0-2bb3-4ad4-a7a6-c10a640acd9f tempest-VolumesTestJSON-581134695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-66016057-6d47-4a9c-ad94-1fadc9d24615" returned: 0 in 0.365s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:18 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5b3902b0-2bb3-4ad4-a7a6-c10a640acd9f tempest-VolumesTestJSON-581134695 None] Lock "cinder-quobyte-66016057-6d47-4a9c-ad94-1fadc9d24615" released by "delete_volume" :: held 0.969s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:27:18 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-5b3902b0-2bb3-4ad4-a7a6-c10a640acd9f tempest-VolumesTestJSON-581134695 None] Created reservations ['c9a93e6c-37f2-44c6-8368-f6f8742d6a18', '54b9a54d-1647-4df8-a4ef-bf0b6a510e60', 'dfbc7300-6c17-47a0-abd7-2cb67fbfd331', 'a423e047-4821-4979-9165-23d29c904f88'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:27:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5b3902b0-2bb3-4ad4-a7a6-c10a640acd9f tempest-VolumesTestJSON-581134695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:27:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5b3902b0-2bb3-4ad4-a7a6-c10a640acd9f tempest-VolumesTestJSON-581134695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:27:18 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5b3902b0-2bb3-4ad4-a7a6-c10a640acd9f tempest-VolumesTestJSON-581134695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:27:18 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5b3902b0-2bb3-4ad4-a7a6-c10a640acd9f tempest-VolumesTestJSON-581134695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:27:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5b3902b0-2bb3-4ad4-a7a6-c10a640acd9f tempest-VolumesTestJSON-581134695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:27:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5b3902b0-2bb3-4ad4-a7a6-c10a640acd9f tempest-VolumesTestJSON-581134695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:18 devstack sudo[92180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:27:18 devstack sudo[92180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:19 devstack sudo[92180]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5b3902b0-2bb3-4ad4-a7a6-c10a640acd9f tempest-VolumesTestJSON-581134695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.433s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:19 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-5b3902b0-2bb3-4ad4-a7a6-c10a640acd9f tempest-VolumesTestJSON-581134695 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:27:19 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-5b3902b0-2bb3-4ad4-a7a6-c10a640acd9f tempest-VolumesTestJSON-581134695 None] Deleted volume successfully. Nov 02 12:27:19 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5b3902b0-2bb3-4ad4-a7a6-c10a640acd9f tempest-VolumesTestJSON-581134695 None] Lock "cinder-66016057-6d47-4a9c-ad94-1fadc9d24615-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:27:24 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-38397555-7f07-4f23-804e-4fd629a3ad0c tempest-VolumeQuotasNegativeTestJSON-332324289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:27:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-38397555-7f07-4f23-804e-4fd629a3ad0c tempest-VolumeQuotasNegativeTestJSON-332324289 None] Flow 'volume_create_manager' (1c9ff964-0749-4b94-87e8-4c2074aa0deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:27:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-38397555-7f07-4f23-804e-4fd629a3ad0c tempest-VolumeQuotasNegativeTestJSON-332324289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30051fd7-650f-48c4-8565-7dda33ef1c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-38397555-7f07-4f23-804e-4fd629a3ad0c tempest-VolumeQuotasNegativeTestJSON-332324289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30051fd7-650f-48c4-8565-7dda33ef1c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1084184574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=564e6b60-06a9-4410-a110-65a680c7b1c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14d5c79f8de04d2e9bc253c1b2deb5ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:27:25Z,use_quota=True,user_id='0f53a6c675a4436b92d12c3248ba1fa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-38397555-7f07-4f23-804e-4fd629a3ad0c tempest-VolumeQuotasNegativeTestJSON-332324289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29d06be4-00e2-4dbf-89f9-88590b703e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-38397555-7f07-4f23-804e-4fd629a3ad0c tempest-VolumeQuotasNegativeTestJSON-332324289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29d06be4-00e2-4dbf-89f9-88590b703e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-38397555-7f07-4f23-804e-4fd629a3ad0c tempest-VolumeQuotasNegativeTestJSON-332324289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3577aab-f047-4526-bc13-2af9fd2246d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-38397555-7f07-4f23-804e-4fd629a3ad0c tempest-VolumeQuotasNegativeTestJSON-332324289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3577aab-f047-4526-bc13-2af9fd2246d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '564e6b60-06a9-4410-a110-65a680c7b1c7', 'volume_name': 'volume-564e6b60-06a9-4410-a110-65a680c7b1c7', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-38397555-7f07-4f23-804e-4fd629a3ad0c tempest-VolumeQuotasNegativeTestJSON-332324289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (761713a3-2b60-443b-8da0-0611b4a0adde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-38397555-7f07-4f23-804e-4fd629a3ad0c tempest-VolumeQuotasNegativeTestJSON-332324289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (761713a3-2b60-443b-8da0-0611b4a0adde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-38397555-7f07-4f23-804e-4fd629a3ad0c tempest-VolumeQuotasNegativeTestJSON-332324289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca004d04-ea9f-4b5f-ab57-52699739d106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:25 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-38397555-7f07-4f23-804e-4fd629a3ad0c tempest-VolumeQuotasNegativeTestJSON-332324289 None] Volume 564e6b60-06a9-4410-a110-65a680c7b1c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-564e6b60-06a9-4410-a110-65a680c7b1c7', 'volume_size': 1} Nov 02 12:27:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-38397555-7f07-4f23-804e-4fd629a3ad0c tempest-VolumeQuotasNegativeTestJSON-332324289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:27:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-38397555-7f07-4f23-804e-4fd629a3ad0c tempest-VolumeQuotasNegativeTestJSON-332324289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:27:25 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-38397555-7f07-4f23-804e-4fd629a3ad0c tempest-VolumeQuotasNegativeTestJSON-332324289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:27:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1084184574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=564e6b60-06a9-4410-a110-65a680c7b1c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14d5c79f8de04d2e9bc253c1b2deb5ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:27:25Z,use_quota=True,user_id='0f53a6c675a4436b92d12c3248ba1fa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:27:25 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-38397555-7f07-4f23-804e-4fd629a3ad0c tempest-VolumeQuotasNegativeTestJSON-332324289 None] Creating volume 564e6b60-06a9-4410-a110-65a680c7b1c7 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:27:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-38397555-7f07-4f23-804e-4fd629a3ad0c tempest-VolumeQuotasNegativeTestJSON-332324289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:27:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-38397555-7f07-4f23-804e-4fd629a3ad0c tempest-VolumeQuotasNegativeTestJSON-332324289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:27:25 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-38397555-7f07-4f23-804e-4fd629a3ad0c tempest-VolumeQuotasNegativeTestJSON-332324289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:27:25 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-38397555-7f07-4f23-804e-4fd629a3ad0c tempest-VolumeQuotasNegativeTestJSON-332324289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:27:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-38397555-7f07-4f23-804e-4fd629a3ad0c tempest-VolumeQuotasNegativeTestJSON-332324289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:27:25 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-38397555-7f07-4f23-804e-4fd629a3ad0c tempest-VolumeQuotasNegativeTestJSON-332324289 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:27:25 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-38397555-7f07-4f23-804e-4fd629a3ad0c tempest-VolumeQuotasNegativeTestJSON-332324289 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:27:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-38397555-7f07-4f23-804e-4fd629a3ad0c tempest-VolumeQuotasNegativeTestJSON-332324289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-564e6b60-06a9-4410-a110-65a680c7b1c7 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:25 devstack sudo[92241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-564e6b60-06a9-4410-a110-65a680c7b1c7 1073741824 Nov 02 12:27:25 devstack sudo[92241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:25 devstack sudo[92241]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-38397555-7f07-4f23-804e-4fd629a3ad0c tempest-VolumeQuotasNegativeTestJSON-332324289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-564e6b60-06a9-4410-a110-65a680c7b1c7 1073741824" returned: 0 in 0.619s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-38397555-7f07-4f23-804e-4fd629a3ad0c tempest-VolumeQuotasNegativeTestJSON-332324289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-564e6b60-06a9-4410-a110-65a680c7b1c7 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:25 devstack sudo[92247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-564e6b60-06a9-4410-a110-65a680c7b1c7 Nov 02 12:27:25 devstack sudo[92247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:26 devstack sudo[92247]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-38397555-7f07-4f23-804e-4fd629a3ad0c tempest-VolumeQuotasNegativeTestJSON-332324289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-564e6b60-06a9-4410-a110-65a680c7b1c7" returned: 0 in 0.473s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:26 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-38397555-7f07-4f23-804e-4fd629a3ad0c tempest-VolumeQuotasNegativeTestJSON-332324289 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:27:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-38397555-7f07-4f23-804e-4fd629a3ad0c tempest-VolumeQuotasNegativeTestJSON-332324289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:27:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-38397555-7f07-4f23-804e-4fd629a3ad0c tempest-VolumeQuotasNegativeTestJSON-332324289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca004d04-ea9f-4b5f-ab57-52699739d106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-564e6b60-06a9-4410-a110-65a680c7b1c7', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-38397555-7f07-4f23-804e-4fd629a3ad0c tempest-VolumeQuotasNegativeTestJSON-332324289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebc43712-f2f6-461c-b362-a2ac41705c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:26 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-38397555-7f07-4f23-804e-4fd629a3ad0c tempest-VolumeQuotasNegativeTestJSON-332324289 None] Volume volume-564e6b60-06a9-4410-a110-65a680c7b1c7 (564e6b60-06a9-4410-a110-65a680c7b1c7): created successfully Nov 02 12:27:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-38397555-7f07-4f23-804e-4fd629a3ad0c tempest-VolumeQuotasNegativeTestJSON-332324289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebc43712-f2f6-461c-b362-a2ac41705c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-38397555-7f07-4f23-804e-4fd629a3ad0c tempest-VolumeQuotasNegativeTestJSON-332324289 None] Flow 'volume_create_manager' (1c9ff964-0749-4b94-87e8-4c2074aa0deb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:27:26 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-38397555-7f07-4f23-804e-4fd629a3ad0c tempest-VolumeQuotasNegativeTestJSON-332324289 None] Created volume successfully. Nov 02 12:27:27 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-74cd5eb7-75e6-4270-addd-97a4c500c9aa tempest-GroupsTest-678686835 None] Group tempest-Group1-1907597200: creating Nov 02 12:27:27 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-74cd5eb7-75e6-4270-addd-97a4c500c9aa tempest-GroupsTest-678686835 None] Group tempest-Group1-1907597200: created successfully Nov 02 12:27:27 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-74cd5eb7-75e6-4270-addd-97a4c500c9aa tempest-GroupsTest-678686835 None] Create group completed successfully. Nov 02 12:27:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-6a4272ee-6564-4564-88d7-b17a328e4f33 tempest-VolumeQuotasNegativeTestJSON-332324289 None] Acquiring lock "cinder-564e6b60-06a9-4410-a110-65a680c7b1c7-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:27:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-6a4272ee-6564-4564-88d7-b17a328e4f33 tempest-VolumeQuotasNegativeTestJSON-332324289 None] Lock "cinder-564e6b60-06a9-4410-a110-65a680c7b1c7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:27:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-6a4272ee-6564-4564-88d7-b17a328e4f33 tempest-VolumeQuotasNegativeTestJSON-332324289 None] Acquiring lock "cinder-quobyte-564e6b60-06a9-4410-a110-65a680c7b1c7" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:27:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-6a4272ee-6564-4564-88d7-b17a328e4f33 tempest-VolumeQuotasNegativeTestJSON-332324289 None] Lock "cinder-quobyte-564e6b60-06a9-4410-a110-65a680c7b1c7" acquired by "delete_volume" :: waited 0.018s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:27:28 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[9457bed8-49b4-475b-95e6-cf8fb147f08b]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:27:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6a4272ee-6564-4564-88d7-b17a328e4f33 tempest-VolumeQuotasNegativeTestJSON-332324289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-564e6b60-06a9-4410-a110-65a680c7b1c7 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:28 devstack sudo[92252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-564e6b60-06a9-4410-a110-65a680c7b1c7 Nov 02 12:27:28 devstack sudo[92252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:28 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-86def5ff-0dcd-4ed8-8359-ae358d68b615 tempest-GroupsTest-678686835 None] Group tempest-Group2-1365161823: creating Nov 02 12:27:28 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-86def5ff-0dcd-4ed8-8359-ae358d68b615 tempest-GroupsTest-678686835 None] Group tempest-Group2-1365161823: created successfully Nov 02 12:27:28 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-86def5ff-0dcd-4ed8-8359-ae358d68b615 tempest-GroupsTest-678686835 None] Create group completed successfully. Nov 02 12:27:28 devstack sudo[92252]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6a4272ee-6564-4564-88d7-b17a328e4f33 tempest-VolumeQuotasNegativeTestJSON-332324289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-564e6b60-06a9-4410-a110-65a680c7b1c7" returned: 0 in 0.443s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6a4272ee-6564-4564-88d7-b17a328e4f33 tempest-VolumeQuotasNegativeTestJSON-332324289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-564e6b60-06a9-4410-a110-65a680c7b1c7 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:28 devstack sudo[92257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-564e6b60-06a9-4410-a110-65a680c7b1c7 Nov 02 12:27:28 devstack sudo[92257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:29 devstack sudo[92257]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6a4272ee-6564-4564-88d7-b17a328e4f33 tempest-VolumeQuotasNegativeTestJSON-332324289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-564e6b60-06a9-4410-a110-65a680c7b1c7" returned: 0 in 0.247s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:29 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-6a4272ee-6564-4564-88d7-b17a328e4f33 tempest-VolumeQuotasNegativeTestJSON-332324289 None] Lock "cinder-quobyte-564e6b60-06a9-4410-a110-65a680c7b1c7" released by "delete_volume" :: held 0.732s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:27:29 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-6a4272ee-6564-4564-88d7-b17a328e4f33 tempest-VolumeQuotasNegativeTestJSON-332324289 None] Created reservations ['c7e30a59-e756-4ee4-a22a-089593a5eb37', '0da69972-c1c0-43c0-8ef4-472c6ecae656', 'c4163af6-65c0-4f3f-9727-a2b8ebe549ef', '1193606a-fb60-455a-86ff-4ee81a9e46f8'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:27:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-6a4272ee-6564-4564-88d7-b17a328e4f33 tempest-VolumeQuotasNegativeTestJSON-332324289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:27:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-6a4272ee-6564-4564-88d7-b17a328e4f33 tempest-VolumeQuotasNegativeTestJSON-332324289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:27:29 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-6a4272ee-6564-4564-88d7-b17a328e4f33 tempest-VolumeQuotasNegativeTestJSON-332324289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:27:29 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-6a4272ee-6564-4564-88d7-b17a328e4f33 tempest-VolumeQuotasNegativeTestJSON-332324289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:27:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-6a4272ee-6564-4564-88d7-b17a328e4f33 tempest-VolumeQuotasNegativeTestJSON-332324289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:27:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6a4272ee-6564-4564-88d7-b17a328e4f33 tempest-VolumeQuotasNegativeTestJSON-332324289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:29 devstack sudo[92260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:27:29 devstack sudo[92260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:29 devstack sudo[92260]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6a4272ee-6564-4564-88d7-b17a328e4f33 tempest-VolumeQuotasNegativeTestJSON-332324289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.256s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:29 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-6a4272ee-6564-4564-88d7-b17a328e4f33 tempest-VolumeQuotasNegativeTestJSON-332324289 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:27:29 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-6a4272ee-6564-4564-88d7-b17a328e4f33 tempest-VolumeQuotasNegativeTestJSON-332324289 None] Deleted volume successfully. Nov 02 12:27:29 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-6a4272ee-6564-4564-88d7-b17a328e4f33 tempest-VolumeQuotasNegativeTestJSON-332324289 None] Lock "cinder-564e6b60-06a9-4410-a110-65a680c7b1c7-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:27:30 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-37136e4e-6611-418b-9ae8-163c2e4fe1ea tempest-GroupsTest-678686835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:27:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-37136e4e-6611-418b-9ae8-163c2e4fe1ea tempest-GroupsTest-678686835 None] Flow 'volume_create_manager' (823c74f9-9c1b-4408-a5a3-9b61ffcf98c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:27:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-37136e4e-6611-418b-9ae8-163c2e4fe1ea tempest-GroupsTest-678686835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb78705-6d8a-4f80-9875-d271643879e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-37136e4e-6611-418b-9ae8-163c2e4fe1ea tempest-GroupsTest-678686835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb78705-6d8a-4f80-9875-d271643879e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-622053933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8787574c-cb25-4879-867d-2b53ff62a5f5,host='devstack@QuobyteHD#QuobyteHD',id=69edcdef-dd9c-4e86-ba43-d4188f299969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f385aeb79d463093f2b7f18e1c870a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:27:30Z,use_quota=True,user_id='ca92e0125c334579b5942b662516de8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0102975c-a28c-4abe-88bf-93552ed680da),volume_type_id=0102975c-a28c-4abe-88bf-93552ed680da)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-37136e4e-6611-418b-9ae8-163c2e4fe1ea tempest-GroupsTest-678686835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c7fe6ce-d314-4002-8d6c-05bfa51e83e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-37136e4e-6611-418b-9ae8-163c2e4fe1ea tempest-GroupsTest-678686835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c7fe6ce-d314-4002-8d6c-05bfa51e83e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-37136e4e-6611-418b-9ae8-163c2e4fe1ea tempest-GroupsTest-678686835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (858ea559-241e-46d6-b07e-0a5f3cb8dc54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-37136e4e-6611-418b-9ae8-163c2e4fe1ea tempest-GroupsTest-678686835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (858ea559-241e-46d6-b07e-0a5f3cb8dc54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69edcdef-dd9c-4e86-ba43-d4188f299969', 'volume_name': 'volume-69edcdef-dd9c-4e86-ba43-d4188f299969', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-37136e4e-6611-418b-9ae8-163c2e4fe1ea tempest-GroupsTest-678686835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (225c270b-d170-4e1d-ae66-236d609eecef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-37136e4e-6611-418b-9ae8-163c2e4fe1ea tempest-GroupsTest-678686835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (225c270b-d170-4e1d-ae66-236d609eecef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-37136e4e-6611-418b-9ae8-163c2e4fe1ea tempest-GroupsTest-678686835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7cda99f-acab-44cc-92d7-cab6f9a45b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:30 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-37136e4e-6611-418b-9ae8-163c2e4fe1ea tempest-GroupsTest-678686835 None] Volume 69edcdef-dd9c-4e86-ba43-d4188f299969: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69edcdef-dd9c-4e86-ba43-d4188f299969', 'volume_size': 1} Nov 02 12:27:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-37136e4e-6611-418b-9ae8-163c2e4fe1ea tempest-GroupsTest-678686835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:27:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-37136e4e-6611-418b-9ae8-163c2e4fe1ea tempest-GroupsTest-678686835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:27:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-37136e4e-6611-418b-9ae8-163c2e4fe1ea tempest-GroupsTest-678686835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8787574c-cb25-4879-867d-2b53ff62a5f5,created_at=2026-11-02T11:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-622053933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8787574c-cb25-4879-867d-2b53ff62a5f5,host='devstack@QuobyteHD#QuobyteHD',id=69edcdef-dd9c-4e86-ba43-d4188f299969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f385aeb79d463093f2b7f18e1c870a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:27:30Z,use_quota=True,user_id='ca92e0125c334579b5942b662516de8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0102975c-a28c-4abe-88bf-93552ed680da),volume_type_id=0102975c-a28c-4abe-88bf-93552ed680da)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:27:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-37136e4e-6611-418b-9ae8-163c2e4fe1ea tempest-GroupsTest-678686835 None] Creating volume 69edcdef-dd9c-4e86-ba43-d4188f299969 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:27:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-37136e4e-6611-418b-9ae8-163c2e4fe1ea tempest-GroupsTest-678686835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:27:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-37136e4e-6611-418b-9ae8-163c2e4fe1ea tempest-GroupsTest-678686835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:27:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-37136e4e-6611-418b-9ae8-163c2e4fe1ea tempest-GroupsTest-678686835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:27:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-37136e4e-6611-418b-9ae8-163c2e4fe1ea tempest-GroupsTest-678686835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:27:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-37136e4e-6611-418b-9ae8-163c2e4fe1ea tempest-GroupsTest-678686835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:27:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-37136e4e-6611-418b-9ae8-163c2e4fe1ea tempest-GroupsTest-678686835 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:27:30 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-37136e4e-6611-418b-9ae8-163c2e4fe1ea tempest-GroupsTest-678686835 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:27:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-37136e4e-6611-418b-9ae8-163c2e4fe1ea tempest-GroupsTest-678686835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-69edcdef-dd9c-4e86-ba43-d4188f299969 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:30 devstack sudo[92263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-69edcdef-dd9c-4e86-ba43-d4188f299969 1073741824 Nov 02 12:27:30 devstack sudo[92263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:31 devstack sudo[92263]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-37136e4e-6611-418b-9ae8-163c2e4fe1ea tempest-GroupsTest-678686835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-69edcdef-dd9c-4e86-ba43-d4188f299969 1073741824" returned: 0 in 0.521s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-37136e4e-6611-418b-9ae8-163c2e4fe1ea tempest-GroupsTest-678686835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-69edcdef-dd9c-4e86-ba43-d4188f299969 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:31 devstack sudo[92269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-69edcdef-dd9c-4e86-ba43-d4188f299969 Nov 02 12:27:31 devstack sudo[92269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:31 devstack sudo[92269]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-37136e4e-6611-418b-9ae8-163c2e4fe1ea tempest-GroupsTest-678686835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-69edcdef-dd9c-4e86-ba43-d4188f299969" returned: 0 in 0.290s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:31 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-37136e4e-6611-418b-9ae8-163c2e4fe1ea tempest-GroupsTest-678686835 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:27:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-37136e4e-6611-418b-9ae8-163c2e4fe1ea tempest-GroupsTest-678686835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:27:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-37136e4e-6611-418b-9ae8-163c2e4fe1ea tempest-GroupsTest-678686835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7cda99f-acab-44cc-92d7-cab6f9a45b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69edcdef-dd9c-4e86-ba43-d4188f299969', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-37136e4e-6611-418b-9ae8-163c2e4fe1ea tempest-GroupsTest-678686835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a5b4bde-9c1b-47a6-a492-607366c27aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:31 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-37136e4e-6611-418b-9ae8-163c2e4fe1ea tempest-GroupsTest-678686835 None] Volume volume-69edcdef-dd9c-4e86-ba43-d4188f299969 (69edcdef-dd9c-4e86-ba43-d4188f299969): created successfully Nov 02 12:27:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-37136e4e-6611-418b-9ae8-163c2e4fe1ea tempest-GroupsTest-678686835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a5b4bde-9c1b-47a6-a492-607366c27aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-37136e4e-6611-418b-9ae8-163c2e4fe1ea tempest-GroupsTest-678686835 None] Flow 'volume_create_manager' (823c74f9-9c1b-4408-a5a3-9b61ffcf98c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:27:31 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-37136e4e-6611-418b-9ae8-163c2e4fe1ea tempest-GroupsTest-678686835 None] Created volume successfully. Nov 02 12:27:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-1170017b-e266-4c2b-b03d-30caa0c01347 tempest-GroupsTest-678686835 None] Acquiring lock "cinder-quobyte-69edcdef-dd9c-4e86-ba43-d4188f299969" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:27:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-1170017b-e266-4c2b-b03d-30caa0c01347 tempest-GroupsTest-678686835 None] Lock "cinder-quobyte-69edcdef-dd9c-4e86-ba43-d4188f299969" acquired by "delete_volume" :: waited 0.050s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:27:33 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed92967-285d-462a-b6c7-8a25ec9ab0ef]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:27:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1170017b-e266-4c2b-b03d-30caa0c01347 tempest-GroupsTest-678686835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-69edcdef-dd9c-4e86-ba43-d4188f299969 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:33 devstack sudo[92278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-69edcdef-dd9c-4e86-ba43-d4188f299969 Nov 02 12:27:33 devstack sudo[92278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:33 devstack sudo[92278]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1170017b-e266-4c2b-b03d-30caa0c01347 tempest-GroupsTest-678686835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-69edcdef-dd9c-4e86-ba43-d4188f299969" returned: 0 in 0.761s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1170017b-e266-4c2b-b03d-30caa0c01347 tempest-GroupsTest-678686835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-69edcdef-dd9c-4e86-ba43-d4188f299969 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:33 devstack sudo[92312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-69edcdef-dd9c-4e86-ba43-d4188f299969 Nov 02 12:27:33 devstack sudo[92312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:34 devstack sudo[92312]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1170017b-e266-4c2b-b03d-30caa0c01347 tempest-GroupsTest-678686835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-69edcdef-dd9c-4e86-ba43-d4188f299969" returned: 0 in 0.518s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:34 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-1170017b-e266-4c2b-b03d-30caa0c01347 tempest-GroupsTest-678686835 None] Lock "cinder-quobyte-69edcdef-dd9c-4e86-ba43-d4188f299969" released by "delete_volume" :: held 1.430s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:27:34 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-1170017b-e266-4c2b-b03d-30caa0c01347 tempest-GroupsTest-678686835 None] Created reservations ['8ffc1f06-11b3-4ff6-a48b-b4657c0de775'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:27:34 devstack cinder-volume[86515]: WARNING cinder.quota [None req-1170017b-e266-4c2b-b03d-30caa0c01347 tempest-GroupsTest-678686835 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-747086000 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-747086000, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:27:34 devstack cinder-volume[86515]: WARNING cinder.quota [None req-1170017b-e266-4c2b-b03d-30caa0c01347 tempest-GroupsTest-678686835 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-747086000 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-747086000, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:27:34 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-1170017b-e266-4c2b-b03d-30caa0c01347 tempest-GroupsTest-678686835 None] Created reservations ['316e72b5-cac2-40c1-90c8-667c77f11846', '9f47c2bd-0eb1-4b27-9c5d-253192e0dc8e', 'd0ee6aee-7e78-4543-af5b-c070cf239303', '5b7f88a2-796d-4bcf-a553-8aa037457b49'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:27:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1170017b-e266-4c2b-b03d-30caa0c01347 tempest-GroupsTest-678686835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:27:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1170017b-e266-4c2b-b03d-30caa0c01347 tempest-GroupsTest-678686835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:27:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-1170017b-e266-4c2b-b03d-30caa0c01347 tempest-GroupsTest-678686835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:27:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-1170017b-e266-4c2b-b03d-30caa0c01347 tempest-GroupsTest-678686835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:27:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1170017b-e266-4c2b-b03d-30caa0c01347 tempest-GroupsTest-678686835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:27:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1170017b-e266-4c2b-b03d-30caa0c01347 tempest-GroupsTest-678686835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:34 devstack sudo[92317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:27:34 devstack sudo[92317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:35 devstack sudo[92317]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1170017b-e266-4c2b-b03d-30caa0c01347 tempest-GroupsTest-678686835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.304s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:35 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-1170017b-e266-4c2b-b03d-30caa0c01347 tempest-GroupsTest-678686835 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:27:35 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-1170017b-e266-4c2b-b03d-30caa0c01347 tempest-GroupsTest-678686835 None] Delete group completed successfully. Nov 02 12:27:35 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-6a2e9478-1558-43b9-b2b1-0848cbbf38c0 tempest-GroupsTest-678686835 None] Created reservations ['27eec389-48d8-4737-b8eb-f9048d59a306'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:27:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-6a2e9478-1558-43b9-b2b1-0848cbbf38c0 tempest-GroupsTest-678686835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:27:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-6a2e9478-1558-43b9-b2b1-0848cbbf38c0 tempest-GroupsTest-678686835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:27:35 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-6a2e9478-1558-43b9-b2b1-0848cbbf38c0 tempest-GroupsTest-678686835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:27:35 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-6a2e9478-1558-43b9-b2b1-0848cbbf38c0 tempest-GroupsTest-678686835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:27:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-6a2e9478-1558-43b9-b2b1-0848cbbf38c0 tempest-GroupsTest-678686835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:27:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6a2e9478-1558-43b9-b2b1-0848cbbf38c0 tempest-GroupsTest-678686835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:35 devstack sudo[92322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:27:35 devstack sudo[92322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:36 devstack sudo[92322]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6a2e9478-1558-43b9-b2b1-0848cbbf38c0 tempest-GroupsTest-678686835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.305s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:36 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-6a2e9478-1558-43b9-b2b1-0848cbbf38c0 tempest-GroupsTest-678686835 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:27:36 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-6a2e9478-1558-43b9-b2b1-0848cbbf38c0 tempest-GroupsTest-678686835 None] Delete group completed successfully. Nov 02 12:27:36 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-02483955-87a5-472a-af54-faf599a55218 tempest-AttachVolumeTestJSON-1055770325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:27:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-02483955-87a5-472a-af54-faf599a55218 tempest-AttachVolumeTestJSON-1055770325 None] Flow 'volume_create_manager' (1ec6449b-0904-4eb9-809b-7795728aa579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:27:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-02483955-87a5-472a-af54-faf599a55218 tempest-AttachVolumeTestJSON-1055770325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bed93f5-b52c-4ad2-b259-907dd01c4dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-02483955-87a5-472a-af54-faf599a55218 tempest-AttachVolumeTestJSON-1055770325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bed93f5-b52c-4ad2-b259-907dd01c4dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1553814950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39bfbc6e-2473-4123-9ced-5764063e4b05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e2d019c95d40b883211901089255b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:27:37Z,use_quota=True,user_id='a3e91acddbd14ee5b9ad6eec12e35a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-02483955-87a5-472a-af54-faf599a55218 tempest-AttachVolumeTestJSON-1055770325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f03fac1d-8773-4709-9fb2-8dc0d0e6d3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-02483955-87a5-472a-af54-faf599a55218 tempest-AttachVolumeTestJSON-1055770325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f03fac1d-8773-4709-9fb2-8dc0d0e6d3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-02483955-87a5-472a-af54-faf599a55218 tempest-AttachVolumeTestJSON-1055770325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fceca5ea-0061-4f11-a0e1-c0f6b94b51af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-02483955-87a5-472a-af54-faf599a55218 tempest-AttachVolumeTestJSON-1055770325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fceca5ea-0061-4f11-a0e1-c0f6b94b51af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39bfbc6e-2473-4123-9ced-5764063e4b05', 'volume_name': 'volume-39bfbc6e-2473-4123-9ced-5764063e4b05', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-02483955-87a5-472a-af54-faf599a55218 tempest-AttachVolumeTestJSON-1055770325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19ff2c5b-d5af-4d54-8f60-38da21b49f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-02483955-87a5-472a-af54-faf599a55218 tempest-AttachVolumeTestJSON-1055770325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19ff2c5b-d5af-4d54-8f60-38da21b49f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-02483955-87a5-472a-af54-faf599a55218 tempest-AttachVolumeTestJSON-1055770325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d70cece3-399a-475a-b14d-a67fe6a27420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:36 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-02483955-87a5-472a-af54-faf599a55218 tempest-AttachVolumeTestJSON-1055770325 None] Volume 39bfbc6e-2473-4123-9ced-5764063e4b05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39bfbc6e-2473-4123-9ced-5764063e4b05', 'volume_size': 1} Nov 02 12:27:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-02483955-87a5-472a-af54-faf599a55218 tempest-AttachVolumeTestJSON-1055770325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:27:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-02483955-87a5-472a-af54-faf599a55218 tempest-AttachVolumeTestJSON-1055770325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:27:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-02483955-87a5-472a-af54-faf599a55218 tempest-AttachVolumeTestJSON-1055770325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1553814950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39bfbc6e-2473-4123-9ced-5764063e4b05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e2d019c95d40b883211901089255b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:27:37Z,use_quota=True,user_id='a3e91acddbd14ee5b9ad6eec12e35a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:27:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-02483955-87a5-472a-af54-faf599a55218 tempest-AttachVolumeTestJSON-1055770325 None] Creating volume 39bfbc6e-2473-4123-9ced-5764063e4b05 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:27:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-02483955-87a5-472a-af54-faf599a55218 tempest-AttachVolumeTestJSON-1055770325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:27:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-02483955-87a5-472a-af54-faf599a55218 tempest-AttachVolumeTestJSON-1055770325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:27:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-02483955-87a5-472a-af54-faf599a55218 tempest-AttachVolumeTestJSON-1055770325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:27:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-02483955-87a5-472a-af54-faf599a55218 tempest-AttachVolumeTestJSON-1055770325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:27:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-02483955-87a5-472a-af54-faf599a55218 tempest-AttachVolumeTestJSON-1055770325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:27:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-02483955-87a5-472a-af54-faf599a55218 tempest-AttachVolumeTestJSON-1055770325 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:27:36 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-02483955-87a5-472a-af54-faf599a55218 tempest-AttachVolumeTestJSON-1055770325 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:27:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-02483955-87a5-472a-af54-faf599a55218 tempest-AttachVolumeTestJSON-1055770325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39bfbc6e-2473-4123-9ced-5764063e4b05 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:36 devstack sudo[92345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39bfbc6e-2473-4123-9ced-5764063e4b05 1073741824 Nov 02 12:27:36 devstack sudo[92345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:37 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-84f710c0-8bd2-4f7b-ba58-dc0b98cd70b5 tempest-GroupsTest-678686835 None] Group tempest-GroupsTest-Group-1137443834: creating Nov 02 12:27:37 devstack sudo[92345]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-02483955-87a5-472a-af54-faf599a55218 tempest-AttachVolumeTestJSON-1055770325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39bfbc6e-2473-4123-9ced-5764063e4b05 1073741824" returned: 0 in 0.641s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:37 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-84f710c0-8bd2-4f7b-ba58-dc0b98cd70b5 tempest-GroupsTest-678686835 None] Group tempest-GroupsTest-Group-1137443834: created successfully Nov 02 12:27:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-02483955-87a5-472a-af54-faf599a55218 tempest-AttachVolumeTestJSON-1055770325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39bfbc6e-2473-4123-9ced-5764063e4b05 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:37 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-84f710c0-8bd2-4f7b-ba58-dc0b98cd70b5 tempest-GroupsTest-678686835 None] Create group completed successfully. Nov 02 12:27:37 devstack sudo[92351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39bfbc6e-2473-4123-9ced-5764063e4b05 Nov 02 12:27:37 devstack sudo[92351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:37 devstack sudo[92351]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-02483955-87a5-472a-af54-faf599a55218 tempest-AttachVolumeTestJSON-1055770325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39bfbc6e-2473-4123-9ced-5764063e4b05" returned: 0 in 0.260s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:37 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-02483955-87a5-472a-af54-faf599a55218 tempest-AttachVolumeTestJSON-1055770325 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:27:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-02483955-87a5-472a-af54-faf599a55218 tempest-AttachVolumeTestJSON-1055770325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:27:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-02483955-87a5-472a-af54-faf599a55218 tempest-AttachVolumeTestJSON-1055770325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d70cece3-399a-475a-b14d-a67fe6a27420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39bfbc6e-2473-4123-9ced-5764063e4b05', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-02483955-87a5-472a-af54-faf599a55218 tempest-AttachVolumeTestJSON-1055770325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eedd8cc6-5ebb-46db-abe4-8129718a5d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:37 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-02483955-87a5-472a-af54-faf599a55218 tempest-AttachVolumeTestJSON-1055770325 None] Volume volume-39bfbc6e-2473-4123-9ced-5764063e4b05 (39bfbc6e-2473-4123-9ced-5764063e4b05): created successfully Nov 02 12:27:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-02483955-87a5-472a-af54-faf599a55218 tempest-AttachVolumeTestJSON-1055770325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eedd8cc6-5ebb-46db-abe4-8129718a5d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-02483955-87a5-472a-af54-faf599a55218 tempest-AttachVolumeTestJSON-1055770325 None] Flow 'volume_create_manager' (1ec6449b-0904-4eb9-809b-7795728aa579) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:27:37 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-02483955-87a5-472a-af54-faf599a55218 tempest-AttachVolumeTestJSON-1055770325 None] Created volume successfully. Nov 02 12:27:38 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-330e6987-8535-4ca1-9c00-a55e753ee8f7 tempest-VolumesServicesTestJSON-1446509925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:27:38 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-330e6987-8535-4ca1-9c00-a55e753ee8f7 tempest-VolumesServicesTestJSON-1446509925 None] Flow 'volume_create_manager' (ce02dfe9-a19d-4fa3-87b7-77b50f6899b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:27:38 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-330e6987-8535-4ca1-9c00-a55e753ee8f7 tempest-VolumesServicesTestJSON-1446509925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949ce4fc-8009-410c-a470-d38e64ef12fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:38 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-330e6987-8535-4ca1-9c00-a55e753ee8f7 tempest-VolumesServicesTestJSON-1446509925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949ce4fc-8009-410c-a470-d38e64ef12fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-437894589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10194af2-28ad-4c38-a3d4-daac778b17aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='034f2750e06b44919f571d9affcc5b5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:27:38Z,use_quota=True,user_id='998d6bb06c704d7bae7728fdba37df8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:38 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-330e6987-8535-4ca1-9c00-a55e753ee8f7 tempest-VolumesServicesTestJSON-1446509925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac0e93fd-9c37-4c7d-84cf-df82a7d98d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:38 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-330e6987-8535-4ca1-9c00-a55e753ee8f7 tempest-VolumesServicesTestJSON-1446509925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac0e93fd-9c37-4c7d-84cf-df82a7d98d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:38 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-330e6987-8535-4ca1-9c00-a55e753ee8f7 tempest-VolumesServicesTestJSON-1446509925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c52cef1-5153-4989-97f2-970e070bf3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:38 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-330e6987-8535-4ca1-9c00-a55e753ee8f7 tempest-VolumesServicesTestJSON-1446509925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c52cef1-5153-4989-97f2-970e070bf3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10194af2-28ad-4c38-a3d4-daac778b17aa', 'volume_name': 'volume-10194af2-28ad-4c38-a3d4-daac778b17aa', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:38 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-330e6987-8535-4ca1-9c00-a55e753ee8f7 tempest-VolumesServicesTestJSON-1446509925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541b2118-ad6a-408d-a000-cc1f7901a932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:38 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-330e6987-8535-4ca1-9c00-a55e753ee8f7 tempest-VolumesServicesTestJSON-1446509925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541b2118-ad6a-408d-a000-cc1f7901a932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:38 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-330e6987-8535-4ca1-9c00-a55e753ee8f7 tempest-VolumesServicesTestJSON-1446509925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (283e7f08-03fe-40bc-ae20-f9d4690f657c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:38 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-330e6987-8535-4ca1-9c00-a55e753ee8f7 tempest-VolumesServicesTestJSON-1446509925 None] Volume 10194af2-28ad-4c38-a3d4-daac778b17aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10194af2-28ad-4c38-a3d4-daac778b17aa', 'volume_size': 1} Nov 02 12:27:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-330e6987-8535-4ca1-9c00-a55e753ee8f7 tempest-VolumesServicesTestJSON-1446509925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:27:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-330e6987-8535-4ca1-9c00-a55e753ee8f7 tempest-VolumesServicesTestJSON-1446509925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:27:38 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-330e6987-8535-4ca1-9c00-a55e753ee8f7 tempest-VolumesServicesTestJSON-1446509925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-437894589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10194af2-28ad-4c38-a3d4-daac778b17aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='034f2750e06b44919f571d9affcc5b5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:27:38Z,use_quota=True,user_id='998d6bb06c704d7bae7728fdba37df8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:27:38 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-330e6987-8535-4ca1-9c00-a55e753ee8f7 tempest-VolumesServicesTestJSON-1446509925 None] Creating volume 10194af2-28ad-4c38-a3d4-daac778b17aa {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:27:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-330e6987-8535-4ca1-9c00-a55e753ee8f7 tempest-VolumesServicesTestJSON-1446509925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:27:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-330e6987-8535-4ca1-9c00-a55e753ee8f7 tempest-VolumesServicesTestJSON-1446509925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:27:38 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-330e6987-8535-4ca1-9c00-a55e753ee8f7 tempest-VolumesServicesTestJSON-1446509925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:27:38 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-330e6987-8535-4ca1-9c00-a55e753ee8f7 tempest-VolumesServicesTestJSON-1446509925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:27:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-330e6987-8535-4ca1-9c00-a55e753ee8f7 tempest-VolumesServicesTestJSON-1446509925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:27:38 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-330e6987-8535-4ca1-9c00-a55e753ee8f7 tempest-VolumesServicesTestJSON-1446509925 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:27:38 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-330e6987-8535-4ca1-9c00-a55e753ee8f7 tempest-VolumesServicesTestJSON-1446509925 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:27:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-330e6987-8535-4ca1-9c00-a55e753ee8f7 tempest-VolumesServicesTestJSON-1446509925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-10194af2-28ad-4c38-a3d4-daac778b17aa 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:38 devstack sudo[92354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-10194af2-28ad-4c38-a3d4-daac778b17aa 1073741824 Nov 02 12:27:38 devstack sudo[92354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:38 devstack sudo[92354]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-330e6987-8535-4ca1-9c00-a55e753ee8f7 tempest-VolumesServicesTestJSON-1446509925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-10194af2-28ad-4c38-a3d4-daac778b17aa 1073741824" returned: 0 in 0.436s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-330e6987-8535-4ca1-9c00-a55e753ee8f7 tempest-VolumesServicesTestJSON-1446509925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-10194af2-28ad-4c38-a3d4-daac778b17aa {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:38 devstack sudo[92360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-10194af2-28ad-4c38-a3d4-daac778b17aa Nov 02 12:27:38 devstack sudo[92360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:38 devstack sudo[92360]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-330e6987-8535-4ca1-9c00-a55e753ee8f7 tempest-VolumesServicesTestJSON-1446509925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-10194af2-28ad-4c38-a3d4-daac778b17aa" returned: 0 in 0.358s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:38 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-330e6987-8535-4ca1-9c00-a55e753ee8f7 tempest-VolumesServicesTestJSON-1446509925 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:27:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-330e6987-8535-4ca1-9c00-a55e753ee8f7 tempest-VolumesServicesTestJSON-1446509925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:27:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-330e6987-8535-4ca1-9c00-a55e753ee8f7 tempest-VolumesServicesTestJSON-1446509925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (283e7f08-03fe-40bc-ae20-f9d4690f657c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10194af2-28ad-4c38-a3d4-daac778b17aa', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-330e6987-8535-4ca1-9c00-a55e753ee8f7 tempest-VolumesServicesTestJSON-1446509925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cbd2480-62ff-40e9-9cb9-404832df117e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:39 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-330e6987-8535-4ca1-9c00-a55e753ee8f7 tempest-VolumesServicesTestJSON-1446509925 None] Volume volume-10194af2-28ad-4c38-a3d4-daac778b17aa (10194af2-28ad-4c38-a3d4-daac778b17aa): created successfully Nov 02 12:27:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-330e6987-8535-4ca1-9c00-a55e753ee8f7 tempest-VolumesServicesTestJSON-1446509925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cbd2480-62ff-40e9-9cb9-404832df117e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-330e6987-8535-4ca1-9c00-a55e753ee8f7 tempest-VolumesServicesTestJSON-1446509925 None] Flow 'volume_create_manager' (ce02dfe9-a19d-4fa3-87b7-77b50f6899b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:27:39 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-330e6987-8535-4ca1-9c00-a55e753ee8f7 tempest-VolumesServicesTestJSON-1446509925 None] Created volume successfully. Nov 02 12:27:39 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-068f9a09-281d-4d5e-a5f3-1ffe3dd7a052 tempest-GroupsTest-678686835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:27:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-068f9a09-281d-4d5e-a5f3-1ffe3dd7a052 tempest-GroupsTest-678686835 None] Flow 'volume_create_manager' (d07a4c1a-dcb8-4a99-8558-e2975b71f832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:27:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-068f9a09-281d-4d5e-a5f3-1ffe3dd7a052 tempest-GroupsTest-678686835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (864de849-4046-43ae-bcc8-99df68748af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-068f9a09-281d-4d5e-a5f3-1ffe3dd7a052 tempest-GroupsTest-678686835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (864de849-4046-43ae-bcc8-99df68748af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1676707455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=657fbb6d-bf85-4751-9e74-7b5083828219,host='devstack@QuobyteHD#QuobyteHD',id=fdf0c5d0-0b15-4255-887c-e47b3522edb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f385aeb79d463093f2b7f18e1c870a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:27:39Z,use_quota=True,user_id='ca92e0125c334579b5942b662516de8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab3d6a1e-dfdc-4340-8c97-5a74462aa985),volume_type_id=ab3d6a1e-dfdc-4340-8c97-5a74462aa985)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-068f9a09-281d-4d5e-a5f3-1ffe3dd7a052 tempest-GroupsTest-678686835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4a45be0-ec14-4d98-8fbc-63660e4e8a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-068f9a09-281d-4d5e-a5f3-1ffe3dd7a052 tempest-GroupsTest-678686835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4a45be0-ec14-4d98-8fbc-63660e4e8a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-068f9a09-281d-4d5e-a5f3-1ffe3dd7a052 tempest-GroupsTest-678686835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd2a5840-353c-4aeb-9174-1945f5736f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-068f9a09-281d-4d5e-a5f3-1ffe3dd7a052 tempest-GroupsTest-678686835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd2a5840-353c-4aeb-9174-1945f5736f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdf0c5d0-0b15-4255-887c-e47b3522edb4', 'volume_name': 'volume-fdf0c5d0-0b15-4255-887c-e47b3522edb4', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-068f9a09-281d-4d5e-a5f3-1ffe3dd7a052 tempest-GroupsTest-678686835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4cabaeb-367f-4f66-9f98-7a67cf1c8874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-068f9a09-281d-4d5e-a5f3-1ffe3dd7a052 tempest-GroupsTest-678686835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4cabaeb-367f-4f66-9f98-7a67cf1c8874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-068f9a09-281d-4d5e-a5f3-1ffe3dd7a052 tempest-GroupsTest-678686835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2662d8ea-626c-45e4-b15c-47a754f155b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:39 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-068f9a09-281d-4d5e-a5f3-1ffe3dd7a052 tempest-GroupsTest-678686835 None] Volume fdf0c5d0-0b15-4255-887c-e47b3522edb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdf0c5d0-0b15-4255-887c-e47b3522edb4', 'volume_size': 1} Nov 02 12:27:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-068f9a09-281d-4d5e-a5f3-1ffe3dd7a052 tempest-GroupsTest-678686835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:27:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-068f9a09-281d-4d5e-a5f3-1ffe3dd7a052 tempest-GroupsTest-678686835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:27:39 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-068f9a09-281d-4d5e-a5f3-1ffe3dd7a052 tempest-GroupsTest-678686835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=657fbb6d-bf85-4751-9e74-7b5083828219,created_at=2026-11-02T11:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1676707455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=657fbb6d-bf85-4751-9e74-7b5083828219,host='devstack@QuobyteHD#QuobyteHD',id=fdf0c5d0-0b15-4255-887c-e47b3522edb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f385aeb79d463093f2b7f18e1c870a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:27:39Z,use_quota=True,user_id='ca92e0125c334579b5942b662516de8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab3d6a1e-dfdc-4340-8c97-5a74462aa985),volume_type_id=ab3d6a1e-dfdc-4340-8c97-5a74462aa985)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:27:39 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-068f9a09-281d-4d5e-a5f3-1ffe3dd7a052 tempest-GroupsTest-678686835 None] Creating volume fdf0c5d0-0b15-4255-887c-e47b3522edb4 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:27:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-068f9a09-281d-4d5e-a5f3-1ffe3dd7a052 tempest-GroupsTest-678686835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:27:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-068f9a09-281d-4d5e-a5f3-1ffe3dd7a052 tempest-GroupsTest-678686835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:27:39 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-068f9a09-281d-4d5e-a5f3-1ffe3dd7a052 tempest-GroupsTest-678686835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:27:39 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-068f9a09-281d-4d5e-a5f3-1ffe3dd7a052 tempest-GroupsTest-678686835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:27:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-068f9a09-281d-4d5e-a5f3-1ffe3dd7a052 tempest-GroupsTest-678686835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:27:39 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-068f9a09-281d-4d5e-a5f3-1ffe3dd7a052 tempest-GroupsTest-678686835 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:27:39 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-068f9a09-281d-4d5e-a5f3-1ffe3dd7a052 tempest-GroupsTest-678686835 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:27:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-068f9a09-281d-4d5e-a5f3-1ffe3dd7a052 tempest-GroupsTest-678686835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-fdf0c5d0-0b15-4255-887c-e47b3522edb4 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:39 devstack sudo[92368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-fdf0c5d0-0b15-4255-887c-e47b3522edb4 1073741824 Nov 02 12:27:39 devstack sudo[92368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-b1b1c46e-f2fe-43c5-8f07-8218e543d70b req-abbdf977-8496-496a-a1bc-00a041f68150 tempest-AttachVolumeTestJSON-1055770325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:27:39 devstack sudo[92368]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-068f9a09-281d-4d5e-a5f3-1ffe3dd7a052 tempest-GroupsTest-678686835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-fdf0c5d0-0b15-4255-887c-e47b3522edb4 1073741824" returned: 0 in 0.478s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-068f9a09-281d-4d5e-a5f3-1ffe3dd7a052 tempest-GroupsTest-678686835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-fdf0c5d0-0b15-4255-887c-e47b3522edb4 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:39 devstack sudo[92382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-fdf0c5d0-0b15-4255-887c-e47b3522edb4 Nov 02 12:27:39 devstack sudo[92382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:40 devstack sudo[92382]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-068f9a09-281d-4d5e-a5f3-1ffe3dd7a052 tempest-GroupsTest-678686835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-fdf0c5d0-0b15-4255-887c-e47b3522edb4" returned: 0 in 0.289s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:40 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-068f9a09-281d-4d5e-a5f3-1ffe3dd7a052 tempest-GroupsTest-678686835 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:27:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-068f9a09-281d-4d5e-a5f3-1ffe3dd7a052 tempest-GroupsTest-678686835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:27:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-b1b1c46e-f2fe-43c5-8f07-8218e543d70b req-abbdf977-8496-496a-a1bc-00a041f68150 tempest-AttachVolumeTestJSON-1055770325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.517s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:27:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-068f9a09-281d-4d5e-a5f3-1ffe3dd7a052 tempest-GroupsTest-678686835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2662d8ea-626c-45e4-b15c-47a754f155b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdf0c5d0-0b15-4255-887c-e47b3522edb4', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-068f9a09-281d-4d5e-a5f3-1ffe3dd7a052 tempest-GroupsTest-678686835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aee0871-5bb5-4743-a0d3-336ab3f0db09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-b1b1c46e-f2fe-43c5-8f07-8218e543d70b req-abbdf977-8496-496a-a1bc-00a041f68150 tempest-AttachVolumeTestJSON-1055770325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:27:40 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-068f9a09-281d-4d5e-a5f3-1ffe3dd7a052 tempest-GroupsTest-678686835 None] Volume volume-fdf0c5d0-0b15-4255-887c-e47b3522edb4 (fdf0c5d0-0b15-4255-887c-e47b3522edb4): created successfully Nov 02 12:27:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-068f9a09-281d-4d5e-a5f3-1ffe3dd7a052 tempest-GroupsTest-678686835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aee0871-5bb5-4743-a0d3-336ab3f0db09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-068f9a09-281d-4d5e-a5f3-1ffe3dd7a052 tempest-GroupsTest-678686835 None] Flow 'volume_create_manager' (d07a4c1a-dcb8-4a99-8558-e2975b71f832) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:27:40 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-068f9a09-281d-4d5e-a5f3-1ffe3dd7a052 tempest-GroupsTest-678686835 None] Created volume successfully. Nov 02 12:27:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-b1b1c46e-f2fe-43c5-8f07-8218e543d70b req-abbdf977-8496-496a-a1bc-00a041f68150 tempest-AttachVolumeTestJSON-1055770325 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae', 'name': 'volume-39bfbc6e-2473-4123-9ced-5764063e4b05', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '85ee8118-1d6b-46cf-9704-601de9689e7f', 'enforce_multipath': True} {{(pid=86515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:27:40 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-b1b1c46e-f2fe-43c5-8f07-8218e543d70b req-abbdf977-8496-496a-a1bc-00a041f68150 tempest-AttachVolumeTestJSON-1055770325 None] attachment_update completed successfully. Nov 02 12:27:40 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8849893c-e6c0-4ee2-b38e-37dd35392e2a tempest-VolumesServicesTestJSON-1446509925 None] Acquiring lock "cinder-10194af2-28ad-4c38-a3d4-daac778b17aa-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:27:40 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8849893c-e6c0-4ee2-b38e-37dd35392e2a tempest-VolumesServicesTestJSON-1446509925 None] Lock "cinder-10194af2-28ad-4c38-a3d4-daac778b17aa-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:27:40 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8849893c-e6c0-4ee2-b38e-37dd35392e2a tempest-VolumesServicesTestJSON-1446509925 None] Acquiring lock "cinder-quobyte-10194af2-28ad-4c38-a3d4-daac778b17aa" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:27:40 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8849893c-e6c0-4ee2-b38e-37dd35392e2a tempest-VolumesServicesTestJSON-1446509925 None] Lock "cinder-quobyte-10194af2-28ad-4c38-a3d4-daac778b17aa" acquired by "delete_volume" :: waited 0.025s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:27:40 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f88b7f8-e117-4771-8675-f6c8649fd840]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:27:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8849893c-e6c0-4ee2-b38e-37dd35392e2a tempest-VolumesServicesTestJSON-1446509925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-10194af2-28ad-4c38-a3d4-daac778b17aa {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:40 devstack sudo[92486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-10194af2-28ad-4c38-a3d4-daac778b17aa Nov 02 12:27:40 devstack sudo[92486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:41 devstack sudo[92486]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8849893c-e6c0-4ee2-b38e-37dd35392e2a tempest-VolumesServicesTestJSON-1446509925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-10194af2-28ad-4c38-a3d4-daac778b17aa" returned: 0 in 0.513s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8849893c-e6c0-4ee2-b38e-37dd35392e2a tempest-VolumesServicesTestJSON-1446509925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-10194af2-28ad-4c38-a3d4-daac778b17aa {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:41 devstack sudo[92806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-10194af2-28ad-4c38-a3d4-daac778b17aa Nov 02 12:27:41 devstack sudo[92806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f998d37-6fd8-46b5-ba72-4bfad1d20093 tempest-GroupsTest-678686835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0f998d37-6fd8-46b5-ba72-4bfad1d20093 tempest-GroupsTest-678686835 None] Flow 'volume_create_manager' (f314e609-7848-4b31-af98-f9bb31f710ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0f998d37-6fd8-46b5-ba72-4bfad1d20093 tempest-GroupsTest-678686835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce9ab678-b7d4-4fc0-8e6a-281fc59a6552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0f998d37-6fd8-46b5-ba72-4bfad1d20093 tempest-GroupsTest-678686835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce9ab678-b7d4-4fc0-8e6a-281fc59a6552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-646837410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=657fbb6d-bf85-4751-9e74-7b5083828219,host='devstack@QuobyteHD#QuobyteHD',id=25c78512-070f-42ba-ba74-5856736ba235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f385aeb79d463093f2b7f18e1c870a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:27:41Z,use_quota=True,user_id='ca92e0125c334579b5942b662516de8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab3d6a1e-dfdc-4340-8c97-5a74462aa985),volume_type_id=ab3d6a1e-dfdc-4340-8c97-5a74462aa985)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0f998d37-6fd8-46b5-ba72-4bfad1d20093 tempest-GroupsTest-678686835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d225a234-5daf-4397-8749-b966865f30c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0f998d37-6fd8-46b5-ba72-4bfad1d20093 tempest-GroupsTest-678686835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d225a234-5daf-4397-8749-b966865f30c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0f998d37-6fd8-46b5-ba72-4bfad1d20093 tempest-GroupsTest-678686835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455de62e-0229-4d7c-af09-a20c16556bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0f998d37-6fd8-46b5-ba72-4bfad1d20093 tempest-GroupsTest-678686835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455de62e-0229-4d7c-af09-a20c16556bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25c78512-070f-42ba-ba74-5856736ba235', 'volume_name': 'volume-25c78512-070f-42ba-ba74-5856736ba235', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0f998d37-6fd8-46b5-ba72-4bfad1d20093 tempest-GroupsTest-678686835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e526696c-14f7-4b20-87df-99d004a83078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0f998d37-6fd8-46b5-ba72-4bfad1d20093 tempest-GroupsTest-678686835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e526696c-14f7-4b20-87df-99d004a83078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0f998d37-6fd8-46b5-ba72-4bfad1d20093 tempest-GroupsTest-678686835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4469fe43-306d-46ab-a836-cc4a581695ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:41 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-0f998d37-6fd8-46b5-ba72-4bfad1d20093 tempest-GroupsTest-678686835 None] Volume 25c78512-070f-42ba-ba74-5856736ba235: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25c78512-070f-42ba-ba74-5856736ba235', 'volume_size': 1} Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0f998d37-6fd8-46b5-ba72-4bfad1d20093 tempest-GroupsTest-678686835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0f998d37-6fd8-46b5-ba72-4bfad1d20093 tempest-GroupsTest-678686835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0f998d37-6fd8-46b5-ba72-4bfad1d20093 tempest-GroupsTest-678686835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=657fbb6d-bf85-4751-9e74-7b5083828219,created_at=2026-11-02T11:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-646837410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=657fbb6d-bf85-4751-9e74-7b5083828219,host='devstack@QuobyteHD#QuobyteHD',id=25c78512-070f-42ba-ba74-5856736ba235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f385aeb79d463093f2b7f18e1c870a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:27:41Z,use_quota=True,user_id='ca92e0125c334579b5942b662516de8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab3d6a1e-dfdc-4340-8c97-5a74462aa985),volume_type_id=ab3d6a1e-dfdc-4340-8c97-5a74462aa985)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-0f998d37-6fd8-46b5-ba72-4bfad1d20093 tempest-GroupsTest-678686835 None] Creating volume 25c78512-070f-42ba-ba74-5856736ba235 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0f998d37-6fd8-46b5-ba72-4bfad1d20093 tempest-GroupsTest-678686835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0f998d37-6fd8-46b5-ba72-4bfad1d20093 tempest-GroupsTest-678686835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0f998d37-6fd8-46b5-ba72-4bfad1d20093 tempest-GroupsTest-678686835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0f998d37-6fd8-46b5-ba72-4bfad1d20093 tempest-GroupsTest-678686835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0f998d37-6fd8-46b5-ba72-4bfad1d20093 tempest-GroupsTest-678686835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0f998d37-6fd8-46b5-ba72-4bfad1d20093 tempest-GroupsTest-678686835 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:27:41 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-0f998d37-6fd8-46b5-ba72-4bfad1d20093 tempest-GroupsTest-678686835 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0f998d37-6fd8-46b5-ba72-4bfad1d20093 tempest-GroupsTest-678686835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-25c78512-070f-42ba-ba74-5856736ba235 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:41 devstack sudo[92808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-25c78512-070f-42ba-ba74-5856736ba235 1073741824 Nov 02 12:27:41 devstack sudo[92808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:41 devstack sudo[92806]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8849893c-e6c0-4ee2-b38e-37dd35392e2a tempest-VolumesServicesTestJSON-1446509925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-10194af2-28ad-4c38-a3d4-daac778b17aa" returned: 0 in 0.294s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8849893c-e6c0-4ee2-b38e-37dd35392e2a tempest-VolumesServicesTestJSON-1446509925 None] Lock "cinder-quobyte-10194af2-28ad-4c38-a3d4-daac778b17aa" released by "delete_volume" :: held 0.869s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-8849893c-e6c0-4ee2-b38e-37dd35392e2a tempest-VolumesServicesTestJSON-1446509925 None] Created reservations ['31899ceb-b246-441e-a150-7cae4d971615', '0b291e7e-c3ba-48fa-a6ee-4a1a9b5a52fd', 'd46c20d3-ea6d-400a-bf18-60b3692d00b3', '418af956-8c18-4841-94c0-5d007eea9dd4'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8849893c-e6c0-4ee2-b38e-37dd35392e2a tempest-VolumesServicesTestJSON-1446509925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8849893c-e6c0-4ee2-b38e-37dd35392e2a tempest-VolumesServicesTestJSON-1446509925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8849893c-e6c0-4ee2-b38e-37dd35392e2a tempest-VolumesServicesTestJSON-1446509925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8849893c-e6c0-4ee2-b38e-37dd35392e2a tempest-VolumesServicesTestJSON-1446509925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8849893c-e6c0-4ee2-b38e-37dd35392e2a tempest-VolumesServicesTestJSON-1446509925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8849893c-e6c0-4ee2-b38e-37dd35392e2a tempest-VolumesServicesTestJSON-1446509925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:41 devstack sudo[92813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:27:41 devstack sudo[92813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:41 devstack sudo[92808]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:41 devstack sudo[92813]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8849893c-e6c0-4ee2-b38e-37dd35392e2a tempest-VolumesServicesTestJSON-1446509925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.304s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0f998d37-6fd8-46b5-ba72-4bfad1d20093 tempest-GroupsTest-678686835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-25c78512-070f-42ba-ba74-5856736ba235 1073741824" returned: 0 in 0.540s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-8849893c-e6c0-4ee2-b38e-37dd35392e2a tempest-VolumesServicesTestJSON-1446509925 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:27:41 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-8849893c-e6c0-4ee2-b38e-37dd35392e2a tempest-VolumesServicesTestJSON-1446509925 None] Deleted volume successfully. Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8849893c-e6c0-4ee2-b38e-37dd35392e2a tempest-VolumesServicesTestJSON-1446509925 None] Lock "cinder-10194af2-28ad-4c38-a3d4-daac778b17aa-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:27:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0f998d37-6fd8-46b5-ba72-4bfad1d20093 tempest-GroupsTest-678686835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-25c78512-070f-42ba-ba74-5856736ba235 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:41 devstack sudo[92818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-25c78512-070f-42ba-ba74-5856736ba235 Nov 02 12:27:41 devstack sudo[92818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:42 devstack sudo[92818]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0f998d37-6fd8-46b5-ba72-4bfad1d20093 tempest-GroupsTest-678686835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-25c78512-070f-42ba-ba74-5856736ba235" returned: 0 in 0.282s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:42 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0f998d37-6fd8-46b5-ba72-4bfad1d20093 tempest-GroupsTest-678686835 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:27:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0f998d37-6fd8-46b5-ba72-4bfad1d20093 tempest-GroupsTest-678686835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:27:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0f998d37-6fd8-46b5-ba72-4bfad1d20093 tempest-GroupsTest-678686835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4469fe43-306d-46ab-a836-cc4a581695ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25c78512-070f-42ba-ba74-5856736ba235', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0f998d37-6fd8-46b5-ba72-4bfad1d20093 tempest-GroupsTest-678686835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d49b8ba-f4f8-4900-b0ae-fe26ce57793c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:42 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-0f998d37-6fd8-46b5-ba72-4bfad1d20093 tempest-GroupsTest-678686835 None] Volume volume-25c78512-070f-42ba-ba74-5856736ba235 (25c78512-070f-42ba-ba74-5856736ba235): created successfully Nov 02 12:27:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0f998d37-6fd8-46b5-ba72-4bfad1d20093 tempest-GroupsTest-678686835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d49b8ba-f4f8-4900-b0ae-fe26ce57793c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0f998d37-6fd8-46b5-ba72-4bfad1d20093 tempest-GroupsTest-678686835 None] Flow 'volume_create_manager' (f314e609-7848-4b31-af98-f9bb31f710ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:27:42 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-0f998d37-6fd8-46b5-ba72-4bfad1d20093 tempest-GroupsTest-678686835 None] Created volume successfully. Nov 02 12:27:42 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-486cd5be-a0ef-4a8c-8be6-116dcdf60de2 tempest-AttachVolumeTestJSON-1055770325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:27:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-486cd5be-a0ef-4a8c-8be6-116dcdf60de2 tempest-AttachVolumeTestJSON-1055770325 None] Flow 'volume_create_manager' (cb611428-3f5f-4038-8aa3-666ffe052dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:27:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-486cd5be-a0ef-4a8c-8be6-116dcdf60de2 tempest-AttachVolumeTestJSON-1055770325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (338f0fbe-6c21-47d4-8770-0dd7eca84763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-486cd5be-a0ef-4a8c-8be6-116dcdf60de2 tempest-AttachVolumeTestJSON-1055770325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (338f0fbe-6c21-47d4-8770-0dd7eca84763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1165570650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed33eb1-554d-41b1-bd3f-1b16ce77975f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e2d019c95d40b883211901089255b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:27:42Z,use_quota=True,user_id='a3e91acddbd14ee5b9ad6eec12e35a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-486cd5be-a0ef-4a8c-8be6-116dcdf60de2 tempest-AttachVolumeTestJSON-1055770325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd76f032-963b-4003-bf71-c99e067ee1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-486cd5be-a0ef-4a8c-8be6-116dcdf60de2 tempest-AttachVolumeTestJSON-1055770325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd76f032-963b-4003-bf71-c99e067ee1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-486cd5be-a0ef-4a8c-8be6-116dcdf60de2 tempest-AttachVolumeTestJSON-1055770325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14334365-e56e-4690-b8af-e56839a802d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-486cd5be-a0ef-4a8c-8be6-116dcdf60de2 tempest-AttachVolumeTestJSON-1055770325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14334365-e56e-4690-b8af-e56839a802d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ed33eb1-554d-41b1-bd3f-1b16ce77975f', 'volume_name': 'volume-4ed33eb1-554d-41b1-bd3f-1b16ce77975f', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-486cd5be-a0ef-4a8c-8be6-116dcdf60de2 tempest-AttachVolumeTestJSON-1055770325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc68394-e4f0-4dbd-84ed-cf00d27fd74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-486cd5be-a0ef-4a8c-8be6-116dcdf60de2 tempest-AttachVolumeTestJSON-1055770325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc68394-e4f0-4dbd-84ed-cf00d27fd74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-486cd5be-a0ef-4a8c-8be6-116dcdf60de2 tempest-AttachVolumeTestJSON-1055770325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6feb7165-0717-4a98-bf2c-e4929f57f4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:42 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-486cd5be-a0ef-4a8c-8be6-116dcdf60de2 tempest-AttachVolumeTestJSON-1055770325 None] Volume 4ed33eb1-554d-41b1-bd3f-1b16ce77975f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ed33eb1-554d-41b1-bd3f-1b16ce77975f', 'volume_size': 1} Nov 02 12:27:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-486cd5be-a0ef-4a8c-8be6-116dcdf60de2 tempest-AttachVolumeTestJSON-1055770325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:27:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-486cd5be-a0ef-4a8c-8be6-116dcdf60de2 tempest-AttachVolumeTestJSON-1055770325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:27:42 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-486cd5be-a0ef-4a8c-8be6-116dcdf60de2 tempest-AttachVolumeTestJSON-1055770325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1165570650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed33eb1-554d-41b1-bd3f-1b16ce77975f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e2d019c95d40b883211901089255b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:27:42Z,use_quota=True,user_id='a3e91acddbd14ee5b9ad6eec12e35a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:27:42 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-486cd5be-a0ef-4a8c-8be6-116dcdf60de2 tempest-AttachVolumeTestJSON-1055770325 None] Creating volume 4ed33eb1-554d-41b1-bd3f-1b16ce77975f {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:27:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-486cd5be-a0ef-4a8c-8be6-116dcdf60de2 tempest-AttachVolumeTestJSON-1055770325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:27:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-486cd5be-a0ef-4a8c-8be6-116dcdf60de2 tempest-AttachVolumeTestJSON-1055770325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:27:42 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-486cd5be-a0ef-4a8c-8be6-116dcdf60de2 tempest-AttachVolumeTestJSON-1055770325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:27:42 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-486cd5be-a0ef-4a8c-8be6-116dcdf60de2 tempest-AttachVolumeTestJSON-1055770325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:27:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-486cd5be-a0ef-4a8c-8be6-116dcdf60de2 tempest-AttachVolumeTestJSON-1055770325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:27:42 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-486cd5be-a0ef-4a8c-8be6-116dcdf60de2 tempest-AttachVolumeTestJSON-1055770325 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:27:42 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-486cd5be-a0ef-4a8c-8be6-116dcdf60de2 tempest-AttachVolumeTestJSON-1055770325 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:27:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-486cd5be-a0ef-4a8c-8be6-116dcdf60de2 tempest-AttachVolumeTestJSON-1055770325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4ed33eb1-554d-41b1-bd3f-1b16ce77975f 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:42 devstack sudo[92822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4ed33eb1-554d-41b1-bd3f-1b16ce77975f 1073741824 Nov 02 12:27:42 devstack sudo[92822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:43 devstack sudo[92822]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-486cd5be-a0ef-4a8c-8be6-116dcdf60de2 tempest-AttachVolumeTestJSON-1055770325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4ed33eb1-554d-41b1-bd3f-1b16ce77975f 1073741824" returned: 0 in 0.573s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-486cd5be-a0ef-4a8c-8be6-116dcdf60de2 tempest-AttachVolumeTestJSON-1055770325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4ed33eb1-554d-41b1-bd3f-1b16ce77975f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:43 devstack sudo[92828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4ed33eb1-554d-41b1-bd3f-1b16ce77975f Nov 02 12:27:43 devstack sudo[92828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:43 devstack sudo[92828]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-486cd5be-a0ef-4a8c-8be6-116dcdf60de2 tempest-AttachVolumeTestJSON-1055770325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4ed33eb1-554d-41b1-bd3f-1b16ce77975f" returned: 0 in 0.369s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-486cd5be-a0ef-4a8c-8be6-116dcdf60de2 tempest-AttachVolumeTestJSON-1055770325 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:27:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-486cd5be-a0ef-4a8c-8be6-116dcdf60de2 tempest-AttachVolumeTestJSON-1055770325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:27:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-486cd5be-a0ef-4a8c-8be6-116dcdf60de2 tempest-AttachVolumeTestJSON-1055770325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6feb7165-0717-4a98-bf2c-e4929f57f4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ed33eb1-554d-41b1-bd3f-1b16ce77975f', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-486cd5be-a0ef-4a8c-8be6-116dcdf60de2 tempest-AttachVolumeTestJSON-1055770325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63cf0bb2-2b96-4145-904c-42744f497c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:27:43 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-486cd5be-a0ef-4a8c-8be6-116dcdf60de2 tempest-AttachVolumeTestJSON-1055770325 None] Volume volume-4ed33eb1-554d-41b1-bd3f-1b16ce77975f (4ed33eb1-554d-41b1-bd3f-1b16ce77975f): created successfully Nov 02 12:27:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-486cd5be-a0ef-4a8c-8be6-116dcdf60de2 tempest-AttachVolumeTestJSON-1055770325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63cf0bb2-2b96-4145-904c-42744f497c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:27:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-486cd5be-a0ef-4a8c-8be6-116dcdf60de2 tempest-AttachVolumeTestJSON-1055770325 None] Flow 'volume_create_manager' (cb611428-3f5f-4038-8aa3-666ffe052dbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:27:43 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-486cd5be-a0ef-4a8c-8be6-116dcdf60de2 tempest-AttachVolumeTestJSON-1055770325 None] Created volume successfully. Nov 02 12:27:43 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-6ea42a8e-7a80-46c6-bee1-f926eefe08c8 tempest-GroupsTest-678686835 None] Update group completed successfully. Nov 02 12:27:43 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:27:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:27:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:27:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:27:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:27:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:27:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:43 devstack sudo[92831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:27:43 devstack sudo[92831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:44 devstack sudo[92831]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.292s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:44 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:27:44 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager._thread_info {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:27:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread count: 8 {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:27:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread info: [<_MainThread(MainThread, started 129944084402304)>, , , , , , , ] {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:27:45 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-64e20d36-cab0-405c-a7b6-773afba39e3f tempest-GroupsTest-678686835 None] Update group completed successfully. Nov 02 12:27:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-15f62399-5931-4d53-a138-75b31d1c4f5c req-321fc404-ff69-4662-b2c0-3fe3d32607b0 tempest-AttachVolumeTestJSON-1055770325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:27:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-15f62399-5931-4d53-a138-75b31d1c4f5c req-321fc404-ff69-4662-b2c0-3fe3d32607b0 tempest-AttachVolumeTestJSON-1055770325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:27:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-15f62399-5931-4d53-a138-75b31d1c4f5c req-321fc404-ff69-4662-b2c0-3fe3d32607b0 tempest-AttachVolumeTestJSON-1055770325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:27:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-15f62399-5931-4d53-a138-75b31d1c4f5c req-321fc404-ff69-4662-b2c0-3fe3d32607b0 tempest-AttachVolumeTestJSON-1055770325 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae', 'name': 'volume-4ed33eb1-554d-41b1-bd3f-1b16ce77975f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'da745329-f8a3-40c4-9d1e-1b212a3682d4', 'enforce_multipath': True} {{(pid=86515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:27:45 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-15f62399-5931-4d53-a138-75b31d1c4f5c req-321fc404-ff69-4662-b2c0-3fe3d32607b0 tempest-AttachVolumeTestJSON-1055770325 None] attachment_update completed successfully. Nov 02 12:27:47 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4996422a-b67f-46fc-b90c-ca602edad994 tempest-GroupsTest-678686835 None] Acquiring lock "cinder-quobyte-25c78512-070f-42ba-ba74-5856736ba235" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:27:47 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4996422a-b67f-46fc-b90c-ca602edad994 tempest-GroupsTest-678686835 None] Lock "cinder-quobyte-25c78512-070f-42ba-ba74-5856736ba235" acquired by "delete_volume" :: waited 0.036s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:27:47 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5f7189-1c57-4065-ac93-857669fbe9e2]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:27:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4996422a-b67f-46fc-b90c-ca602edad994 tempest-GroupsTest-678686835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-25c78512-070f-42ba-ba74-5856736ba235 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:47 devstack sudo[92864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-25c78512-070f-42ba-ba74-5856736ba235 Nov 02 12:27:47 devstack sudo[92864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:47 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-8b3a4415-b7dc-4f37-857f-9ccb99744b53 req-46c3d025-0320-4e37-920d-da2bc6f085b7 tempest-AttachVolumeTestJSON-1055770325 None] Terminate volume connection completed successfully. Nov 02 12:27:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-8b3a4415-b7dc-4f37-857f-9ccb99744b53 req-46c3d025-0320-4e37-920d-da2bc6f085b7 tempest-AttachVolumeTestJSON-1055770325 None] Deleting attachment 85ee8118-1d6b-46cf-9704-601de9689e7f. {{(pid=86515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:27:47 devstack sudo[92864]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4996422a-b67f-46fc-b90c-ca602edad994 tempest-GroupsTest-678686835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-25c78512-070f-42ba-ba74-5856736ba235" returned: 0 in 0.539s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4996422a-b67f-46fc-b90c-ca602edad994 tempest-GroupsTest-678686835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-25c78512-070f-42ba-ba74-5856736ba235 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:47 devstack sudo[92875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-25c78512-070f-42ba-ba74-5856736ba235 Nov 02 12:27:47 devstack sudo[92875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:48 devstack sudo[92875]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4996422a-b67f-46fc-b90c-ca602edad994 tempest-GroupsTest-678686835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-25c78512-070f-42ba-ba74-5856736ba235" returned: 0 in 0.342s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:48 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4996422a-b67f-46fc-b90c-ca602edad994 tempest-GroupsTest-678686835 None] Lock "cinder-quobyte-25c78512-070f-42ba-ba74-5856736ba235" released by "delete_volume" :: held 0.967s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:27:48 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4996422a-b67f-46fc-b90c-ca602edad994 tempest-GroupsTest-678686835 None] Acquiring lock "cinder-quobyte-fdf0c5d0-0b15-4255-887c-e47b3522edb4" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:27:48 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4996422a-b67f-46fc-b90c-ca602edad994 tempest-GroupsTest-678686835 None] Lock "cinder-quobyte-fdf0c5d0-0b15-4255-887c-e47b3522edb4" acquired by "delete_volume" :: waited 0.021s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:27:48 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2f990b-8485-4ec9-80eb-c058217e6dce]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:27:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4996422a-b67f-46fc-b90c-ca602edad994 tempest-GroupsTest-678686835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-fdf0c5d0-0b15-4255-887c-e47b3522edb4 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:48 devstack sudo[92886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-fdf0c5d0-0b15-4255-887c-e47b3522edb4 Nov 02 12:27:48 devstack sudo[92886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-650d8fe7-3ffc-4936-b01c-8b444b95c42c req-2f2c984f-27a0-4b61-bbe8-6dc68214c159 tempest-ServerActionsTestOtherA-618205716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:27:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-650d8fe7-3ffc-4936-b01c-8b444b95c42c req-2f2c984f-27a0-4b61-bbe8-6dc68214c159 tempest-ServerActionsTestOtherA-618205716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:27:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-650d8fe7-3ffc-4936-b01c-8b444b95c42c req-2f2c984f-27a0-4b61-bbe8-6dc68214c159 tempest-ServerActionsTestOtherA-618205716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:27:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-650d8fe7-3ffc-4936-b01c-8b444b95c42c req-2f2c984f-27a0-4b61-bbe8-6dc68214c159 tempest-ServerActionsTestOtherA-618205716 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae', 'name': 'volume-d8233902-5c8d-4b35-99a8-43664013f760', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e3321f64-2d15-45d4-9881-4b3703064238', 'enforce_multipath': True} {{(pid=86515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:27:48 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-650d8fe7-3ffc-4936-b01c-8b444b95c42c req-2f2c984f-27a0-4b61-bbe8-6dc68214c159 tempest-ServerActionsTestOtherA-618205716 None] attachment_update completed successfully. Nov 02 12:27:48 devstack sudo[92886]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4996422a-b67f-46fc-b90c-ca602edad994 tempest-GroupsTest-678686835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-fdf0c5d0-0b15-4255-887c-e47b3522edb4" returned: 0 in 0.457s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4996422a-b67f-46fc-b90c-ca602edad994 tempest-GroupsTest-678686835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-fdf0c5d0-0b15-4255-887c-e47b3522edb4 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:48 devstack sudo[92896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-fdf0c5d0-0b15-4255-887c-e47b3522edb4 Nov 02 12:27:48 devstack sudo[92896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:49 devstack sudo[92896]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4996422a-b67f-46fc-b90c-ca602edad994 tempest-GroupsTest-678686835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-fdf0c5d0-0b15-4255-887c-e47b3522edb4" returned: 0 in 0.372s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:49 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4996422a-b67f-46fc-b90c-ca602edad994 tempest-GroupsTest-678686835 None] Lock "cinder-quobyte-fdf0c5d0-0b15-4255-887c-e47b3522edb4" released by "delete_volume" :: held 0.917s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:27:49 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-4996422a-b67f-46fc-b90c-ca602edad994 tempest-GroupsTest-678686835 None] Created reservations ['c430efbf-0d71-47ce-bc6a-104f59152b93'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:27:49 devstack cinder-volume[86515]: WARNING cinder.quota [None req-4996422a-b67f-46fc-b90c-ca602edad994 tempest-GroupsTest-678686835 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-808073036 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-808073036, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:27:49 devstack cinder-volume[86515]: WARNING cinder.quota [None req-4996422a-b67f-46fc-b90c-ca602edad994 tempest-GroupsTest-678686835 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-808073036 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-808073036, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:27:49 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-4996422a-b67f-46fc-b90c-ca602edad994 tempest-GroupsTest-678686835 None] Created reservations ['02478ff4-e771-47f8-9164-64301107d6e0', 'd78cb3fb-0b23-4a64-a272-e56cffa471f4', '3722b130-8f8f-454a-97e4-2e845d15aef5', '6215a899-78c8-4ed6-ad7f-356adb45bf9a'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:27:49 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-d2e1570c-d89b-42fc-a230-49c7d880c087 req-ce259cd1-c143-4b8a-b3aa-e3b1d4bbe57e tempest-AttachVolumeTestJSON-1055770325 None] Terminate volume connection completed successfully. Nov 02 12:27:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-d2e1570c-d89b-42fc-a230-49c7d880c087 req-ce259cd1-c143-4b8a-b3aa-e3b1d4bbe57e tempest-AttachVolumeTestJSON-1055770325 None] Deleting attachment da745329-f8a3-40c4-9d1e-1b212a3682d4. {{(pid=86515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:27:49 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-4996422a-b67f-46fc-b90c-ca602edad994 tempest-GroupsTest-678686835 None] Created reservations ['931b1e28-f105-4cad-9ed7-cb56b6e03e74', 'c98050be-2dd0-41f3-ba7c-34563ba835b8', '06f8a394-42e5-4ace-ba2f-ca08d905a5a9', '4697647a-dbe1-4c11-96b7-513d72e2a463'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:27:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4996422a-b67f-46fc-b90c-ca602edad994 tempest-GroupsTest-678686835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:27:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4996422a-b67f-46fc-b90c-ca602edad994 tempest-GroupsTest-678686835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:27:49 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-4996422a-b67f-46fc-b90c-ca602edad994 tempest-GroupsTest-678686835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:27:49 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-4996422a-b67f-46fc-b90c-ca602edad994 tempest-GroupsTest-678686835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:27:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4996422a-b67f-46fc-b90c-ca602edad994 tempest-GroupsTest-678686835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:27:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4996422a-b67f-46fc-b90c-ca602edad994 tempest-GroupsTest-678686835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:49 devstack sudo[92902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:27:49 devstack sudo[92902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:49 devstack sudo[92902]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4996422a-b67f-46fc-b90c-ca602edad994 tempest-GroupsTest-678686835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.341s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:49 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-4996422a-b67f-46fc-b90c-ca602edad994 tempest-GroupsTest-678686835 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:27:49 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-4996422a-b67f-46fc-b90c-ca602edad994 tempest-GroupsTest-678686835 None] Delete group completed successfully. Nov 02 12:27:52 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-56c3e71d-73a6-4755-9d8a-015a306595d4 req-e6d5439b-d1a3-43bc-a907-3f9c6e275ca0 tempest-ServerActionsTestOtherA-618205716 None] Terminate volume connection completed successfully. Nov 02 12:27:52 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-56c3e71d-73a6-4755-9d8a-015a306595d4 req-e6d5439b-d1a3-43bc-a907-3f9c6e275ca0 tempest-ServerActionsTestOtherA-618205716 None] Deleting attachment e3321f64-2d15-45d4-9881-4b3703064238. {{(pid=86515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:27:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-56c3e71d-73a6-4755-9d8a-015a306595d4 req-135c9884-94ab-4e50-865a-d13b23ef1e94 tempest-ServerActionsTestOtherA-618205716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:27:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-56c3e71d-73a6-4755-9d8a-015a306595d4 req-135c9884-94ab-4e50-865a-d13b23ef1e94 tempest-ServerActionsTestOtherA-618205716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:27:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-56c3e71d-73a6-4755-9d8a-015a306595d4 req-135c9884-94ab-4e50-865a-d13b23ef1e94 tempest-ServerActionsTestOtherA-618205716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:27:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-56c3e71d-73a6-4755-9d8a-015a306595d4 req-135c9884-94ab-4e50-865a-d13b23ef1e94 tempest-ServerActionsTestOtherA-618205716 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae', 'name': 'volume-d8233902-5c8d-4b35-99a8-43664013f760', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fced60b6-c5d6-46be-842c-36c3fe139d22', 'enforce_multipath': True} {{(pid=86515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:27:54 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-56c3e71d-73a6-4755-9d8a-015a306595d4 req-135c9884-94ab-4e50-865a-d13b23ef1e94 tempest-ServerActionsTestOtherA-618205716 None] attachment_update completed successfully. Nov 02 12:27:57 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-fad5f072-f9cb-47df-bfbd-6ab2aad44c8d tempest-AttachVolumeTestJSON-1055770325 None] Acquiring lock "cinder-4ed33eb1-554d-41b1-bd3f-1b16ce77975f-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:27:57 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-fad5f072-f9cb-47df-bfbd-6ab2aad44c8d tempest-AttachVolumeTestJSON-1055770325 None] Lock "cinder-4ed33eb1-554d-41b1-bd3f-1b16ce77975f-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:27:57 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-fad5f072-f9cb-47df-bfbd-6ab2aad44c8d tempest-AttachVolumeTestJSON-1055770325 None] Acquiring lock "cinder-quobyte-4ed33eb1-554d-41b1-bd3f-1b16ce77975f" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:27:57 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-fad5f072-f9cb-47df-bfbd-6ab2aad44c8d tempest-AttachVolumeTestJSON-1055770325 None] Lock "cinder-quobyte-4ed33eb1-554d-41b1-bd3f-1b16ce77975f" acquired by "delete_volume" :: waited 0.020s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:27:57 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ceb3bf2-3d8a-45da-b227-64c2c67a3e53]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:27:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fad5f072-f9cb-47df-bfbd-6ab2aad44c8d tempest-AttachVolumeTestJSON-1055770325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4ed33eb1-554d-41b1-bd3f-1b16ce77975f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:57 devstack sudo[93485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4ed33eb1-554d-41b1-bd3f-1b16ce77975f Nov 02 12:27:57 devstack sudo[93485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:58 devstack sudo[93485]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fad5f072-f9cb-47df-bfbd-6ab2aad44c8d tempest-AttachVolumeTestJSON-1055770325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4ed33eb1-554d-41b1-bd3f-1b16ce77975f" returned: 0 in 0.515s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fad5f072-f9cb-47df-bfbd-6ab2aad44c8d tempest-AttachVolumeTestJSON-1055770325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4ed33eb1-554d-41b1-bd3f-1b16ce77975f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:58 devstack sudo[93492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4ed33eb1-554d-41b1-bd3f-1b16ce77975f Nov 02 12:27:58 devstack sudo[93492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:58 devstack sudo[93492]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fad5f072-f9cb-47df-bfbd-6ab2aad44c8d tempest-AttachVolumeTestJSON-1055770325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4ed33eb1-554d-41b1-bd3f-1b16ce77975f" returned: 0 in 0.361s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:58 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-fad5f072-f9cb-47df-bfbd-6ab2aad44c8d tempest-AttachVolumeTestJSON-1055770325 None] Lock "cinder-quobyte-4ed33eb1-554d-41b1-bd3f-1b16ce77975f" released by "delete_volume" :: held 0.964s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:27:58 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-fad5f072-f9cb-47df-bfbd-6ab2aad44c8d tempest-AttachVolumeTestJSON-1055770325 None] Created reservations ['8f00a335-8624-4c7b-bd0c-cf8594222b45', 'fdf68fb4-87ad-4ac3-8d24-4d2558f99b4b', '6895d80b-a7fc-4c87-bb6f-8b5706504ffa', '3cf194cb-d2b8-4916-a3e0-0ec4f563ee2a'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:27:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fad5f072-f9cb-47df-bfbd-6ab2aad44c8d tempest-AttachVolumeTestJSON-1055770325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:27:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fad5f072-f9cb-47df-bfbd-6ab2aad44c8d tempest-AttachVolumeTestJSON-1055770325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:27:59 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-fad5f072-f9cb-47df-bfbd-6ab2aad44c8d tempest-AttachVolumeTestJSON-1055770325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:27:59 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-fad5f072-f9cb-47df-bfbd-6ab2aad44c8d tempest-AttachVolumeTestJSON-1055770325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:27:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fad5f072-f9cb-47df-bfbd-6ab2aad44c8d tempest-AttachVolumeTestJSON-1055770325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:27:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fad5f072-f9cb-47df-bfbd-6ab2aad44c8d tempest-AttachVolumeTestJSON-1055770325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:27:59 devstack sudo[93495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:27:59 devstack sudo[93495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:27:59 devstack sudo[93495]: pam_unix(sudo:session): session closed for user root Nov 02 12:27:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fad5f072-f9cb-47df-bfbd-6ab2aad44c8d tempest-AttachVolumeTestJSON-1055770325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.527s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:27:59 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-fad5f072-f9cb-47df-bfbd-6ab2aad44c8d tempest-AttachVolumeTestJSON-1055770325 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:27:59 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-fad5f072-f9cb-47df-bfbd-6ab2aad44c8d tempest-AttachVolumeTestJSON-1055770325 None] Deleted volume successfully. Nov 02 12:27:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-fad5f072-f9cb-47df-bfbd-6ab2aad44c8d tempest-AttachVolumeTestJSON-1055770325 None] Lock "cinder-4ed33eb1-554d-41b1-bd3f-1b16ce77975f-delete_volume" released by "delete_volume" :: held 2.008s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:27:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-86727674-8200-4515-a096-cee69c8ea8da tempest-AttachVolumeTestJSON-1055770325 None] Acquiring lock "cinder-39bfbc6e-2473-4123-9ced-5764063e4b05-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:27:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-86727674-8200-4515-a096-cee69c8ea8da tempest-AttachVolumeTestJSON-1055770325 None] Lock "cinder-39bfbc6e-2473-4123-9ced-5764063e4b05-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:28:00 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-86727674-8200-4515-a096-cee69c8ea8da tempest-AttachVolumeTestJSON-1055770325 None] Acquiring lock "cinder-quobyte-39bfbc6e-2473-4123-9ced-5764063e4b05" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:28:00 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-86727674-8200-4515-a096-cee69c8ea8da tempest-AttachVolumeTestJSON-1055770325 None] Lock "cinder-quobyte-39bfbc6e-2473-4123-9ced-5764063e4b05" acquired by "delete_volume" :: waited 0.027s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:28:00 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[62373b9f-1fd4-4890-8e9a-5e7f761a148b]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:28:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-86727674-8200-4515-a096-cee69c8ea8da tempest-AttachVolumeTestJSON-1055770325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39bfbc6e-2473-4123-9ced-5764063e4b05 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:00 devstack sudo[93498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39bfbc6e-2473-4123-9ced-5764063e4b05 Nov 02 12:28:00 devstack sudo[93498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:00 devstack sudo[93498]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-86727674-8200-4515-a096-cee69c8ea8da tempest-AttachVolumeTestJSON-1055770325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39bfbc6e-2473-4123-9ced-5764063e4b05" returned: 0 in 0.532s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-86727674-8200-4515-a096-cee69c8ea8da tempest-AttachVolumeTestJSON-1055770325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39bfbc6e-2473-4123-9ced-5764063e4b05 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:00 devstack sudo[93503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39bfbc6e-2473-4123-9ced-5764063e4b05 Nov 02 12:28:00 devstack sudo[93503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:00 devstack sudo[93503]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-86727674-8200-4515-a096-cee69c8ea8da tempest-AttachVolumeTestJSON-1055770325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39bfbc6e-2473-4123-9ced-5764063e4b05" returned: 0 in 0.346s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-86727674-8200-4515-a096-cee69c8ea8da tempest-AttachVolumeTestJSON-1055770325 None] Lock "cinder-quobyte-39bfbc6e-2473-4123-9ced-5764063e4b05" released by "delete_volume" :: held 0.937s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:28:01 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-86727674-8200-4515-a096-cee69c8ea8da tempest-AttachVolumeTestJSON-1055770325 None] Created reservations ['e4e1c631-50a9-4a58-a9a4-f5057aff2c29', '113e68fc-18e1-432b-b3d6-e38192b7004a', 'd4f6d280-80f5-4c28-9a38-31eb8ee5540f', '56127c84-4de1-42d8-b0f3-1c5fdefb13e2'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:28:01 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=121,cinder:UPDATE=127,cinder:DELETE=12,cinder:INSERT=23 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:28:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-86727674-8200-4515-a096-cee69c8ea8da tempest-AttachVolumeTestJSON-1055770325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:28:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-86727674-8200-4515-a096-cee69c8ea8da tempest-AttachVolumeTestJSON-1055770325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:28:01 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-86727674-8200-4515-a096-cee69c8ea8da tempest-AttachVolumeTestJSON-1055770325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:28:01 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-86727674-8200-4515-a096-cee69c8ea8da tempest-AttachVolumeTestJSON-1055770325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:28:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-86727674-8200-4515-a096-cee69c8ea8da tempest-AttachVolumeTestJSON-1055770325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:28:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-86727674-8200-4515-a096-cee69c8ea8da tempest-AttachVolumeTestJSON-1055770325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:01 devstack sudo[93507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:28:01 devstack sudo[93507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c6daf009-f0eb-450f-9bcd-2b63a7666ffb tempest-AttachVolumeTestJSON-1055770325 None] Acquiring lock "cinder-30acd361-29dd-4a4e-af80-aecae3da25e5-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:28:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c6daf009-f0eb-450f-9bcd-2b63a7666ffb tempest-AttachVolumeTestJSON-1055770325 None] Lock "cinder-30acd361-29dd-4a4e-af80-aecae3da25e5-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:28:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c6daf009-f0eb-450f-9bcd-2b63a7666ffb tempest-AttachVolumeTestJSON-1055770325 None] Acquiring lock "cinder-quobyte-30acd361-29dd-4a4e-af80-aecae3da25e5" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:28:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c6daf009-f0eb-450f-9bcd-2b63a7666ffb tempest-AttachVolumeTestJSON-1055770325 None] Lock "cinder-quobyte-30acd361-29dd-4a4e-af80-aecae3da25e5" acquired by "delete_volume" :: waited 0.018s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:28:01 devstack sudo[93507]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-86727674-8200-4515-a096-cee69c8ea8da tempest-AttachVolumeTestJSON-1055770325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.427s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:01 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-86727674-8200-4515-a096-cee69c8ea8da tempest-AttachVolumeTestJSON-1055770325 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:28:01 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdbd538-8792-4f2a-ac97-64438dee920f]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:28:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c6daf009-f0eb-450f-9bcd-2b63a7666ffb tempest-AttachVolumeTestJSON-1055770325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-30acd361-29dd-4a4e-af80-aecae3da25e5 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:01 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-86727674-8200-4515-a096-cee69c8ea8da tempest-AttachVolumeTestJSON-1055770325 None] Deleted volume successfully. Nov 02 12:28:01 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=123,cinder:UPDATE=134,cinder:INSERT=31,cinder:DELETE=6 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:28:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-86727674-8200-4515-a096-cee69c8ea8da tempest-AttachVolumeTestJSON-1055770325 None] Lock "cinder-39bfbc6e-2473-4123-9ced-5764063e4b05-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:28:01 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-e6c3f80d-c67c-4321-854d-79cdb06a1556 tempest-GroupsV314Test-665331351 None] Group tempest-GroupsV314Test-Group-452382254: creating Nov 02 12:28:01 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-e6c3f80d-c67c-4321-854d-79cdb06a1556 tempest-GroupsV314Test-665331351 None] Group tempest-GroupsV314Test-Group-452382254: created successfully Nov 02 12:28:01 devstack sudo[93510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-30acd361-29dd-4a4e-af80-aecae3da25e5 Nov 02 12:28:01 devstack sudo[93510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:01 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-e6c3f80d-c67c-4321-854d-79cdb06a1556 tempest-GroupsV314Test-665331351 None] Create group completed successfully. Nov 02 12:28:02 devstack sudo[93510]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c6daf009-f0eb-450f-9bcd-2b63a7666ffb tempest-AttachVolumeTestJSON-1055770325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-30acd361-29dd-4a4e-af80-aecae3da25e5" returned: 0 in 0.415s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c6daf009-f0eb-450f-9bcd-2b63a7666ffb tempest-AttachVolumeTestJSON-1055770325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-30acd361-29dd-4a4e-af80-aecae3da25e5 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:02 devstack sudo[93515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-30acd361-29dd-4a4e-af80-aecae3da25e5 Nov 02 12:28:02 devstack sudo[93515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:02 devstack sudo[93515]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c6daf009-f0eb-450f-9bcd-2b63a7666ffb tempest-AttachVolumeTestJSON-1055770325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-30acd361-29dd-4a4e-af80-aecae3da25e5" returned: 0 in 0.276s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:02 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c6daf009-f0eb-450f-9bcd-2b63a7666ffb tempest-AttachVolumeTestJSON-1055770325 None] Lock "cinder-quobyte-30acd361-29dd-4a4e-af80-aecae3da25e5" released by "delete_volume" :: held 0.797s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:28:02 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-c6daf009-f0eb-450f-9bcd-2b63a7666ffb tempest-AttachVolumeTestJSON-1055770325 None] Created reservations ['a5c65ecc-6d07-45d3-b00e-84d350aabb7e', '84bd2eac-6e3e-4822-96cc-2d8d044d2f83', '1044fe4f-03e9-466f-bbfd-d6fea606dbfe', 'a57bbcb2-46db-4278-8da9-60902827bf4f'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:28:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c6daf009-f0eb-450f-9bcd-2b63a7666ffb tempest-AttachVolumeTestJSON-1055770325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:28:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c6daf009-f0eb-450f-9bcd-2b63a7666ffb tempest-AttachVolumeTestJSON-1055770325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:28:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-c6daf009-f0eb-450f-9bcd-2b63a7666ffb tempest-AttachVolumeTestJSON-1055770325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:28:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-c6daf009-f0eb-450f-9bcd-2b63a7666ffb tempest-AttachVolumeTestJSON-1055770325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:28:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c6daf009-f0eb-450f-9bcd-2b63a7666ffb tempest-AttachVolumeTestJSON-1055770325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:28:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c6daf009-f0eb-450f-9bcd-2b63a7666ffb tempest-AttachVolumeTestJSON-1055770325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:02 devstack sudo[93518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:28:02 devstack sudo[93518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:02 devstack sudo[93518]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c6daf009-f0eb-450f-9bcd-2b63a7666ffb tempest-AttachVolumeTestJSON-1055770325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.291s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:02 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-c6daf009-f0eb-450f-9bcd-2b63a7666ffb tempest-AttachVolumeTestJSON-1055770325 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:28:02 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-c6daf009-f0eb-450f-9bcd-2b63a7666ffb tempest-AttachVolumeTestJSON-1055770325 None] Deleted volume successfully. Nov 02 12:28:02 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c6daf009-f0eb-450f-9bcd-2b63a7666ffb tempest-AttachVolumeTestJSON-1055770325 None] Lock "cinder-30acd361-29dd-4a4e-af80-aecae3da25e5-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:28:03 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-a75c1f58-0e10-4c5b-aa89-4154659926fe tempest-GroupsV314Test-665331351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:28:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a75c1f58-0e10-4c5b-aa89-4154659926fe tempest-GroupsV314Test-665331351 None] Flow 'volume_create_manager' (82d64470-7d84-46a6-9072-b05e596cd61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:28:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a75c1f58-0e10-4c5b-aa89-4154659926fe tempest-GroupsV314Test-665331351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b46f883-3c1e-4da9-8df5-f3ad2ba5e329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a75c1f58-0e10-4c5b-aa89-4154659926fe tempest-GroupsV314Test-665331351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b46f883-3c1e-4da9-8df5-f3ad2ba5e329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1478782778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=056706ba-3321-4336-af23-5e77d1d65af4,host='devstack@QuobyteHD#QuobyteHD',id=2804a84c-18da-4f75-a5ec-a01ef6946756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d577c637244653be5e9e7e39bd4d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:28:04Z,use_quota=True,user_id='210730653fe84b1ba6d13ef1ccac8d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97a55b4b-bbe0-49eb-bce3-1124b78ceaaf),volume_type_id=97a55b4b-bbe0-49eb-bce3-1124b78ceaaf)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a75c1f58-0e10-4c5b-aa89-4154659926fe tempest-GroupsV314Test-665331351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1893052b-4f70-4264-870e-d4f53456f383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a75c1f58-0e10-4c5b-aa89-4154659926fe tempest-GroupsV314Test-665331351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1893052b-4f70-4264-870e-d4f53456f383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a75c1f58-0e10-4c5b-aa89-4154659926fe tempest-GroupsV314Test-665331351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a70b56ef-5e94-40c5-a831-3ab078ec42e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a75c1f58-0e10-4c5b-aa89-4154659926fe tempest-GroupsV314Test-665331351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a70b56ef-5e94-40c5-a831-3ab078ec42e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2804a84c-18da-4f75-a5ec-a01ef6946756', 'volume_name': 'volume-2804a84c-18da-4f75-a5ec-a01ef6946756', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a75c1f58-0e10-4c5b-aa89-4154659926fe tempest-GroupsV314Test-665331351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de83c5d7-dd18-4263-ad01-907154d4f927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a75c1f58-0e10-4c5b-aa89-4154659926fe tempest-GroupsV314Test-665331351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de83c5d7-dd18-4263-ad01-907154d4f927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a75c1f58-0e10-4c5b-aa89-4154659926fe tempest-GroupsV314Test-665331351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfffb2c6-bbd6-432d-9aa6-9f1ffb724141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:03 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-a75c1f58-0e10-4c5b-aa89-4154659926fe tempest-GroupsV314Test-665331351 None] Volume 2804a84c-18da-4f75-a5ec-a01ef6946756: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2804a84c-18da-4f75-a5ec-a01ef6946756', 'volume_size': 1} Nov 02 12:28:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a75c1f58-0e10-4c5b-aa89-4154659926fe tempest-GroupsV314Test-665331351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:28:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a75c1f58-0e10-4c5b-aa89-4154659926fe tempest-GroupsV314Test-665331351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:28:03 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a75c1f58-0e10-4c5b-aa89-4154659926fe tempest-GroupsV314Test-665331351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=056706ba-3321-4336-af23-5e77d1d65af4,created_at=2026-11-02T11:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1478782778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=056706ba-3321-4336-af23-5e77d1d65af4,host='devstack@QuobyteHD#QuobyteHD',id=2804a84c-18da-4f75-a5ec-a01ef6946756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37d577c637244653be5e9e7e39bd4d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:28:04Z,use_quota=True,user_id='210730653fe84b1ba6d13ef1ccac8d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97a55b4b-bbe0-49eb-bce3-1124b78ceaaf),volume_type_id=97a55b4b-bbe0-49eb-bce3-1124b78ceaaf)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:28:03 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-a75c1f58-0e10-4c5b-aa89-4154659926fe tempest-GroupsV314Test-665331351 None] Creating volume 2804a84c-18da-4f75-a5ec-a01ef6946756 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:28:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a75c1f58-0e10-4c5b-aa89-4154659926fe tempest-GroupsV314Test-665331351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:28:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a75c1f58-0e10-4c5b-aa89-4154659926fe tempest-GroupsV314Test-665331351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:28:03 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a75c1f58-0e10-4c5b-aa89-4154659926fe tempest-GroupsV314Test-665331351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:28:03 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a75c1f58-0e10-4c5b-aa89-4154659926fe tempest-GroupsV314Test-665331351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:28:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a75c1f58-0e10-4c5b-aa89-4154659926fe tempest-GroupsV314Test-665331351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:28:03 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a75c1f58-0e10-4c5b-aa89-4154659926fe tempest-GroupsV314Test-665331351 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:28:03 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-a75c1f58-0e10-4c5b-aa89-4154659926fe tempest-GroupsV314Test-665331351 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:28:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a75c1f58-0e10-4c5b-aa89-4154659926fe tempest-GroupsV314Test-665331351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:03 devstack sudo[93521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756 1073741824 Nov 02 12:28:03 devstack sudo[93521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:04 devstack sudo[93521]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a75c1f58-0e10-4c5b-aa89-4154659926fe tempest-GroupsV314Test-665331351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756 1073741824" returned: 0 in 0.658s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a75c1f58-0e10-4c5b-aa89-4154659926fe tempest-GroupsV314Test-665331351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:04 devstack sudo[93527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756 Nov 02 12:28:04 devstack sudo[93527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:04 devstack sudo[93527]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a75c1f58-0e10-4c5b-aa89-4154659926fe tempest-GroupsV314Test-665331351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756" returned: 0 in 0.359s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:04 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a75c1f58-0e10-4c5b-aa89-4154659926fe tempest-GroupsV314Test-665331351 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:28:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a75c1f58-0e10-4c5b-aa89-4154659926fe tempest-GroupsV314Test-665331351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:28:04 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a75c1f58-0e10-4c5b-aa89-4154659926fe tempest-GroupsV314Test-665331351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfffb2c6-bbd6-432d-9aa6-9f1ffb724141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2804a84c-18da-4f75-a5ec-a01ef6946756', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:04 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a75c1f58-0e10-4c5b-aa89-4154659926fe tempest-GroupsV314Test-665331351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd2edd73-dbab-4a33-845d-a1d834d8e3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:04 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-a75c1f58-0e10-4c5b-aa89-4154659926fe tempest-GroupsV314Test-665331351 None] Volume volume-2804a84c-18da-4f75-a5ec-a01ef6946756 (2804a84c-18da-4f75-a5ec-a01ef6946756): created successfully Nov 02 12:28:04 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a75c1f58-0e10-4c5b-aa89-4154659926fe tempest-GroupsV314Test-665331351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd2edd73-dbab-4a33-845d-a1d834d8e3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a75c1f58-0e10-4c5b-aa89-4154659926fe tempest-GroupsV314Test-665331351 None] Flow 'volume_create_manager' (82d64470-7d84-46a6-9072-b05e596cd61f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:28:05 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-a75c1f58-0e10-4c5b-aa89-4154659926fe tempest-GroupsV314Test-665331351 None] Created volume successfully. Nov 02 12:28:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:28:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:28:07 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Cloning volume 2804a84c-18da-4f75-a5ec-a01ef6946756 to volume 23754248-1ac8-4b8d-9415-94bb3152ae08 Nov 02 12:28:07 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Creating offline snapshot c05216e4-090c-41f0-b7aa-471f58e30051 of volume 2804a84c-18da-4f75-a5ec-a01ef6946756 {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:28:07 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[3421b6c4-abaa-4762-82a4-a0c408da152f]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:28:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:07 devstack sudo[93545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756 Nov 02 12:28:07 devstack sudo[93545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:07 devstack sudo[93545]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756" returned: 0 in 0.709s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756.c05216e4-090c-41f0-b7aa-471f58e30051 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:07 devstack sudo[93550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756.c05216e4-090c-41f0-b7aa-471f58e30051 1G Nov 02 12:28:07 devstack sudo[93550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:08 devstack sudo[93550]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756.c05216e4-090c-41f0-b7aa-471f58e30051 1G" returned: 0 in 0.753s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2804a84c-18da-4f75-a5ec-a01ef6946756 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756.c05216e4-090c-41f0-b7aa-471f58e30051 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:08 devstack sudo[93556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2804a84c-18da-4f75-a5ec-a01ef6946756 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756.c05216e4-090c-41f0-b7aa-471f58e30051 Nov 02 12:28:08 devstack sudo[93556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:09 devstack sudo[93556]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2804a84c-18da-4f75-a5ec-a01ef6946756 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756.c05216e4-090c-41f0-b7aa-471f58e30051" returned: 0 in 0.438s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:09 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756.c05216e4-090c-41f0-b7aa-471f58e30051 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 12:28:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756.c05216e4-090c-41f0-b7aa-471f58e30051 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:09 devstack sudo[93563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756.c05216e4-090c-41f0-b7aa-471f58e30051 Nov 02 12:28:09 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:09 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756.c05216e4-090c-41f0-b7aa-471f58e30051" returned: 0 in 0.410s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:09 devstack sudo[93566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756.info Nov 02 12:28:09 devstack sudo[93566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:09 devstack sudo[93566]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756.info" returned: 0 in 0.331s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:09 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 12:28:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:09 devstack sudo[93569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756.info Nov 02 12:28:09 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:10 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756.info" returned: 0 in 0.395s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:10 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Acquiring lock "cinder-quobyte-23754248-1ac8-4b8d-9415-94bb3152ae08" by "_copy_volume_from_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:28:10 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Lock "cinder-quobyte-23754248-1ac8-4b8d-9415-94bb3152ae08" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:28:10 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] snapshot: c05216e4-090c-41f0-b7aa-471f58e30051, volume: 23754248-1ac8-4b8d-9415-94bb3152ae08, {{(pid=86515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 12:28:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:28:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:28:10 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:28:10 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:28:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:28:10 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cf26c8-1cb1-458b-9bdf-42851c867bac]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:28:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756.c05216e4-090c-41f0-b7aa-471f58e30051 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:10 devstack sudo[93572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756.c05216e4-090c-41f0-b7aa-471f58e30051 Nov 02 12:28:10 devstack sudo[93572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:10 devstack sudo[93572]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756.c05216e4-090c-41f0-b7aa-471f58e30051" returned: 0 in 0.585s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:10 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2804a84c-18da-4f75-a5ec-a01ef6946756(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:28:10 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4ae39e-d601-47fa-a432-ec09fcf153ea]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:28:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:11 devstack sudo[93601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756 Nov 02 12:28:11 devstack sudo[93601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:11 devstack sudo[93601]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756" returned: 0 in 0.502s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:11 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] will copy from snapshot at /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756 {{(pid=86515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 12:28:11 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Creating direct copy from snapshot {{(pid=86515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 12:28:11 devstack cinder-volume[86515]: DEBUG cinder.utils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Path /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-23754248-1ac8-4b8d-9415-94bb3152ae08 not found in is_blk_device check {{(pid=86515) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 12:28:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-23754248-1ac8-4b8d-9415-94bb3152ae08 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:11 devstack sudo[93606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-23754248-1ac8-4b8d-9415-94bb3152ae08 Nov 02 12:28:11 devstack sudo[93606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:18 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-a81f26d2-4b96-48aa-ac6d-78ea3466663c tempest-VolumesTransfersV355Test-1516731093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:28:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a81f26d2-4b96-48aa-ac6d-78ea3466663c tempest-VolumesTransfersV355Test-1516731093 None] Flow 'volume_create_manager' (71d47d16-da14-486d-8115-c9ec60e62f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:28:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a81f26d2-4b96-48aa-ac6d-78ea3466663c tempest-VolumesTransfersV355Test-1516731093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56fa322e-c406-4988-b946-976ff9e72ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a81f26d2-4b96-48aa-ac6d-78ea3466663c tempest-VolumesTransfersV355Test-1516731093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56fa322e-c406-4988-b946-976ff9e72ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-70261714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d93b4b71-d371-4ebc-a0ea-596e86e8e371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965ed34ef1c546bc8b0fc1c04a81fdfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:28:19Z,use_quota=True,user_id='ecb752c3c4e1479196e994341b4ab4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a81f26d2-4b96-48aa-ac6d-78ea3466663c tempest-VolumesTransfersV355Test-1516731093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f3b19a-4fde-4b60-b876-0acbe7f7e55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a81f26d2-4b96-48aa-ac6d-78ea3466663c tempest-VolumesTransfersV355Test-1516731093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f3b19a-4fde-4b60-b876-0acbe7f7e55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a81f26d2-4b96-48aa-ac6d-78ea3466663c tempest-VolumesTransfersV355Test-1516731093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cc3c1b6-f926-440e-84b3-f79f2c132840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a81f26d2-4b96-48aa-ac6d-78ea3466663c tempest-VolumesTransfersV355Test-1516731093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cc3c1b6-f926-440e-84b3-f79f2c132840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd93b4b71-d371-4ebc-a0ea-596e86e8e371', 'volume_name': 'volume-d93b4b71-d371-4ebc-a0ea-596e86e8e371', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a81f26d2-4b96-48aa-ac6d-78ea3466663c tempest-VolumesTransfersV355Test-1516731093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17261358-486e-425f-881d-e7ea32bc7172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a81f26d2-4b96-48aa-ac6d-78ea3466663c tempest-VolumesTransfersV355Test-1516731093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17261358-486e-425f-881d-e7ea32bc7172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a81f26d2-4b96-48aa-ac6d-78ea3466663c tempest-VolumesTransfersV355Test-1516731093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59bef346-740a-4040-9d49-2e413376471f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:18 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-a81f26d2-4b96-48aa-ac6d-78ea3466663c tempest-VolumesTransfersV355Test-1516731093 None] Volume d93b4b71-d371-4ebc-a0ea-596e86e8e371: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d93b4b71-d371-4ebc-a0ea-596e86e8e371', 'volume_size': 1} Nov 02 12:28:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a81f26d2-4b96-48aa-ac6d-78ea3466663c tempest-VolumesTransfersV355Test-1516731093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:28:19 devstack sudo[93606]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-23754248-1ac8-4b8d-9415-94bb3152ae08" returned: 0 in 8.502s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:19 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Image conversion details: src /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756, size 1024.00 MB, duration 8.50 sec, destination /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-23754248-1ac8-4b8d-9415-94bb3152ae08 {{(pid=86515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 12:28:19 devstack cinder-volume[86515]: INFO cinder.image.image_utils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Converted 1024.00 MB image at 120.42 MB/s Nov 02 12:28:19 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-23754248-1ac8-4b8d-9415-94bb3152ae08 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 12:28:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-23754248-1ac8-4b8d-9415-94bb3152ae08 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:19 devstack sudo[93643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-23754248-1ac8-4b8d-9415-94bb3152ae08 Nov 02 12:28:19 devstack sudo[93643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:20 devstack sudo[93643]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-23754248-1ac8-4b8d-9415-94bb3152ae08" returned: 0 in 0.262s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:20 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Lock "cinder-quobyte-23754248-1ac8-4b8d-9415-94bb3152ae08" released by "_copy_volume_from_snapshot" :: held 9.964s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:28:20 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Acquiring lock "cinder-quobyte-c05216e4-090c-41f0-b7aa-471f58e30051" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:28:20 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Lock "cinder-quobyte-c05216e4-090c-41f0-b7aa-471f58e30051" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:28:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Deleting offline snapshot c05216e4-090c-41f0-b7aa-471f58e30051 of volume 2804a84c-18da-4f75-a5ec-a01ef6946756 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:28:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] snapshot_file for this snap is: volume-2804a84c-18da-4f75-a5ec-a01ef6946756.c05216e4-090c-41f0-b7aa-471f58e30051 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:28:20 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0ff604-e229-4d2f-b687-466430d1fbed]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:28:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756.c05216e4-090c-41f0-b7aa-471f58e30051 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:20 devstack sudo[93646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756.c05216e4-090c-41f0-b7aa-471f58e30051 Nov 02 12:28:20 devstack sudo[93646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:20 devstack sudo[93646]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756.c05216e4-090c-41f0-b7aa-471f58e30051" returned: 0 in 0.374s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2804a84c-18da-4f75-a5ec-a01ef6946756(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:28:20 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2b1828-db9a-4c60-ba4a-9829aa0054be]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:28:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:20 devstack sudo[93651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756 Nov 02 12:28:20 devstack sudo[93651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:21 devstack sudo[93651]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756" returned: 0 in 0.556s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756.c05216e4-090c-41f0-b7aa-471f58e30051 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:21 devstack sudo[93657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756.c05216e4-090c-41f0-b7aa-471f58e30051 Nov 02 12:28:21 devstack sudo[93657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:21 devstack sudo[93657]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756.c05216e4-090c-41f0-b7aa-471f58e30051" returned: 0 in 0.398s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756.c05216e4-090c-41f0-b7aa-471f58e30051 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:21 devstack sudo[93662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756.c05216e4-090c-41f0-b7aa-471f58e30051 Nov 02 12:28:21 devstack sudo[93662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:21 devstack sudo[93662]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756.c05216e4-090c-41f0-b7aa-471f58e30051" returned: 0 in 0.256s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:21 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Lock "cinder-quobyte-c05216e4-090c-41f0-b7aa-471f58e30051" released by "_delete_snapshot" :: held 1.709s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:28:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.975s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:28:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a81f26d2-4b96-48aa-ac6d-78ea3466663c tempest-VolumesTransfersV355Test-1516731093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.190s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:28:22 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a81f26d2-4b96-48aa-ac6d-78ea3466663c tempest-VolumesTransfersV355Test-1516731093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-70261714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d93b4b71-d371-4ebc-a0ea-596e86e8e371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965ed34ef1c546bc8b0fc1c04a81fdfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:28:19Z,use_quota=True,user_id='ecb752c3c4e1479196e994341b4ab4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:28:22 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-a81f26d2-4b96-48aa-ac6d-78ea3466663c tempest-VolumesTransfersV355Test-1516731093 None] Creating volume d93b4b71-d371-4ebc-a0ea-596e86e8e371 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:28:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a81f26d2-4b96-48aa-ac6d-78ea3466663c tempest-VolumesTransfersV355Test-1516731093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:28:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a81f26d2-4b96-48aa-ac6d-78ea3466663c tempest-VolumesTransfersV355Test-1516731093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:28:22 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a81f26d2-4b96-48aa-ac6d-78ea3466663c tempest-VolumesTransfersV355Test-1516731093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:28:22 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a81f26d2-4b96-48aa-ac6d-78ea3466663c tempest-VolumesTransfersV355Test-1516731093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:28:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a81f26d2-4b96-48aa-ac6d-78ea3466663c tempest-VolumesTransfersV355Test-1516731093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:28:22 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a81f26d2-4b96-48aa-ac6d-78ea3466663c tempest-VolumesTransfersV355Test-1516731093 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:28:22 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-a81f26d2-4b96-48aa-ac6d-78ea3466663c tempest-VolumesTransfersV355Test-1516731093 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:28:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a81f26d2-4b96-48aa-ac6d-78ea3466663c tempest-VolumesTransfersV355Test-1516731093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d93b4b71-d371-4ebc-a0ea-596e86e8e371 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:22 devstack sudo[93667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d93b4b71-d371-4ebc-a0ea-596e86e8e371 1073741824 Nov 02 12:28:22 devstack sudo[93667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:22 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-71ba4e75-805e-4782-8b2c-338cdc65fe01 tempest-GroupsV314Test-665331351 None] Create group from source-group-056706ba-3321-4336-af23-5e77d1d65af4 completed successfully. Nov 02 12:28:22 devstack sudo[93667]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a81f26d2-4b96-48aa-ac6d-78ea3466663c tempest-VolumesTransfersV355Test-1516731093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d93b4b71-d371-4ebc-a0ea-596e86e8e371 1073741824" returned: 0 in 0.555s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a81f26d2-4b96-48aa-ac6d-78ea3466663c tempest-VolumesTransfersV355Test-1516731093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d93b4b71-d371-4ebc-a0ea-596e86e8e371 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:22 devstack sudo[93674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d93b4b71-d371-4ebc-a0ea-596e86e8e371 Nov 02 12:28:22 devstack sudo[93674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:22 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-332fc513-548e-4640-8ade-e2979da69547 tempest-GroupsV314Test-665331351 None] Acquiring lock "cinder-quobyte-23754248-1ac8-4b8d-9415-94bb3152ae08" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:28:22 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-332fc513-548e-4640-8ade-e2979da69547 tempest-GroupsV314Test-665331351 None] Lock "cinder-quobyte-23754248-1ac8-4b8d-9415-94bb3152ae08" acquired by "delete_volume" :: waited 0.019s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:28:22 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff290e1-b071-4fa9-a10d-558a139f11c5]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:28:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-332fc513-548e-4640-8ade-e2979da69547 tempest-GroupsV314Test-665331351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-23754248-1ac8-4b8d-9415-94bb3152ae08 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:22 devstack sudo[93674]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a81f26d2-4b96-48aa-ac6d-78ea3466663c tempest-VolumesTransfersV355Test-1516731093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d93b4b71-d371-4ebc-a0ea-596e86e8e371" returned: 0 in 0.356s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:22 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a81f26d2-4b96-48aa-ac6d-78ea3466663c tempest-VolumesTransfersV355Test-1516731093 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:28:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a81f26d2-4b96-48aa-ac6d-78ea3466663c tempest-VolumesTransfersV355Test-1516731093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:28:23 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a81f26d2-4b96-48aa-ac6d-78ea3466663c tempest-VolumesTransfersV355Test-1516731093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59bef346-740a-4040-9d49-2e413376471f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d93b4b71-d371-4ebc-a0ea-596e86e8e371', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:23 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a81f26d2-4b96-48aa-ac6d-78ea3466663c tempest-VolumesTransfersV355Test-1516731093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98b80306-49da-4ae0-84c2-84e4234ef7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:23 devstack sudo[93676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-23754248-1ac8-4b8d-9415-94bb3152ae08 Nov 02 12:28:23 devstack sudo[93676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:23 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-a81f26d2-4b96-48aa-ac6d-78ea3466663c tempest-VolumesTransfersV355Test-1516731093 None] Volume volume-d93b4b71-d371-4ebc-a0ea-596e86e8e371 (d93b4b71-d371-4ebc-a0ea-596e86e8e371): created successfully Nov 02 12:28:23 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a81f26d2-4b96-48aa-ac6d-78ea3466663c tempest-VolumesTransfersV355Test-1516731093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98b80306-49da-4ae0-84c2-84e4234ef7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:23 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a81f26d2-4b96-48aa-ac6d-78ea3466663c tempest-VolumesTransfersV355Test-1516731093 None] Flow 'volume_create_manager' (71d47d16-da14-486d-8115-c9ec60e62f57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:28:23 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-a81f26d2-4b96-48aa-ac6d-78ea3466663c tempest-VolumesTransfersV355Test-1516731093 None] Created volume successfully. Nov 02 12:28:23 devstack sudo[93676]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-332fc513-548e-4640-8ade-e2979da69547 tempest-GroupsV314Test-665331351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-23754248-1ac8-4b8d-9415-94bb3152ae08" returned: 0 in 0.464s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-332fc513-548e-4640-8ade-e2979da69547 tempest-GroupsV314Test-665331351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-23754248-1ac8-4b8d-9415-94bb3152ae08 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:23 devstack sudo[93682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-23754248-1ac8-4b8d-9415-94bb3152ae08 Nov 02 12:28:23 devstack sudo[93682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:23 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-610b044d-d7cf-46fc-b3e8-2f835d74978a req-b09dffd7-c811-4119-9c98-bba5673b9e5c tempest-ServerActionsTestOtherA-618205716 None] Terminate volume connection completed successfully. Nov 02 12:28:23 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-610b044d-d7cf-46fc-b3e8-2f835d74978a req-b09dffd7-c811-4119-9c98-bba5673b9e5c tempest-ServerActionsTestOtherA-618205716 None] Deleting attachment fced60b6-c5d6-46be-842c-36c3fe139d22. {{(pid=86515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:28:23 devstack sudo[93682]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-332fc513-548e-4640-8ade-e2979da69547 tempest-GroupsV314Test-665331351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-23754248-1ac8-4b8d-9415-94bb3152ae08" returned: 0 in 0.349s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:23 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-332fc513-548e-4640-8ade-e2979da69547 tempest-GroupsV314Test-665331351 None] Lock "cinder-quobyte-23754248-1ac8-4b8d-9415-94bb3152ae08" released by "delete_volume" :: held 0.879s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:28:23 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-332fc513-548e-4640-8ade-e2979da69547 tempest-GroupsV314Test-665331351 None] Created reservations ['8141edc8-67c6-4047-9335-e0dcba9d0faf'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:28:23 devstack cinder-volume[86515]: WARNING cinder.quota [None req-332fc513-548e-4640-8ade-e2979da69547 tempest-GroupsV314Test-665331351 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1549152795 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1549152795, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:28:23 devstack cinder-volume[86515]: WARNING cinder.quota [None req-332fc513-548e-4640-8ade-e2979da69547 tempest-GroupsV314Test-665331351 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1549152795 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1549152795, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:28:23 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-332fc513-548e-4640-8ade-e2979da69547 tempest-GroupsV314Test-665331351 None] Created reservations ['d6b1e539-6738-4efe-84a1-9e69403ee006', '26af77ca-e568-44be-862b-6f34f1b0affd', 'c17cf46f-53af-45f2-aa4e-38860dae4f28', 'e5c51bad-95c9-4139-8ecc-5f16bb6dc2f5'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:28:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-332fc513-548e-4640-8ade-e2979da69547 tempest-GroupsV314Test-665331351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:28:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-332fc513-548e-4640-8ade-e2979da69547 tempest-GroupsV314Test-665331351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:28:23 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-332fc513-548e-4640-8ade-e2979da69547 tempest-GroupsV314Test-665331351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:28:23 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-332fc513-548e-4640-8ade-e2979da69547 tempest-GroupsV314Test-665331351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:28:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-332fc513-548e-4640-8ade-e2979da69547 tempest-GroupsV314Test-665331351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:28:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-332fc513-548e-4640-8ade-e2979da69547 tempest-GroupsV314Test-665331351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:24 devstack sudo[93688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:28:24 devstack sudo[93688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:24 devstack sudo[93688]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-332fc513-548e-4640-8ade-e2979da69547 tempest-GroupsV314Test-665331351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.425s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:24 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-332fc513-548e-4640-8ade-e2979da69547 tempest-GroupsV314Test-665331351 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:28:24 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-332fc513-548e-4640-8ade-e2979da69547 tempest-GroupsV314Test-665331351 None] Delete group completed successfully. Nov 02 12:28:24 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b12cdd9b-a4b2-4bd7-bfd5-f19b4acedc24 tempest-GroupsV314Test-665331351 None] Acquiring lock "cinder-quobyte-2804a84c-18da-4f75-a5ec-a01ef6946756" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:28:24 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b12cdd9b-a4b2-4bd7-bfd5-f19b4acedc24 tempest-GroupsV314Test-665331351 None] Lock "cinder-quobyte-2804a84c-18da-4f75-a5ec-a01ef6946756" acquired by "delete_volume" :: waited 0.036s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:28:24 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f94c7b4-2b31-4dc8-ac68-35c1578152c7]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:28:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b12cdd9b-a4b2-4bd7-bfd5-f19b4acedc24 tempest-GroupsV314Test-665331351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:24 devstack sudo[93702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756 Nov 02 12:28:24 devstack sudo[93702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:25 devstack sudo[93702]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b12cdd9b-a4b2-4bd7-bfd5-f19b4acedc24 tempest-GroupsV314Test-665331351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756" returned: 0 in 0.547s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b12cdd9b-a4b2-4bd7-bfd5-f19b4acedc24 tempest-GroupsV314Test-665331351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:25 devstack sudo[93719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756 Nov 02 12:28:25 devstack sudo[93719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:25 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-66214ce5-9183-4ab2-8b9d-a0fa7232bda9 tempest-VolumesTransfersV355Test-1090932619 None] Transfer volume completed successfully. Nov 02 12:28:25 devstack sudo[93719]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b12cdd9b-a4b2-4bd7-bfd5-f19b4acedc24 tempest-GroupsV314Test-665331351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2804a84c-18da-4f75-a5ec-a01ef6946756" returned: 0 in 0.384s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:25 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b12cdd9b-a4b2-4bd7-bfd5-f19b4acedc24 tempest-GroupsV314Test-665331351 None] Lock "cinder-quobyte-2804a84c-18da-4f75-a5ec-a01ef6946756" released by "delete_volume" :: held 1.107s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:28:25 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-b12cdd9b-a4b2-4bd7-bfd5-f19b4acedc24 tempest-GroupsV314Test-665331351 None] Created reservations ['dc5fc3a5-9d28-4951-94c9-39c0af90ecfc'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:28:25 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-b12cdd9b-a4b2-4bd7-bfd5-f19b4acedc24 tempest-GroupsV314Test-665331351 None] Created reservations ['40de171f-0047-41c1-80e2-5008e6b05237', '2bd39b80-1c9a-43d3-a351-a52f3886d961', '218452e5-e2b7-4709-98c8-43bbcb11eac3', '22ca5ab4-e03b-457d-9d11-29d4b2802122'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:28:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b12cdd9b-a4b2-4bd7-bfd5-f19b4acedc24 tempest-GroupsV314Test-665331351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:28:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b12cdd9b-a4b2-4bd7-bfd5-f19b4acedc24 tempest-GroupsV314Test-665331351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:28:26 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b12cdd9b-a4b2-4bd7-bfd5-f19b4acedc24 tempest-GroupsV314Test-665331351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:28:26 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b12cdd9b-a4b2-4bd7-bfd5-f19b4acedc24 tempest-GroupsV314Test-665331351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:28:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b12cdd9b-a4b2-4bd7-bfd5-f19b4acedc24 tempest-GroupsV314Test-665331351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:28:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b12cdd9b-a4b2-4bd7-bfd5-f19b4acedc24 tempest-GroupsV314Test-665331351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:26 devstack sudo[93724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:28:26 devstack sudo[93724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:26 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-bc17cf63-c419-4fa7-b00b-4e748baaab20 tempest-VolumesTransfersV355Test-174241471 None] Acquiring lock "cinder-d93b4b71-d371-4ebc-a0ea-596e86e8e371-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:28:26 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-bc17cf63-c419-4fa7-b00b-4e748baaab20 tempest-VolumesTransfersV355Test-174241471 None] Lock "cinder-d93b4b71-d371-4ebc-a0ea-596e86e8e371-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:28:26 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-bc17cf63-c419-4fa7-b00b-4e748baaab20 tempest-VolumesTransfersV355Test-174241471 None] Acquiring lock "cinder-quobyte-d93b4b71-d371-4ebc-a0ea-596e86e8e371" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:28:26 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-bc17cf63-c419-4fa7-b00b-4e748baaab20 tempest-VolumesTransfersV355Test-174241471 None] Lock "cinder-quobyte-d93b4b71-d371-4ebc-a0ea-596e86e8e371" acquired by "delete_volume" :: waited 0.020s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:28:26 devstack sudo[93724]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b12cdd9b-a4b2-4bd7-bfd5-f19b4acedc24 tempest-GroupsV314Test-665331351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.299s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:26 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-b12cdd9b-a4b2-4bd7-bfd5-f19b4acedc24 tempest-GroupsV314Test-665331351 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:28:26 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-b12cdd9b-a4b2-4bd7-bfd5-f19b4acedc24 tempest-GroupsV314Test-665331351 None] Delete group completed successfully. Nov 02 12:28:26 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cefa028-f46f-4bf0-98ea-ae07727e2e27]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:28:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bc17cf63-c419-4fa7-b00b-4e748baaab20 tempest-VolumesTransfersV355Test-174241471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d93b4b71-d371-4ebc-a0ea-596e86e8e371 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:26 devstack sudo[93727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d93b4b71-d371-4ebc-a0ea-596e86e8e371 Nov 02 12:28:26 devstack sudo[93727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:26 devstack sudo[93727]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bc17cf63-c419-4fa7-b00b-4e748baaab20 tempest-VolumesTransfersV355Test-174241471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d93b4b71-d371-4ebc-a0ea-596e86e8e371" returned: 0 in 0.359s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bc17cf63-c419-4fa7-b00b-4e748baaab20 tempest-VolumesTransfersV355Test-174241471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d93b4b71-d371-4ebc-a0ea-596e86e8e371 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:26 devstack sudo[93732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d93b4b71-d371-4ebc-a0ea-596e86e8e371 Nov 02 12:28:26 devstack sudo[93732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:27 devstack sudo[93732]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bc17cf63-c419-4fa7-b00b-4e748baaab20 tempest-VolumesTransfersV355Test-174241471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d93b4b71-d371-4ebc-a0ea-596e86e8e371" returned: 0 in 0.274s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:27 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-bc17cf63-c419-4fa7-b00b-4e748baaab20 tempest-VolumesTransfersV355Test-174241471 None] Lock "cinder-quobyte-d93b4b71-d371-4ebc-a0ea-596e86e8e371" released by "delete_volume" :: held 0.695s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:28:27 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-bc17cf63-c419-4fa7-b00b-4e748baaab20 tempest-VolumesTransfersV355Test-174241471 None] Created reservations ['73fe2e7e-bdb6-4313-94db-9cab5d065d2d', '6bab28dd-16c0-496b-a947-d1718b5c12e8', '75767ca2-bf19-4ee2-8c94-a0ed72e23311', '653935ff-291b-401c-8e88-980a534295a0'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:28:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-bc17cf63-c419-4fa7-b00b-4e748baaab20 tempest-VolumesTransfersV355Test-174241471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:28:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-bc17cf63-c419-4fa7-b00b-4e748baaab20 tempest-VolumesTransfersV355Test-174241471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:28:27 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-bc17cf63-c419-4fa7-b00b-4e748baaab20 tempest-VolumesTransfersV355Test-174241471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:28:27 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-bc17cf63-c419-4fa7-b00b-4e748baaab20 tempest-VolumesTransfersV355Test-174241471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:28:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-bc17cf63-c419-4fa7-b00b-4e748baaab20 tempest-VolumesTransfersV355Test-174241471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:28:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bc17cf63-c419-4fa7-b00b-4e748baaab20 tempest-VolumesTransfersV355Test-174241471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:27 devstack sudo[93736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:28:27 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:27 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bc17cf63-c419-4fa7-b00b-4e748baaab20 tempest-VolumesTransfersV355Test-174241471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.412s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:27 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-bc17cf63-c419-4fa7-b00b-4e748baaab20 tempest-VolumesTransfersV355Test-174241471 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:28:27 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-bc17cf63-c419-4fa7-b00b-4e748baaab20 tempest-VolumesTransfersV355Test-174241471 None] Deleted volume successfully. Nov 02 12:28:27 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-bc17cf63-c419-4fa7-b00b-4e748baaab20 tempest-VolumesTransfersV355Test-174241471 None] Lock "cinder-d93b4b71-d371-4ebc-a0ea-596e86e8e371-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:28:28 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f08facc-17ad-4b41-b98f-14786808a630 tempest-VolumesTransfersV355Test-1516731093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:28:28 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-9f08facc-17ad-4b41-b98f-14786808a630 tempest-VolumesTransfersV355Test-1516731093 None] Flow 'volume_create_manager' (258e57b4-b628-4e81-8305-52a71bf04133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:28:28 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-9f08facc-17ad-4b41-b98f-14786808a630 tempest-VolumesTransfersV355Test-1516731093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8991b4b-8c68-4558-8752-7ab9bc1564ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:28 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-9f08facc-17ad-4b41-b98f-14786808a630 tempest-VolumesTransfersV355Test-1516731093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8991b4b-8c68-4558-8752-7ab9bc1564ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1289324256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54fe5566-c0c3-4adf-aae7-81312443c7c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965ed34ef1c546bc8b0fc1c04a81fdfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:28:28Z,use_quota=True,user_id='ecb752c3c4e1479196e994341b4ab4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:28 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-9f08facc-17ad-4b41-b98f-14786808a630 tempest-VolumesTransfersV355Test-1516731093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9975c7b-b183-47f5-8449-392479f1ba54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:28 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-9f08facc-17ad-4b41-b98f-14786808a630 tempest-VolumesTransfersV355Test-1516731093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9975c7b-b183-47f5-8449-392479f1ba54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:28 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-9f08facc-17ad-4b41-b98f-14786808a630 tempest-VolumesTransfersV355Test-1516731093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2acd85f7-2db5-44d8-808f-4af187361550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:28 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-9f08facc-17ad-4b41-b98f-14786808a630 tempest-VolumesTransfersV355Test-1516731093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2acd85f7-2db5-44d8-808f-4af187361550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54fe5566-c0c3-4adf-aae7-81312443c7c5', 'volume_name': 'volume-54fe5566-c0c3-4adf-aae7-81312443c7c5', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:28 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-9f08facc-17ad-4b41-b98f-14786808a630 tempest-VolumesTransfersV355Test-1516731093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de847df9-d362-4d61-bf64-28ed3342e3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:28 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-9f08facc-17ad-4b41-b98f-14786808a630 tempest-VolumesTransfersV355Test-1516731093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de847df9-d362-4d61-bf64-28ed3342e3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:28 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-9f08facc-17ad-4b41-b98f-14786808a630 tempest-VolumesTransfersV355Test-1516731093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71a0e8d8-a4b2-45db-a566-d1e1bc2fdfc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:28 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-9f08facc-17ad-4b41-b98f-14786808a630 tempest-VolumesTransfersV355Test-1516731093 None] Volume 54fe5566-c0c3-4adf-aae7-81312443c7c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54fe5566-c0c3-4adf-aae7-81312443c7c5', 'volume_size': 1} Nov 02 12:28:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-9f08facc-17ad-4b41-b98f-14786808a630 tempest-VolumesTransfersV355Test-1516731093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:28:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-9f08facc-17ad-4b41-b98f-14786808a630 tempest-VolumesTransfersV355Test-1516731093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:28:28 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-9f08facc-17ad-4b41-b98f-14786808a630 tempest-VolumesTransfersV355Test-1516731093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1289324256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54fe5566-c0c3-4adf-aae7-81312443c7c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='965ed34ef1c546bc8b0fc1c04a81fdfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:28:28Z,use_quota=True,user_id='ecb752c3c4e1479196e994341b4ab4bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:28:28 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-9f08facc-17ad-4b41-b98f-14786808a630 tempest-VolumesTransfersV355Test-1516731093 None] Creating volume 54fe5566-c0c3-4adf-aae7-81312443c7c5 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:28:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-9f08facc-17ad-4b41-b98f-14786808a630 tempest-VolumesTransfersV355Test-1516731093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:28:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-9f08facc-17ad-4b41-b98f-14786808a630 tempest-VolumesTransfersV355Test-1516731093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:28:28 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-9f08facc-17ad-4b41-b98f-14786808a630 tempest-VolumesTransfersV355Test-1516731093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:28:28 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-9f08facc-17ad-4b41-b98f-14786808a630 tempest-VolumesTransfersV355Test-1516731093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:28:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-9f08facc-17ad-4b41-b98f-14786808a630 tempest-VolumesTransfersV355Test-1516731093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:28:28 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-9f08facc-17ad-4b41-b98f-14786808a630 tempest-VolumesTransfersV355Test-1516731093 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:28:28 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-9f08facc-17ad-4b41-b98f-14786808a630 tempest-VolumesTransfersV355Test-1516731093 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:28:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9f08facc-17ad-4b41-b98f-14786808a630 tempest-VolumesTransfersV355Test-1516731093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-54fe5566-c0c3-4adf-aae7-81312443c7c5 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:28 devstack sudo[93740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-54fe5566-c0c3-4adf-aae7-81312443c7c5 1073741824 Nov 02 12:28:28 devstack sudo[93740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:29 devstack sudo[93740]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9f08facc-17ad-4b41-b98f-14786808a630 tempest-VolumesTransfersV355Test-1516731093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-54fe5566-c0c3-4adf-aae7-81312443c7c5 1073741824" returned: 0 in 0.624s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9f08facc-17ad-4b41-b98f-14786808a630 tempest-VolumesTransfersV355Test-1516731093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-54fe5566-c0c3-4adf-aae7-81312443c7c5 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:29 devstack sudo[93748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-54fe5566-c0c3-4adf-aae7-81312443c7c5 Nov 02 12:28:29 devstack sudo[93748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:29 devstack sudo[93748]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9f08facc-17ad-4b41-b98f-14786808a630 tempest-VolumesTransfersV355Test-1516731093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-54fe5566-c0c3-4adf-aae7-81312443c7c5" returned: 0 in 0.450s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:29 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-9f08facc-17ad-4b41-b98f-14786808a630 tempest-VolumesTransfersV355Test-1516731093 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:28:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-9f08facc-17ad-4b41-b98f-14786808a630 tempest-VolumesTransfersV355Test-1516731093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:28:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-9f08facc-17ad-4b41-b98f-14786808a630 tempest-VolumesTransfersV355Test-1516731093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71a0e8d8-a4b2-45db-a566-d1e1bc2fdfc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54fe5566-c0c3-4adf-aae7-81312443c7c5', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-9f08facc-17ad-4b41-b98f-14786808a630 tempest-VolumesTransfersV355Test-1516731093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32380b17-5a58-425f-9c8a-57eb6cb083b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:29 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-9f08facc-17ad-4b41-b98f-14786808a630 tempest-VolumesTransfersV355Test-1516731093 None] Volume volume-54fe5566-c0c3-4adf-aae7-81312443c7c5 (54fe5566-c0c3-4adf-aae7-81312443c7c5): created successfully Nov 02 12:28:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-9f08facc-17ad-4b41-b98f-14786808a630 tempest-VolumesTransfersV355Test-1516731093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32380b17-5a58-425f-9c8a-57eb6cb083b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-9f08facc-17ad-4b41-b98f-14786808a630 tempest-VolumesTransfersV355Test-1516731093 None] Flow 'volume_create_manager' (258e57b4-b628-4e81-8305-52a71bf04133) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:28:29 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-9f08facc-17ad-4b41-b98f-14786808a630 tempest-VolumesTransfersV355Test-1516731093 None] Created volume successfully. Nov 02 12:28:30 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9be44cbb-32f0-446f-a2a1-10f2e4e4ef70 tempest-VolumesTransfersV355Test-174241471 None] Acquiring lock "cinder-54fe5566-c0c3-4adf-aae7-81312443c7c5-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:28:30 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9be44cbb-32f0-446f-a2a1-10f2e4e4ef70 tempest-VolumesTransfersV355Test-174241471 None] Lock "cinder-54fe5566-c0c3-4adf-aae7-81312443c7c5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:28:30 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9be44cbb-32f0-446f-a2a1-10f2e4e4ef70 tempest-VolumesTransfersV355Test-174241471 None] Acquiring lock "cinder-quobyte-54fe5566-c0c3-4adf-aae7-81312443c7c5" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:28:30 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9be44cbb-32f0-446f-a2a1-10f2e4e4ef70 tempest-VolumesTransfersV355Test-174241471 None] Lock "cinder-quobyte-54fe5566-c0c3-4adf-aae7-81312443c7c5" acquired by "delete_volume" :: waited 0.023s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:28:30 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03cf9ac-d54c-4059-99a7-f8a8d19c78d4]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:28:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9be44cbb-32f0-446f-a2a1-10f2e4e4ef70 tempest-VolumesTransfersV355Test-174241471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-54fe5566-c0c3-4adf-aae7-81312443c7c5 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:31 devstack sudo[93752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-54fe5566-c0c3-4adf-aae7-81312443c7c5 Nov 02 12:28:31 devstack sudo[93752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:31 devstack sudo[93752]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9be44cbb-32f0-446f-a2a1-10f2e4e4ef70 tempest-VolumesTransfersV355Test-174241471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-54fe5566-c0c3-4adf-aae7-81312443c7c5" returned: 0 in 0.553s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9be44cbb-32f0-446f-a2a1-10f2e4e4ef70 tempest-VolumesTransfersV355Test-174241471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-54fe5566-c0c3-4adf-aae7-81312443c7c5 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:31 devstack sudo[93758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-54fe5566-c0c3-4adf-aae7-81312443c7c5 Nov 02 12:28:31 devstack sudo[93758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:31 devstack sudo[93758]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9be44cbb-32f0-446f-a2a1-10f2e4e4ef70 tempest-VolumesTransfersV355Test-174241471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-54fe5566-c0c3-4adf-aae7-81312443c7c5" returned: 0 in 0.427s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9be44cbb-32f0-446f-a2a1-10f2e4e4ef70 tempest-VolumesTransfersV355Test-174241471 None] Lock "cinder-quobyte-54fe5566-c0c3-4adf-aae7-81312443c7c5" released by "delete_volume" :: held 1.059s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:28:32 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-9be44cbb-32f0-446f-a2a1-10f2e4e4ef70 tempest-VolumesTransfersV355Test-174241471 None] Created reservations ['fae2e432-2122-4db9-a74b-97d444153e48', '19d3636d-c8c0-4f80-a2c5-6b3336f19caa', '4772439e-872d-445d-b2c7-bf929fcd8cb2', '861bbdcf-eeb3-4d5a-8790-59cbc5f63ec2'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:28:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-9be44cbb-32f0-446f-a2a1-10f2e4e4ef70 tempest-VolumesTransfersV355Test-174241471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:28:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-9be44cbb-32f0-446f-a2a1-10f2e4e4ef70 tempest-VolumesTransfersV355Test-174241471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:28:32 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-9be44cbb-32f0-446f-a2a1-10f2e4e4ef70 tempest-VolumesTransfersV355Test-174241471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:28:32 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-9be44cbb-32f0-446f-a2a1-10f2e4e4ef70 tempest-VolumesTransfersV355Test-174241471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:28:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-9be44cbb-32f0-446f-a2a1-10f2e4e4ef70 tempest-VolumesTransfersV355Test-174241471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:28:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9be44cbb-32f0-446f-a2a1-10f2e4e4ef70 tempest-VolumesTransfersV355Test-174241471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:32 devstack sudo[93761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:28:32 devstack sudo[93761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:32 devstack sudo[93761]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9be44cbb-32f0-446f-a2a1-10f2e4e4ef70 tempest-VolumesTransfersV355Test-174241471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.279s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:32 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-9be44cbb-32f0-446f-a2a1-10f2e4e4ef70 tempest-VolumesTransfersV355Test-174241471 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:28:32 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-9be44cbb-32f0-446f-a2a1-10f2e4e4ef70 tempest-VolumesTransfersV355Test-174241471 None] Deleted volume successfully. Nov 02 12:28:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9be44cbb-32f0-446f-a2a1-10f2e4e4ef70 tempest-VolumesTransfersV355Test-174241471 None] Lock "cinder-54fe5566-c0c3-4adf-aae7-81312443c7c5-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:28:32 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:28:32 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Flow 'volume_create_manager' (527a7e2e-6b99-418b-a1b8-d2adb95a98bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:28:32 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d60a42e3-84cd-4b14-a3d5-695cd958aae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:32 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d60a42e3-84cd-4b14-a3d5-695cd958aae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-329020262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dab32c4f-0a42-4330-9a05-0d6ec70f2441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c704877a3edb4a9281410edc16ee6bc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:28:33Z,use_quota=True,user_id='5473d145237447cabc808f954175afbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:32 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1c85d05-4812-4cfa-bbea-b685c15cf771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:32 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1c85d05-4812-4cfa-bbea-b685c15cf771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:32 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef6520df-e54e-4a2a-80b3-7fcabcbbcd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:32 devstack cinder-volume[86515]: DEBUG cinder.image.glance [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Creating Keystone auth plugin from conf {{(pid=86515) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 12:28:33 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cb008f8-52c8-49ea-b65b-ea88acfb9d22 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:28:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4cb008f8-52c8-49ea-b65b-ea88acfb9d22 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Flow 'volume_create_manager' (6c6147cc-6149-4729-ab5f-db9ae48df3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:28:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4cb008f8-52c8-49ea-b65b-ea88acfb9d22 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43705a98-094f-4cdf-8993-13760dbc3ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4cb008f8-52c8-49ea-b65b-ea88acfb9d22 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43705a98-094f-4cdf-8993-13760dbc3ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1827812763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44022ac3-3c79-4422-bce9-db7539c6ca39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dbdf140e2a34abdb3fcb2c9cdae67ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:28:34Z,use_quota=True,user_id='68544c20d7cb4532b35a6d77336634a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c7d278b-f826-4a97-9111-c6eb2d47c631),volume_type_id=3c7d278b-f826-4a97-9111-c6eb2d47c631)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4cb008f8-52c8-49ea-b65b-ea88acfb9d22 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b18b5fca-74c0-42be-9a04-10f95e5aed68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4cb008f8-52c8-49ea-b65b-ea88acfb9d22 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b18b5fca-74c0-42be-9a04-10f95e5aed68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4cb008f8-52c8-49ea-b65b-ea88acfb9d22 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7465c58-3ea0-4389-99ce-2fe736da8177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4cb008f8-52c8-49ea-b65b-ea88acfb9d22 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7465c58-3ea0-4389-99ce-2fe736da8177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44022ac3-3c79-4422-bce9-db7539c6ca39', 'volume_name': 'volume-44022ac3-3c79-4422-bce9-db7539c6ca39', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4cb008f8-52c8-49ea-b65b-ea88acfb9d22 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfecc888-7fb1-4c68-8f85-497a768f6aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4cb008f8-52c8-49ea-b65b-ea88acfb9d22 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfecc888-7fb1-4c68-8f85-497a768f6aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4cb008f8-52c8-49ea-b65b-ea88acfb9d22 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (778e06cc-6aad-42c1-9731-f9d6554aa219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:33 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-4cb008f8-52c8-49ea-b65b-ea88acfb9d22 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Volume 44022ac3-3c79-4422-bce9-db7539c6ca39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44022ac3-3c79-4422-bce9-db7539c6ca39', 'volume_size': 1} Nov 02 12:28:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4cb008f8-52c8-49ea-b65b-ea88acfb9d22 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:28:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4cb008f8-52c8-49ea-b65b-ea88acfb9d22 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:28:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-4cb008f8-52c8-49ea-b65b-ea88acfb9d22 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1827812763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44022ac3-3c79-4422-bce9-db7539c6ca39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dbdf140e2a34abdb3fcb2c9cdae67ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:28:34Z,use_quota=True,user_id='68544c20d7cb4532b35a6d77336634a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c7d278b-f826-4a97-9111-c6eb2d47c631),volume_type_id=3c7d278b-f826-4a97-9111-c6eb2d47c631)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:28:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-4cb008f8-52c8-49ea-b65b-ea88acfb9d22 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Creating volume 44022ac3-3c79-4422-bce9-db7539c6ca39 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:28:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4cb008f8-52c8-49ea-b65b-ea88acfb9d22 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:28:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4cb008f8-52c8-49ea-b65b-ea88acfb9d22 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:28:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-4cb008f8-52c8-49ea-b65b-ea88acfb9d22 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:28:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-4cb008f8-52c8-49ea-b65b-ea88acfb9d22 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:28:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4cb008f8-52c8-49ea-b65b-ea88acfb9d22 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:28:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-4cb008f8-52c8-49ea-b65b-ea88acfb9d22 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:28:33 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-4cb008f8-52c8-49ea-b65b-ea88acfb9d22 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:28:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4cb008f8-52c8-49ea-b65b-ea88acfb9d22 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-44022ac3-3c79-4422-bce9-db7539c6ca39 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:33 devstack sudo[93764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-44022ac3-3c79-4422-bce9-db7539c6ca39 1073741824 Nov 02 12:28:33 devstack sudo[93764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:34 devstack sudo[93764]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4cb008f8-52c8-49ea-b65b-ea88acfb9d22 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-44022ac3-3c79-4422-bce9-db7539c6ca39 1073741824" returned: 0 in 0.560s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4cb008f8-52c8-49ea-b65b-ea88acfb9d22 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-44022ac3-3c79-4422-bce9-db7539c6ca39 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:34 devstack sudo[93782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-44022ac3-3c79-4422-bce9-db7539c6ca39 Nov 02 12:28:34 devstack sudo[93782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef6520df-e54e-4a2a-80b3-7fcabcbbcd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dab32c4f-0a42-4330-9a05-0d6ec70f2441', 'volume_name': 'volume-dab32c4f-0a42-4330-9a05-0d6ec70f2441', 'volume_size': 1, 'image_id': '4d531188-e398-41fe-8056-e52aa8e7c4ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d531188-e398-41fe-8056-e52aa8e7c4ab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ea64174531846a688f10d8f38a757ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d531188-e398-41fe-8056-e52aa8e7c4ab', 'created_at': datetime.datetime(2026, 11, 2, 11, 16, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 16, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d531188-e398-41fe-8056-e52aa8e7c4ab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3d46983-5071-42f7-9c56-f2f447b8ba77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3d46983-5071-42f7-9c56-f2f447b8ba77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c1cef81-6f2d-497b-9284-0e27fdb08cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:34 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Volume dab32c4f-0a42-4330-9a05-0d6ec70f2441: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dab32c4f-0a42-4330-9a05-0d6ec70f2441', 'volume_size': 1, 'image_id': '4d531188-e398-41fe-8056-e52aa8e7c4ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d531188-e398-41fe-8056-e52aa8e7c4ab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ea64174531846a688f10d8f38a757ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d531188-e398-41fe-8056-e52aa8e7c4ab', 'created_at': datetime.datetime(2026, 11, 2, 11, 16, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 16, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d531188-e398-41fe-8056-e52aa8e7c4ab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 12:28:34 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Trying to clone dab32c4f-0a42-4330-9a05-0d6ec70f2441 from image 4d531188-e398-41fe-8056-e52aa8e7c4ab at location (None, [{'url': 'file:///opt/stack/data/glance/images/4d531188-e398-41fe-8056-e52aa8e7c4ab', 'metadata': {}}]). {{(pid=86515) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1127}} Nov 02 12:28:34 devstack sudo[93782]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4cb008f8-52c8-49ea-b65b-ea88acfb9d22 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-44022ac3-3c79-4422-bce9-db7539c6ca39" returned: 0 in 0.503s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-4cb008f8-52c8-49ea-b65b-ea88acfb9d22 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:28:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4cb008f8-52c8-49ea-b65b-ea88acfb9d22 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:28:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4cb008f8-52c8-49ea-b65b-ea88acfb9d22 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (778e06cc-6aad-42c1-9731-f9d6554aa219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44022ac3-3c79-4422-bce9-db7539c6ca39', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4cb008f8-52c8-49ea-b65b-ea88acfb9d22 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958f7d83-54d5-4a70-ba30-ea78ff33690d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:34 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-4cb008f8-52c8-49ea-b65b-ea88acfb9d22 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Volume volume-44022ac3-3c79-4422-bce9-db7539c6ca39 (44022ac3-3c79-4422-bce9-db7539c6ca39): created successfully Nov 02 12:28:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4cb008f8-52c8-49ea-b65b-ea88acfb9d22 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958f7d83-54d5-4a70-ba30-ea78ff33690d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:35 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4cb008f8-52c8-49ea-b65b-ea88acfb9d22 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Flow 'volume_create_manager' (6c6147cc-6149-4729-ab5f-db9ae48df3c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:28:35 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-4cb008f8-52c8-49ea-b65b-ea88acfb9d22 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Created volume successfully. Nov 02 12:28:35 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_nip8mm6odevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86515) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 12:28:35 devstack cinder-volume[86515]: INFO cinder.image.image_utils [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Image download 20.69 MB at 20.69 MB/s Nov 02 12:28:35 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98506bc-45e1-496c-9f59-c00ea86c0326]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:28:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_nip8mm6odevstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:35 devstack sudo[93831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_nip8mm6odevstack@QuobyteHD Nov 02 12:28:35 devstack sudo[93831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:35 devstack sudo[93831]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_nip8mm6odevstack@QuobyteHD" returned: 0 in 0.380s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:35 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Temporary image 4d531188-e398-41fe-8056-e52aa8e7c4ab is fetched for user 5473d145237447cabc808f954175afbe. {{(pid=86515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 12:28:35 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[6291e618-980e-4bb3-a474-e4c3458d7f90]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:28:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_nip8mm6odevstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:35 devstack sudo[93836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_nip8mm6odevstack@QuobyteHD Nov 02 12:28:35 devstack sudo[93836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:36 devstack sudo[93836]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_nip8mm6odevstack@QuobyteHD" returned: 0 in 0.487s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:28:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:28:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-329020262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dab32c4f-0a42-4330-9a05-0d6ec70f2441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c704877a3edb4a9281410edc16ee6bc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:28:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:28:33Z,use_quota=True,user_id='5473d145237447cabc808f954175afbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:28:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Creating volume dab32c4f-0a42-4330-9a05-0d6ec70f2441 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:28:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:28:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:28:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:28:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:28:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:28:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:28:36 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:28:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-dab32c4f-0a42-4330-9a05-0d6ec70f2441 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:36 devstack sudo[93842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-dab32c4f-0a42-4330-9a05-0d6ec70f2441 1073741824 Nov 02 12:28:36 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-231d0404-3ef0-4d68-992d-b48f6700b756 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:28:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-231d0404-3ef0-4d68-992d-b48f6700b756 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:28:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-231d0404-3ef0-4d68-992d-b48f6700b756 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:28:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-231d0404-3ef0-4d68-992d-b48f6700b756 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:28:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-231d0404-3ef0-4d68-992d-b48f6700b756 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:28:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-231d0404-3ef0-4d68-992d-b48f6700b756 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:36 devstack sudo[93844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:28:36 devstack sudo[93844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:36 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc6e795f-0d24-4b6d-aadf-53e46dc27751 tempest-SnapshotsActionsTest-1836243303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:28:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-cc6e795f-0d24-4b6d-aadf-53e46dc27751 tempest-SnapshotsActionsTest-1836243303 None] Flow 'volume_create_manager' (0d7539d0-d3bd-423d-b8da-f77918072446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:28:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-cc6e795f-0d24-4b6d-aadf-53e46dc27751 tempest-SnapshotsActionsTest-1836243303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d1fff5-b5db-487d-a57e-db390430475c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-cc6e795f-0d24-4b6d-aadf-53e46dc27751 tempest-SnapshotsActionsTest-1836243303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d1fff5-b5db-487d-a57e-db390430475c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1094998748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=234cad9e-8649-4eca-babb-abeea8ea4d4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61404b45a18341e494ff8875a5e31113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:28:37Z,use_quota=True,user_id='1e0eeb07898b48fb9a02d9acb5e6383a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-cc6e795f-0d24-4b6d-aadf-53e46dc27751 tempest-SnapshotsActionsTest-1836243303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (663774b9-4731-491e-a9b5-0ab660c2937a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-cc6e795f-0d24-4b6d-aadf-53e46dc27751 tempest-SnapshotsActionsTest-1836243303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (663774b9-4731-491e-a9b5-0ab660c2937a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-cc6e795f-0d24-4b6d-aadf-53e46dc27751 tempest-SnapshotsActionsTest-1836243303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cacde038-0732-4251-9fcd-4ddfbd976892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-cc6e795f-0d24-4b6d-aadf-53e46dc27751 tempest-SnapshotsActionsTest-1836243303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cacde038-0732-4251-9fcd-4ddfbd976892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '234cad9e-8649-4eca-babb-abeea8ea4d4d', 'volume_name': 'volume-234cad9e-8649-4eca-babb-abeea8ea4d4d', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-cc6e795f-0d24-4b6d-aadf-53e46dc27751 tempest-SnapshotsActionsTest-1836243303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab68f52-d71d-4bc0-875a-7bf305a06289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-cc6e795f-0d24-4b6d-aadf-53e46dc27751 tempest-SnapshotsActionsTest-1836243303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab68f52-d71d-4bc0-875a-7bf305a06289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-cc6e795f-0d24-4b6d-aadf-53e46dc27751 tempest-SnapshotsActionsTest-1836243303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41acb0e0-11c4-45d4-911d-939ef0eb0022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:36 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-cc6e795f-0d24-4b6d-aadf-53e46dc27751 tempest-SnapshotsActionsTest-1836243303 None] Volume 234cad9e-8649-4eca-babb-abeea8ea4d4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-234cad9e-8649-4eca-babb-abeea8ea4d4d', 'volume_size': 1} Nov 02 12:28:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-cc6e795f-0d24-4b6d-aadf-53e46dc27751 tempest-SnapshotsActionsTest-1836243303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:28:36 devstack sudo[93844]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-231d0404-3ef0-4d68-992d-b48f6700b756 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.366s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:36 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-231d0404-3ef0-4d68-992d-b48f6700b756 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:28:36 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-231d0404-3ef0-4d68-992d-b48f6700b756 tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Retype volume completed successfully. Nov 02 12:28:36 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-dab32c4f-0a42-4330-9a05-0d6ec70f2441 1073741824" returned: 0 in 0.633s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-dab32c4f-0a42-4330-9a05-0d6ec70f2441 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:36 devstack sudo[93851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-dab32c4f-0a42-4330-9a05-0d6ec70f2441 Nov 02 12:28:36 devstack sudo[93851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:37 devstack sudo[93851]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-dab32c4f-0a42-4330-9a05-0d6ec70f2441" returned: 0 in 0.265s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:37 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:28:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:28:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-cc6e795f-0d24-4b6d-aadf-53e46dc27751 tempest-SnapshotsActionsTest-1836243303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.427s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:28:37 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-cc6e795f-0d24-4b6d-aadf-53e46dc27751 tempest-SnapshotsActionsTest-1836243303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1094998748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=234cad9e-8649-4eca-babb-abeea8ea4d4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61404b45a18341e494ff8875a5e31113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:28:37Z,use_quota=True,user_id='1e0eeb07898b48fb9a02d9acb5e6383a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:28:37 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-cc6e795f-0d24-4b6d-aadf-53e46dc27751 tempest-SnapshotsActionsTest-1836243303 None] Creating volume 234cad9e-8649-4eca-babb-abeea8ea4d4d {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:28:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-cc6e795f-0d24-4b6d-aadf-53e46dc27751 tempest-SnapshotsActionsTest-1836243303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:28:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-cc6e795f-0d24-4b6d-aadf-53e46dc27751 tempest-SnapshotsActionsTest-1836243303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:28:37 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-cc6e795f-0d24-4b6d-aadf-53e46dc27751 tempest-SnapshotsActionsTest-1836243303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:28:37 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-cc6e795f-0d24-4b6d-aadf-53e46dc27751 tempest-SnapshotsActionsTest-1836243303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:28:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-cc6e795f-0d24-4b6d-aadf-53e46dc27751 tempest-SnapshotsActionsTest-1836243303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:28:37 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-cc6e795f-0d24-4b6d-aadf-53e46dc27751 tempest-SnapshotsActionsTest-1836243303 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:28:37 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-cc6e795f-0d24-4b6d-aadf-53e46dc27751 tempest-SnapshotsActionsTest-1836243303 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:28:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cc6e795f-0d24-4b6d-aadf-53e46dc27751 tempest-SnapshotsActionsTest-1836243303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:37 devstack sudo[93854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d 1073741824 Nov 02 12:28:37 devstack sudo[93854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:37 devstack cinder-volume[86515]: DEBUG cinder.volume.volume_utils [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Attempting download of 4d531188-e398-41fe-8056-e52aa8e7c4ab ((None, [{'url': 'file:///opt/stack/data/glance/images/4d531188-e398-41fe-8056-e52aa8e7c4ab', 'metadata': {}}])) to volume dab32c4f-0a42-4330-9a05-0d6ec70f2441. {{(pid=86515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 12:28:37 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edb55fa-1944-4f29-a7d0-3bf8a82e7639]: (4, 'raw') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:28:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d531188-e398-41fe-8056-e52aa8e7c4ab__x5ezoqg {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:37 devstack sudo[93856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d531188-e398-41fe-8056-e52aa8e7c4ab__x5ezoqg Nov 02 12:28:37 devstack sudo[93856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:37 devstack sudo[93856]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d531188-e398-41fe-8056-e52aa8e7c4ab__x5ezoqg" returned: 0 in 0.420s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d531188-e398-41fe-8056-e52aa8e7c4ab__x5ezoqg {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:37 devstack sudo[93854]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cc6e795f-0d24-4b6d-aadf-53e46dc27751 tempest-SnapshotsActionsTest-1836243303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d 1073741824" returned: 0 in 0.548s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cc6e795f-0d24-4b6d-aadf-53e46dc27751 tempest-SnapshotsActionsTest-1836243303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:37 devstack sudo[93865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d Nov 02 12:28:37 devstack sudo[93865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:37 devstack sudo[93864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d531188-e398-41fe-8056-e52aa8e7c4ab__x5ezoqg Nov 02 12:28:37 devstack sudo[93864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:38 devstack sudo[93865]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:38 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d2d33b6d-5ef8-423d-b43e-841d68fd85cd tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Acquiring lock "cinder-44022ac3-3c79-4422-bce9-db7539c6ca39-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:28:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cc6e795f-0d24-4b6d-aadf-53e46dc27751 tempest-SnapshotsActionsTest-1836243303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d" returned: 0 in 0.320s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:38 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-cc6e795f-0d24-4b6d-aadf-53e46dc27751 tempest-SnapshotsActionsTest-1836243303 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:28:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-cc6e795f-0d24-4b6d-aadf-53e46dc27751 tempest-SnapshotsActionsTest-1836243303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:28:38 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-cc6e795f-0d24-4b6d-aadf-53e46dc27751 tempest-SnapshotsActionsTest-1836243303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41acb0e0-11c4-45d4-911d-939ef0eb0022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-234cad9e-8649-4eca-babb-abeea8ea4d4d', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:38 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-cc6e795f-0d24-4b6d-aadf-53e46dc27751 tempest-SnapshotsActionsTest-1836243303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35553f12-4e4d-48fe-b73b-b18fb4f3bcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:38 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d2d33b6d-5ef8-423d-b43e-841d68fd85cd tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Lock "cinder-44022ac3-3c79-4422-bce9-db7539c6ca39-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:28:38 devstack sudo[93864]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d531188-e398-41fe-8056-e52aa8e7c4ab__x5ezoqg" returned: 1 in 0.442s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d531188-e398-41fe-8056-e52aa8e7c4ab__x5ezoqg' failed. Not Retrying. {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:28:38 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[741e48a7-a777-411b-97a8-81d434d30944]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:28:38 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-cc6e795f-0d24-4b6d-aadf-53e46dc27751 tempest-SnapshotsActionsTest-1836243303 None] Volume volume-234cad9e-8649-4eca-babb-abeea8ea4d4d (234cad9e-8649-4eca-babb-abeea8ea4d4d): created successfully Nov 02 12:28:38 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-cc6e795f-0d24-4b6d-aadf-53e46dc27751 tempest-SnapshotsActionsTest-1836243303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35553f12-4e4d-48fe-b73b-b18fb4f3bcc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:38 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-cc6e795f-0d24-4b6d-aadf-53e46dc27751 tempest-SnapshotsActionsTest-1836243303 None] Flow 'volume_create_manager' (0d7539d0-d3bd-423d-b8da-f77918072446) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:28:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_nip8mm6odevstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:38 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d2d33b6d-5ef8-423d-b43e-841d68fd85cd tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Acquiring lock "cinder-quobyte-44022ac3-3c79-4422-bce9-db7539c6ca39" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:28:38 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-cc6e795f-0d24-4b6d-aadf-53e46dc27751 tempest-SnapshotsActionsTest-1836243303 None] Created volume successfully. Nov 02 12:28:38 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d2d33b6d-5ef8-423d-b43e-841d68fd85cd tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Lock "cinder-quobyte-44022ac3-3c79-4422-bce9-db7539c6ca39" acquired by "delete_volume" :: waited 0.026s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:28:38 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd0f159-5a02-4993-b8f1-67fc52a42f88]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:28:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d2d33b6d-5ef8-423d-b43e-841d68fd85cd tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-44022ac3-3c79-4422-bce9-db7539c6ca39 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:38 devstack sudo[93871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_nip8mm6odevstack@QuobyteHD Nov 02 12:28:38 devstack sudo[93871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:38 devstack sudo[93872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-44022ac3-3c79-4422-bce9-db7539c6ca39 Nov 02 12:28:38 devstack sudo[93872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:38 devstack sudo[93871]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_nip8mm6odevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:38 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] 4d531188-e398-41fe-8056-e52aa8e7c4ab was qcow2, converting to qcow2 {{(pid=86515) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 12:28:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_nip8mm6odevstack@QuobyteHD /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-dab32c4f-0a42-4330-9a05-0d6ec70f2441 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:38 devstack sudo[93879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_nip8mm6odevstack@QuobyteHD /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-dab32c4f-0a42-4330-9a05-0d6ec70f2441 Nov 02 12:28:38 devstack sudo[93879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:38 devstack sudo[93872]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d2d33b6d-5ef8-423d-b43e-841d68fd85cd tempest-VolumeRetypeWithoutMigrationTest-897427958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-44022ac3-3c79-4422-bce9-db7539c6ca39" returned: 0 in 0.518s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d2d33b6d-5ef8-423d-b43e-841d68fd85cd tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-44022ac3-3c79-4422-bce9-db7539c6ca39 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:38 devstack sudo[93884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-44022ac3-3c79-4422-bce9-db7539c6ca39 Nov 02 12:28:38 devstack sudo[93884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-18fec36c-eb9e-4744-a29e-881b7b80347a tempest-SnapshotsActionsTest-1836243303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:28:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-18fec36c-eb9e-4744-a29e-881b7b80347a tempest-SnapshotsActionsTest-1836243303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:28:38 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-18fec36c-eb9e-4744-a29e-881b7b80347a tempest-SnapshotsActionsTest-1836243303 None] Creating offline snapshot 008ca792-2770-49a6-9e17-3e8548b65845 of volume 234cad9e-8649-4eca-babb-abeea8ea4d4d {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:28:38 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[4716b44f-648b-4f37-b345-dcc07c4182cf]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:28:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-18fec36c-eb9e-4744-a29e-881b7b80347a tempest-SnapshotsActionsTest-1836243303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:39 devstack sudo[93884]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d2d33b6d-5ef8-423d-b43e-841d68fd85cd tempest-VolumeRetypeWithoutMigrationTest-897427958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-44022ac3-3c79-4422-bce9-db7539c6ca39" returned: 0 in 0.378s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:39 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d2d33b6d-5ef8-423d-b43e-841d68fd85cd tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Lock "cinder-quobyte-44022ac3-3c79-4422-bce9-db7539c6ca39" released by "delete_volume" :: held 0.957s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:28:39 devstack cinder-volume[86515]: WARNING cinder.quota [None req-d2d33b6d-5ef8-423d-b43e-841d68fd85cd tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:28:39 devstack cinder-volume[86515]: WARNING cinder.quota [None req-d2d33b6d-5ef8-423d-b43e-841d68fd85cd tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:28:39 devstack sudo[93890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d Nov 02 12:28:39 devstack sudo[93890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:39 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-d2d33b6d-5ef8-423d-b43e-841d68fd85cd tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Created reservations ['547d9618-34f8-4ed8-800f-a8cbfbcb3f10', '4d2c4daa-8875-44a3-a2c3-816b7d945ccf', '8a5170cd-38d9-4ee1-bfc4-eba80b13f548', '17dd900c-ceef-4af0-ab0b-d11bc9f23a7b'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:28:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d2d33b6d-5ef8-423d-b43e-841d68fd85cd tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:28:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d2d33b6d-5ef8-423d-b43e-841d68fd85cd tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:28:39 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d2d33b6d-5ef8-423d-b43e-841d68fd85cd tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:28:39 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d2d33b6d-5ef8-423d-b43e-841d68fd85cd tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:28:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d2d33b6d-5ef8-423d-b43e-841d68fd85cd tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:28:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d2d33b6d-5ef8-423d-b43e-841d68fd85cd tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:39 devstack sudo[93894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:28:39 devstack sudo[93894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:39 devstack sudo[93890]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-18fec36c-eb9e-4744-a29e-881b7b80347a tempest-SnapshotsActionsTest-1836243303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d" returned: 0 in 0.540s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-18fec36c-eb9e-4744-a29e-881b7b80347a tempest-SnapshotsActionsTest-1836243303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:39 devstack sudo[93899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 1G Nov 02 12:28:39 devstack sudo[93899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:39 devstack sudo[93894]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d2d33b6d-5ef8-423d-b43e-841d68fd85cd tempest-VolumeRetypeWithoutMigrationTest-897427958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.382s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:39 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-d2d33b6d-5ef8-423d-b43e-841d68fd85cd tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:28:39 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-d2d33b6d-5ef8-423d-b43e-841d68fd85cd tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Deleted volume successfully. Nov 02 12:28:39 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d2d33b6d-5ef8-423d-b43e-841d68fd85cd tempest-VolumeRetypeWithoutMigrationTest-897427958 None] Lock "cinder-44022ac3-3c79-4422-bce9-db7539c6ca39-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:28:40 devstack sudo[93899]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-18fec36c-eb9e-4744-a29e-881b7b80347a tempest-SnapshotsActionsTest-1836243303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 1G" returned: 0 in 0.523s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-18fec36c-eb9e-4744-a29e-881b7b80347a tempest-SnapshotsActionsTest-1836243303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-234cad9e-8649-4eca-babb-abeea8ea4d4d -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:40 devstack sudo[93907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-234cad9e-8649-4eca-babb-abeea8ea4d4d -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 Nov 02 12:28:40 devstack sudo[93907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:40 devstack sudo[93907]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-18fec36c-eb9e-4744-a29e-881b7b80347a tempest-SnapshotsActionsTest-1836243303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-234cad9e-8649-4eca-babb-abeea8ea4d4d -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845" returned: 0 in 0.357s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:40 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-18fec36c-eb9e-4744-a29e-881b7b80347a tempest-SnapshotsActionsTest-1836243303 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 is being set with open permissions: ugo+rw Nov 02 12:28:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-18fec36c-eb9e-4744-a29e-881b7b80347a tempest-SnapshotsActionsTest-1836243303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:40 devstack sudo[93912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 Nov 02 12:28:40 devstack sudo[93912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:40 devstack sudo[93912]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-18fec36c-eb9e-4744-a29e-881b7b80347a tempest-SnapshotsActionsTest-1836243303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845" returned: 0 in 0.340s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-18fec36c-eb9e-4744-a29e-881b7b80347a tempest-SnapshotsActionsTest-1836243303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:40 devstack sudo[93916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.info Nov 02 12:28:40 devstack sudo[93916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:41 devstack sudo[93879]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_nip8mm6odevstack@QuobyteHD /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-dab32c4f-0a42-4330-9a05-0d6ec70f2441" returned: 0 in 2.469s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_nip8mm6odevstack@QuobyteHD, size 112.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-dab32c4f-0a42-4330-9a05-0d6ec70f2441 {{(pid=86515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 12:28:41 devstack cinder-volume[86515]: INFO cinder.image.image_utils [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Converted 112.00 MB image at 45.33 MB/s Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-dab32c4f-0a42-4330-9a05-0d6ec70f2441 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:41 devstack sudo[93918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-dab32c4f-0a42-4330-9a05-0d6ec70f2441 1G Nov 02 12:28:41 devstack sudo[93918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:41 devstack sudo[93916]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-18fec36c-eb9e-4744-a29e-881b7b80347a tempest-SnapshotsActionsTest-1836243303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.info" returned: 0 in 0.387s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:41 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-18fec36c-eb9e-4744-a29e-881b7b80347a tempest-SnapshotsActionsTest-1836243303 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.info is being set with open permissions: ugo+rw Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-18fec36c-eb9e-4744-a29e-881b7b80347a tempest-SnapshotsActionsTest-1836243303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:41 devstack sudo[93921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.info Nov 02 12:28:41 devstack sudo[93921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-69c9e21c-d47c-4984-9870-77dfa348e1a3 tempest-VolumesSnapshotListTestJSON-397503495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-69c9e21c-d47c-4984-9870-77dfa348e1a3 tempest-VolumesSnapshotListTestJSON-397503495 None] Flow 'volume_create_manager' (3461f2d0-2919-4a35-8b3e-f87fef42e0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-69c9e21c-d47c-4984-9870-77dfa348e1a3 tempest-VolumesSnapshotListTestJSON-397503495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92ad2a8e-dd70-4185-8fa8-0aebe440f5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-69c9e21c-d47c-4984-9870-77dfa348e1a3 tempest-VolumesSnapshotListTestJSON-397503495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92ad2a8e-dd70-4185-8fa8-0aebe440f5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1826664606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eef24cd6-1cc6-4c1a-a23c-498dc5ed1406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be7cff31859144fdbaa09c770bb84c4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:28:41Z,use_quota=True,user_id='69fe47173b1d43d08dc97961225f355a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-69c9e21c-d47c-4984-9870-77dfa348e1a3 tempest-VolumesSnapshotListTestJSON-397503495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba56781-c5de-4857-a340-4cc7a70fd01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-69c9e21c-d47c-4984-9870-77dfa348e1a3 tempest-VolumesSnapshotListTestJSON-397503495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba56781-c5de-4857-a340-4cc7a70fd01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-69c9e21c-d47c-4984-9870-77dfa348e1a3 tempest-VolumesSnapshotListTestJSON-397503495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d2ee938-bc4b-4486-a7f3-5ddb4fcdb145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-69c9e21c-d47c-4984-9870-77dfa348e1a3 tempest-VolumesSnapshotListTestJSON-397503495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d2ee938-bc4b-4486-a7f3-5ddb4fcdb145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eef24cd6-1cc6-4c1a-a23c-498dc5ed1406', 'volume_name': 'volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-69c9e21c-d47c-4984-9870-77dfa348e1a3 tempest-VolumesSnapshotListTestJSON-397503495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cc4c35e-9ea4-4553-860b-6293adf34700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-69c9e21c-d47c-4984-9870-77dfa348e1a3 tempest-VolumesSnapshotListTestJSON-397503495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cc4c35e-9ea4-4553-860b-6293adf34700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-69c9e21c-d47c-4984-9870-77dfa348e1a3 tempest-VolumesSnapshotListTestJSON-397503495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (401aa4d9-1c0e-415e-bdfb-5d6f257fc26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:41 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-69c9e21c-d47c-4984-9870-77dfa348e1a3 tempest-VolumesSnapshotListTestJSON-397503495 None] Volume eef24cd6-1cc6-4c1a-a23c-498dc5ed1406: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406', 'volume_size': 1} Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-69c9e21c-d47c-4984-9870-77dfa348e1a3 tempest-VolumesSnapshotListTestJSON-397503495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:28:41 devstack sudo[93918]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-dab32c4f-0a42-4330-9a05-0d6ec70f2441 1G" returned: 0 in 0.393s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG cinder.volume.volume_utils [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Downloaded image 4d531188-e398-41fe-8056-e52aa8e7c4ab ((None, [{'url': 'file:///opt/stack/data/glance/images/4d531188-e398-41fe-8056-e52aa8e7c4ab', 'metadata': {}}])) to volume dab32c4f-0a42-4330-9a05-0d6ec70f2441 successfully. {{(pid=86515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Temporary image 4d531188-e398-41fe-8056-e52aa8e7c4ab for user 5473d145237447cabc808f954175afbe is deleted. {{(pid=86515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG cinder.volume.volume_utils [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Marking volume dab32c4f-0a42-4330-9a05-0d6ec70f2441 as bootable. {{(pid=86515) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Copying metadata from image 4d531188-e398-41fe-8056-e52aa8e7c4ab to dab32c4f-0a42-4330-9a05-0d6ec70f2441. {{(pid=86515) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Creating volume glance metadata for volume dab32c4f-0a42-4330-9a05-0d6ec70f2441 backed by image 4d531188-e398-41fe-8056-e52aa8e7c4ab with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4d531188-e398-41fe-8056-e52aa8e7c4ab', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86515) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 12:28:41 devstack sudo[93921]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-18fec36c-eb9e-4744-a29e-881b7b80347a tempest-SnapshotsActionsTest-1836243303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.info" returned: 0 in 0.278s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-18fec36c-eb9e-4744-a29e-881b7b80347a tempest-SnapshotsActionsTest-1836243303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.569s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-69c9e21c-d47c-4984-9870-77dfa348e1a3 tempest-VolumesSnapshotListTestJSON-397503495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.125s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-69c9e21c-d47c-4984-9870-77dfa348e1a3 tempest-VolumesSnapshotListTestJSON-397503495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1826664606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eef24cd6-1cc6-4c1a-a23c-498dc5ed1406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be7cff31859144fdbaa09c770bb84c4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:28:41Z,use_quota=True,user_id='69fe47173b1d43d08dc97961225f355a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-69c9e21c-d47c-4984-9870-77dfa348e1a3 tempest-VolumesSnapshotListTestJSON-397503495 None] Creating volume eef24cd6-1cc6-4c1a-a23c-498dc5ed1406 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-69c9e21c-d47c-4984-9870-77dfa348e1a3 tempest-VolumesSnapshotListTestJSON-397503495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-69c9e21c-d47c-4984-9870-77dfa348e1a3 tempest-VolumesSnapshotListTestJSON-397503495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-69c9e21c-d47c-4984-9870-77dfa348e1a3 tempest-VolumesSnapshotListTestJSON-397503495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-69c9e21c-d47c-4984-9870-77dfa348e1a3 tempest-VolumesSnapshotListTestJSON-397503495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-69c9e21c-d47c-4984-9870-77dfa348e1a3 tempest-VolumesSnapshotListTestJSON-397503495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-69c9e21c-d47c-4984-9870-77dfa348e1a3 tempest-VolumesSnapshotListTestJSON-397503495 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:28:41 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-69c9e21c-d47c-4984-9870-77dfa348e1a3 tempest-VolumesSnapshotListTestJSON-397503495 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-69c9e21c-d47c-4984-9870-77dfa348e1a3 tempest-VolumesSnapshotListTestJSON-397503495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:41 devstack sudo[93928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406 1073741824 Nov 02 12:28:41 devstack sudo[93928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:41 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-18fec36c-eb9e-4744-a29e-881b7b80347a tempest-SnapshotsActionsTest-1836243303 None] Create snapshot completed successfully Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c1cef81-6f2d-497b-9284-0e27fdb08cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dab32c4f-0a42-4330-9a05-0d6ec70f2441', 'volume_size': 1, 'image_id': '4d531188-e398-41fe-8056-e52aa8e7c4ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d531188-e398-41fe-8056-e52aa8e7c4ab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ea64174531846a688f10d8f38a757ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d531188-e398-41fe-8056-e52aa8e7c4ab', 'created_at': datetime.datetime(2026, 11, 2, 11, 16, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 16, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d531188-e398-41fe-8056-e52aa8e7c4ab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c40ec78c-00a0-48c7-8880-d5b1cbeb6b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:41 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Volume volume-dab32c4f-0a42-4330-9a05-0d6ec70f2441 (dab32c4f-0a42-4330-9a05-0d6ec70f2441): created successfully Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c40ec78c-00a0-48c7-8880-d5b1cbeb6b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Flow 'volume_create_manager' (527a7e2e-6b99-418b-a1b8-d2adb95a98bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:28:41 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-8626662d-da0d-4b73-86c2-1788442cfda7 tempest-ServerActionsTestOtherA-618205716 None] Created volume successfully. Nov 02 12:28:42 devstack sudo[93928]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-69c9e21c-d47c-4984-9870-77dfa348e1a3 tempest-VolumesSnapshotListTestJSON-397503495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406 1073741824" returned: 0 in 0.496s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-69c9e21c-d47c-4984-9870-77dfa348e1a3 tempest-VolumesSnapshotListTestJSON-397503495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:42 devstack sudo[93934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406 Nov 02 12:28:42 devstack sudo[93934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:42 devstack sudo[93934]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-69c9e21c-d47c-4984-9870-77dfa348e1a3 tempest-VolumesSnapshotListTestJSON-397503495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406" returned: 0 in 0.357s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:42 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-69c9e21c-d47c-4984-9870-77dfa348e1a3 tempest-VolumesSnapshotListTestJSON-397503495 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:28:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-69c9e21c-d47c-4984-9870-77dfa348e1a3 tempest-VolumesSnapshotListTestJSON-397503495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:28:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-69c9e21c-d47c-4984-9870-77dfa348e1a3 tempest-VolumesSnapshotListTestJSON-397503495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (401aa4d9-1c0e-415e-bdfb-5d6f257fc26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-69c9e21c-d47c-4984-9870-77dfa348e1a3 tempest-VolumesSnapshotListTestJSON-397503495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73369a1a-6fa2-405b-83ce-f502c12730e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:42 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-69c9e21c-d47c-4984-9870-77dfa348e1a3 tempest-VolumesSnapshotListTestJSON-397503495 None] Volume volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406 (eef24cd6-1cc6-4c1a-a23c-498dc5ed1406): created successfully Nov 02 12:28:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-69c9e21c-d47c-4984-9870-77dfa348e1a3 tempest-VolumesSnapshotListTestJSON-397503495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73369a1a-6fa2-405b-83ce-f502c12730e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-69c9e21c-d47c-4984-9870-77dfa348e1a3 tempest-VolumesSnapshotListTestJSON-397503495 None] Flow 'volume_create_manager' (3461f2d0-2919-4a35-8b3e-f87fef42e0cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:28:42 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-69c9e21c-d47c-4984-9870-77dfa348e1a3 tempest-VolumesSnapshotListTestJSON-397503495 None] Created volume successfully. Nov 02 12:28:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-88375937-6e64-45e0-893a-871dc0d539e6 tempest-SnapshotsActionsTest-1836243303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:28:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-88375937-6e64-45e0-893a-871dc0d539e6 tempest-SnapshotsActionsTest-1836243303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:28:42 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-88375937-6e64-45e0-893a-871dc0d539e6 tempest-SnapshotsActionsTest-1836243303 None] Creating offline snapshot f18220ca-5b69-46d7-90c1-f20e9de2bf41 of volume 234cad9e-8649-4eca-babb-abeea8ea4d4d {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:28:43 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[2454e140-9d1e-4ba4-a6e9-b9dc1bb615ab]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:28:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-88375937-6e64-45e0-893a-871dc0d539e6 tempest-SnapshotsActionsTest-1836243303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:43 devstack sudo[93938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 Nov 02 12:28:43 devstack sudo[93938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:43 devstack sudo[93938]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-88375937-6e64-45e0-893a-871dc0d539e6 tempest-SnapshotsActionsTest-1836243303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845" returned: 0 in 0.529s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-88375937-6e64-45e0-893a-871dc0d539e6 tempest-SnapshotsActionsTest-1836243303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-234cad9e-8649-4eca-babb-abeea8ea4d4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:28:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-88375937-6e64-45e0-893a-871dc0d539e6 tempest-SnapshotsActionsTest-1836243303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.f18220ca-5b69-46d7-90c1-f20e9de2bf41 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:43 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.f18220ca-5b69-46d7-90c1-f20e9de2bf41 1G Nov 02 12:28:43 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-467b7dcc-8407-4226-82fe-e9b54b1cbe7c tempest-VolumesSnapshotListTestJSON-397503495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:28:43 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:28:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:28:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:28:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:28:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:28:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:28:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:43 devstack sudo[93952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:28:43 devstack sudo[93952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:44 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-88375937-6e64-45e0-893a-871dc0d539e6 tempest-SnapshotsActionsTest-1836243303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.f18220ca-5b69-46d7-90c1-f20e9de2bf41 1G" returned: 0 in 0.625s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-88375937-6e64-45e0-893a-871dc0d539e6 tempest-SnapshotsActionsTest-1836243303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.f18220ca-5b69-46d7-90c1-f20e9de2bf41 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:44 devstack sudo[93956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.f18220ca-5b69-46d7-90c1-f20e9de2bf41 Nov 02 12:28:44 devstack sudo[93956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:44 devstack sudo[93952]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.392s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:44 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:28:44 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager._thread_info {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:28:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread count: 28 {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:28:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread info: [<_MainThread(MainThread, started 129944084402304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:28:44 devstack sudo[93956]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-88375937-6e64-45e0-893a-871dc0d539e6 tempest-SnapshotsActionsTest-1836243303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.f18220ca-5b69-46d7-90c1-f20e9de2bf41" returned: 0 in 0.384s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:44 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-88375937-6e64-45e0-893a-871dc0d539e6 tempest-SnapshotsActionsTest-1836243303 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.f18220ca-5b69-46d7-90c1-f20e9de2bf41 is being set with open permissions: ugo+rw Nov 02 12:28:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-88375937-6e64-45e0-893a-871dc0d539e6 tempest-SnapshotsActionsTest-1836243303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.f18220ca-5b69-46d7-90c1-f20e9de2bf41 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:44 devstack sudo[93964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.f18220ca-5b69-46d7-90c1-f20e9de2bf41 Nov 02 12:28:44 devstack sudo[93964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:44 devstack sudo[93964]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-88375937-6e64-45e0-893a-871dc0d539e6 tempest-SnapshotsActionsTest-1836243303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.f18220ca-5b69-46d7-90c1-f20e9de2bf41" returned: 0 in 0.282s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-88375937-6e64-45e0-893a-871dc0d539e6 tempest-SnapshotsActionsTest-1836243303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.955s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:28:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-467b7dcc-8407-4226-82fe-e9b54b1cbe7c tempest-VolumesSnapshotListTestJSON-397503495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.185s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:28:44 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-467b7dcc-8407-4226-82fe-e9b54b1cbe7c tempest-VolumesSnapshotListTestJSON-397503495 None] Creating offline snapshot 7d72fec5-83c3-434f-90be-982ed2ff6a92 of volume eef24cd6-1cc6-4c1a-a23c-498dc5ed1406 {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:28:44 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-88375937-6e64-45e0-893a-871dc0d539e6 tempest-SnapshotsActionsTest-1836243303 None] Create snapshot completed successfully Nov 02 12:28:44 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[5167ad47-84e7-42a8-b5ac-fa79bd6de66f]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:28:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-467b7dcc-8407-4226-82fe-e9b54b1cbe7c tempest-VolumesSnapshotListTestJSON-397503495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:45 devstack sudo[93967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406 Nov 02 12:28:45 devstack sudo[93967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:45 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-796f04d7-41f5-478d-843a-49e4fd645c23 tempest-SnapshotsActionsTest-1518372145 None] Acquiring lock "cinder-f18220ca-5b69-46d7-90c1-f20e9de2bf41-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:28:45 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-796f04d7-41f5-478d-843a-49e4fd645c23 tempest-SnapshotsActionsTest-1518372145 None] Lock "cinder-f18220ca-5b69-46d7-90c1-f20e9de2bf41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:28:45 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-796f04d7-41f5-478d-843a-49e4fd645c23 tempest-SnapshotsActionsTest-1518372145 None] Acquiring lock "cinder-quobyte-234cad9e-8649-4eca-babb-abeea8ea4d4d" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:28:45 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-796f04d7-41f5-478d-843a-49e4fd645c23 tempest-SnapshotsActionsTest-1518372145 None] Lock "cinder-quobyte-234cad9e-8649-4eca-babb-abeea8ea4d4d" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:28:45 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-796f04d7-41f5-478d-843a-49e4fd645c23 tempest-SnapshotsActionsTest-1518372145 None] Acquiring lock "cinder-quobyte-f18220ca-5b69-46d7-90c1-f20e9de2bf41" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:28:45 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-796f04d7-41f5-478d-843a-49e4fd645c23 tempest-SnapshotsActionsTest-1518372145 None] Lock "cinder-quobyte-f18220ca-5b69-46d7-90c1-f20e9de2bf41" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:28:45 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-796f04d7-41f5-478d-843a-49e4fd645c23 tempest-SnapshotsActionsTest-1518372145 None] Deleting offline snapshot f18220ca-5b69-46d7-90c1-f20e9de2bf41 of volume 234cad9e-8649-4eca-babb-abeea8ea4d4d {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:28:45 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-796f04d7-41f5-478d-843a-49e4fd645c23 tempest-SnapshotsActionsTest-1518372145 None] snapshot_file for this snap is: volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.f18220ca-5b69-46d7-90c1-f20e9de2bf41 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:28:45 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab45551-2781-456f-8224-57224574df90]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:28:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-796f04d7-41f5-478d-843a-49e4fd645c23 tempest-SnapshotsActionsTest-1518372145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.f18220ca-5b69-46d7-90c1-f20e9de2bf41 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:45 devstack sudo[93977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.f18220ca-5b69-46d7-90c1-f20e9de2bf41 Nov 02 12:28:45 devstack sudo[93977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:45 devstack sudo[93967]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-467b7dcc-8407-4226-82fe-e9b54b1cbe7c tempest-VolumesSnapshotListTestJSON-397503495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406" returned: 0 in 0.704s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-467b7dcc-8407-4226-82fe-e9b54b1cbe7c tempest-VolumesSnapshotListTestJSON-397503495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.7d72fec5-83c3-434f-90be-982ed2ff6a92 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:45 devstack sudo[93990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.7d72fec5-83c3-434f-90be-982ed2ff6a92 1G Nov 02 12:28:45 devstack sudo[93990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-e62b95d4-e97e-40cf-97d4-889104154fa9 req-2f13dc2d-c5a9-4e39-93b0-0390af83befb tempest-ServerActionsTestOtherA-618205716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:28:45 devstack sudo[93977]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-796f04d7-41f5-478d-843a-49e4fd645c23 tempest-SnapshotsActionsTest-1518372145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.f18220ca-5b69-46d7-90c1-f20e9de2bf41" returned: 0 in 0.510s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:45 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-796f04d7-41f5-478d-843a-49e4fd645c23 tempest-SnapshotsActionsTest-1518372145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-234cad9e-8649-4eca-babb-abeea8ea4d4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:28:45 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13077d3-9f8e-4de9-912a-62b2e5e54f8b]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:28:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-796f04d7-41f5-478d-843a-49e4fd645c23 tempest-SnapshotsActionsTest-1518372145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:46 devstack sudo[93995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 Nov 02 12:28:46 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:46 devstack sudo[93990]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-467b7dcc-8407-4226-82fe-e9b54b1cbe7c tempest-VolumesSnapshotListTestJSON-397503495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.7d72fec5-83c3-434f-90be-982ed2ff6a92 1G" returned: 0 in 0.610s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-467b7dcc-8407-4226-82fe-e9b54b1cbe7c tempest-VolumesSnapshotListTestJSON-397503495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.7d72fec5-83c3-434f-90be-982ed2ff6a92 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:46 devstack sudo[94001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.7d72fec5-83c3-434f-90be-982ed2ff6a92 Nov 02 12:28:46 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:46 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-796f04d7-41f5-478d-843a-49e4fd645c23 tempest-SnapshotsActionsTest-1518372145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845" returned: 0 in 0.584s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:46 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-796f04d7-41f5-478d-843a-49e4fd645c23 tempest-SnapshotsActionsTest-1518372145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-234cad9e-8649-4eca-babb-abeea8ea4d4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:28:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-796f04d7-41f5-478d-843a-49e4fd645c23 tempest-SnapshotsActionsTest-1518372145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.f18220ca-5b69-46d7-90c1-f20e9de2bf41 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:46 devstack sudo[94008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.f18220ca-5b69-46d7-90c1-f20e9de2bf41 Nov 02 12:28:46 devstack sudo[94008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:46 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-467b7dcc-8407-4226-82fe-e9b54b1cbe7c tempest-VolumesSnapshotListTestJSON-397503495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.7d72fec5-83c3-434f-90be-982ed2ff6a92" returned: 0 in 0.338s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:46 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-467b7dcc-8407-4226-82fe-e9b54b1cbe7c tempest-VolumesSnapshotListTestJSON-397503495 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.7d72fec5-83c3-434f-90be-982ed2ff6a92 is being set with open permissions: ugo+rw Nov 02 12:28:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-467b7dcc-8407-4226-82fe-e9b54b1cbe7c tempest-VolumesSnapshotListTestJSON-397503495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.7d72fec5-83c3-434f-90be-982ed2ff6a92 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:46 devstack sudo[94013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.7d72fec5-83c3-434f-90be-982ed2ff6a92 Nov 02 12:28:46 devstack sudo[94013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:46 devstack sudo[94013]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-467b7dcc-8407-4226-82fe-e9b54b1cbe7c tempest-VolumesSnapshotListTestJSON-397503495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.7d72fec5-83c3-434f-90be-982ed2ff6a92" returned: 0 in 0.285s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-467b7dcc-8407-4226-82fe-e9b54b1cbe7c tempest-VolumesSnapshotListTestJSON-397503495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:46 devstack sudo[94019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.info Nov 02 12:28:46 devstack sudo[94019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:47 devstack sudo[94008]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-796f04d7-41f5-478d-843a-49e4fd645c23 tempest-SnapshotsActionsTest-1518372145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.f18220ca-5b69-46d7-90c1-f20e9de2bf41" returned: 0 in 0.543s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-796f04d7-41f5-478d-843a-49e4fd645c23 tempest-SnapshotsActionsTest-1518372145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.f18220ca-5b69-46d7-90c1-f20e9de2bf41 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:47 devstack sudo[94021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.f18220ca-5b69-46d7-90c1-f20e9de2bf41 Nov 02 12:28:47 devstack sudo[94021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:47 devstack sudo[94019]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-467b7dcc-8407-4226-82fe-e9b54b1cbe7c tempest-VolumesSnapshotListTestJSON-397503495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.info" returned: 0 in 0.337s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:47 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-467b7dcc-8407-4226-82fe-e9b54b1cbe7c tempest-VolumesSnapshotListTestJSON-397503495 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.info is being set with open permissions: ugo+rw Nov 02 12:28:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-467b7dcc-8407-4226-82fe-e9b54b1cbe7c tempest-VolumesSnapshotListTestJSON-397503495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:47 devstack sudo[94025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.info Nov 02 12:28:47 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:47 devstack sudo[94021]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-796f04d7-41f5-478d-843a-49e4fd645c23 tempest-SnapshotsActionsTest-1518372145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.f18220ca-5b69-46d7-90c1-f20e9de2bf41" returned: 0 in 0.317s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:47 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-796f04d7-41f5-478d-843a-49e4fd645c23 tempest-SnapshotsActionsTest-1518372145 None] Lock "cinder-quobyte-f18220ca-5b69-46d7-90c1-f20e9de2bf41" released by "_delete_snapshot" :: held 2.088s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:28:47 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-796f04d7-41f5-478d-843a-49e4fd645c23 tempest-SnapshotsActionsTest-1518372145 None] Lock "cinder-quobyte-234cad9e-8649-4eca-babb-abeea8ea4d4d" released by "delete_snapshot" :: held 2.113s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:28:47 devstack cinder-volume[86515]: WARNING cinder.quota [None req-796f04d7-41f5-478d-843a-49e4fd645c23 tempest-SnapshotsActionsTest-1518372145 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:28:47 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-796f04d7-41f5-478d-843a-49e4fd645c23 tempest-SnapshotsActionsTest-1518372145 None] Created reservations ['9687350c-57fd-485c-9c96-f5f57d62313a', '658f579d-5b3a-4f83-93d4-3a8a7517a39e', '5e0ca60d-46be-4cce-b472-e3e0ed34ab66', '367bce4e-eb89-42b3-a3e4-fca575d4e1f4'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:28:47 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-796f04d7-41f5-478d-843a-49e4fd645c23 tempest-SnapshotsActionsTest-1518372145 None] Delete snapshot completed successfully. Nov 02 12:28:47 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-796f04d7-41f5-478d-843a-49e4fd645c23 tempest-SnapshotsActionsTest-1518372145 None] Lock "cinder-f18220ca-5b69-46d7-90c1-f20e9de2bf41-delete_snapshot" released by "delete_snapshot" :: held 2.294s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:28:47 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-467b7dcc-8407-4226-82fe-e9b54b1cbe7c tempest-VolumesSnapshotListTestJSON-397503495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.info" returned: 0 in 0.342s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-467b7dcc-8407-4226-82fe-e9b54b1cbe7c tempest-VolumesSnapshotListTestJSON-397503495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.744s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:28:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-e62b95d4-e97e-40cf-97d4-889104154fa9 req-2f13dc2d-c5a9-4e39-93b0-0390af83befb tempest-ServerActionsTestOtherA-618205716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.856s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:28:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-e62b95d4-e97e-40cf-97d4-889104154fa9 req-2f13dc2d-c5a9-4e39-93b0-0390af83befb tempest-ServerActionsTestOtherA-618205716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:28:47 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-467b7dcc-8407-4226-82fe-e9b54b1cbe7c tempest-VolumesSnapshotListTestJSON-397503495 None] Create snapshot completed successfully Nov 02 12:28:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-e62b95d4-e97e-40cf-97d4-889104154fa9 req-2f13dc2d-c5a9-4e39-93b0-0390af83befb tempest-ServerActionsTestOtherA-618205716 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae', 'name': 'volume-dab32c4f-0a42-4330-9a05-0d6ec70f2441', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f9f40510-071e-463a-8752-3d7aafe168c9', 'enforce_multipath': True} {{(pid=86515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:28:47 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-e62b95d4-e97e-40cf-97d4-889104154fa9 req-2f13dc2d-c5a9-4e39-93b0-0390af83befb tempest-ServerActionsTestOtherA-618205716 None] attachment_update completed successfully. Nov 02 12:28:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d140f7e4-eb0e-440c-89ca-bc375fc8358a tempest-VolumesSnapshotListTestJSON-397503495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:28:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d140f7e4-eb0e-440c-89ca-bc375fc8358a tempest-VolumesSnapshotListTestJSON-397503495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:28:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-d140f7e4-eb0e-440c-89ca-bc375fc8358a tempest-VolumesSnapshotListTestJSON-397503495 None] Creating offline snapshot 2aa7ce74-7c7e-4ea2-9461-e92efa27f505 of volume eef24cd6-1cc6-4c1a-a23c-498dc5ed1406 {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:28:48 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcaf780c-c1fc-45d5-b0fd-80dc8a689cde]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:28:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d140f7e4-eb0e-440c-89ca-bc375fc8358a tempest-VolumesSnapshotListTestJSON-397503495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.7d72fec5-83c3-434f-90be-982ed2ff6a92 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:48 devstack sudo[94029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.7d72fec5-83c3-434f-90be-982ed2ff6a92 Nov 02 12:28:48 devstack sudo[94029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:48 devstack sudo[94029]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d140f7e4-eb0e-440c-89ca-bc375fc8358a tempest-VolumesSnapshotListTestJSON-397503495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.7d72fec5-83c3-434f-90be-982ed2ff6a92" returned: 0 in 0.619s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-d140f7e4-eb0e-440c-89ca-bc375fc8358a tempest-VolumesSnapshotListTestJSON-397503495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:28:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d140f7e4-eb0e-440c-89ca-bc375fc8358a tempest-VolumesSnapshotListTestJSON-397503495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.7d72fec5-83c3-434f-90be-982ed2ff6a92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.2aa7ce74-7c7e-4ea2-9461-e92efa27f505 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:49 devstack sudo[94135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.7d72fec5-83c3-434f-90be-982ed2ff6a92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.2aa7ce74-7c7e-4ea2-9461-e92efa27f505 1G Nov 02 12:28:49 devstack sudo[94135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-bdaab1b9-63c6-445d-add4-b9fb7d78406a tempest-SnapshotsActionsTest-1836243303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:28:49 devstack sudo[94135]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d140f7e4-eb0e-440c-89ca-bc375fc8358a tempest-VolumesSnapshotListTestJSON-397503495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.7d72fec5-83c3-434f-90be-982ed2ff6a92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.2aa7ce74-7c7e-4ea2-9461-e92efa27f505 1G" returned: 0 in 0.882s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d140f7e4-eb0e-440c-89ca-bc375fc8358a tempest-VolumesSnapshotListTestJSON-397503495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.7d72fec5-83c3-434f-90be-982ed2ff6a92 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.2aa7ce74-7c7e-4ea2-9461-e92efa27f505 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:49 devstack sudo[94491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.7d72fec5-83c3-434f-90be-982ed2ff6a92 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.2aa7ce74-7c7e-4ea2-9461-e92efa27f505 Nov 02 12:28:49 devstack sudo[94491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:50 devstack sudo[94491]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d140f7e4-eb0e-440c-89ca-bc375fc8358a tempest-VolumesSnapshotListTestJSON-397503495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.7d72fec5-83c3-434f-90be-982ed2ff6a92 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.2aa7ce74-7c7e-4ea2-9461-e92efa27f505" returned: 0 in 0.557s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:50 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-d140f7e4-eb0e-440c-89ca-bc375fc8358a tempest-VolumesSnapshotListTestJSON-397503495 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.2aa7ce74-7c7e-4ea2-9461-e92efa27f505 is being set with open permissions: ugo+rw Nov 02 12:28:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d140f7e4-eb0e-440c-89ca-bc375fc8358a tempest-VolumesSnapshotListTestJSON-397503495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.2aa7ce74-7c7e-4ea2-9461-e92efa27f505 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:50 devstack sudo[94506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.2aa7ce74-7c7e-4ea2-9461-e92efa27f505 Nov 02 12:28:50 devstack sudo[94506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:50 devstack sudo[94506]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d140f7e4-eb0e-440c-89ca-bc375fc8358a tempest-VolumesSnapshotListTestJSON-397503495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.2aa7ce74-7c7e-4ea2-9461-e92efa27f505" returned: 0 in 0.505s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d140f7e4-eb0e-440c-89ca-bc375fc8358a tempest-VolumesSnapshotListTestJSON-397503495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.722s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:28:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-bdaab1b9-63c6-445d-add4-b9fb7d78406a tempest-SnapshotsActionsTest-1836243303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.851s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:28:51 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-bdaab1b9-63c6-445d-add4-b9fb7d78406a tempest-SnapshotsActionsTest-1836243303 None] Creating offline snapshot e18a6d78-c460-46bf-842a-c0813acbeee2 of volume 234cad9e-8649-4eca-babb-abeea8ea4d4d {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:28:51 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-d140f7e4-eb0e-440c-89ca-bc375fc8358a tempest-VolumesSnapshotListTestJSON-397503495 None] Create snapshot completed successfully Nov 02 12:28:51 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8dd1ef-0ebb-4969-95c2-0346f403891b]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:28:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bdaab1b9-63c6-445d-add4-b9fb7d78406a tempest-SnapshotsActionsTest-1836243303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:51 devstack sudo[94511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 Nov 02 12:28:51 devstack sudo[94511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:51 devstack sudo[94511]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bdaab1b9-63c6-445d-add4-b9fb7d78406a tempest-SnapshotsActionsTest-1836243303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845" returned: 0 in 0.532s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:51 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-bdaab1b9-63c6-445d-add4-b9fb7d78406a tempest-SnapshotsActionsTest-1836243303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-234cad9e-8649-4eca-babb-abeea8ea4d4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:28:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bdaab1b9-63c6-445d-add4-b9fb7d78406a tempest-SnapshotsActionsTest-1836243303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.e18a6d78-c460-46bf-842a-c0813acbeee2 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:51 devstack sudo[94518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.e18a6d78-c460-46bf-842a-c0813acbeee2 1G Nov 02 12:28:51 devstack sudo[94518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-948c15d0-b1d3-47b1-bb80-888bcc3732a1 tempest-VolumesSnapshotListTestJSON-397503495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:28:52 devstack sudo[94518]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bdaab1b9-63c6-445d-add4-b9fb7d78406a tempest-SnapshotsActionsTest-1836243303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.e18a6d78-c460-46bf-842a-c0813acbeee2 1G" returned: 0 in 0.642s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bdaab1b9-63c6-445d-add4-b9fb7d78406a tempest-SnapshotsActionsTest-1836243303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.e18a6d78-c460-46bf-842a-c0813acbeee2 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:52 devstack sudo[94524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.e18a6d78-c460-46bf-842a-c0813acbeee2 Nov 02 12:28:52 devstack sudo[94524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:52 devstack sudo[94524]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bdaab1b9-63c6-445d-add4-b9fb7d78406a tempest-SnapshotsActionsTest-1836243303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.e18a6d78-c460-46bf-842a-c0813acbeee2" returned: 0 in 0.325s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:52 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-bdaab1b9-63c6-445d-add4-b9fb7d78406a tempest-SnapshotsActionsTest-1836243303 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.e18a6d78-c460-46bf-842a-c0813acbeee2 is being set with open permissions: ugo+rw Nov 02 12:28:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bdaab1b9-63c6-445d-add4-b9fb7d78406a tempest-SnapshotsActionsTest-1836243303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.e18a6d78-c460-46bf-842a-c0813acbeee2 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:52 devstack sudo[94529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.e18a6d78-c460-46bf-842a-c0813acbeee2 Nov 02 12:28:52 devstack sudo[94529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:52 devstack sudo[94529]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bdaab1b9-63c6-445d-add4-b9fb7d78406a tempest-SnapshotsActionsTest-1836243303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.e18a6d78-c460-46bf-842a-c0813acbeee2" returned: 0 in 0.291s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-bdaab1b9-63c6-445d-add4-b9fb7d78406a tempest-SnapshotsActionsTest-1836243303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.979s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:28:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-948c15d0-b1d3-47b1-bb80-888bcc3732a1 tempest-VolumesSnapshotListTestJSON-397503495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.987s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:28:53 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-948c15d0-b1d3-47b1-bb80-888bcc3732a1 tempest-VolumesSnapshotListTestJSON-397503495 None] Creating offline snapshot e481bdd7-bffa-41c1-97fe-d2fe63800110 of volume eef24cd6-1cc6-4c1a-a23c-498dc5ed1406 {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:28:53 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[af67f380-55c9-4346-a975-1355475532d6]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:28:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-948c15d0-b1d3-47b1-bb80-888bcc3732a1 tempest-VolumesSnapshotListTestJSON-397503495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.2aa7ce74-7c7e-4ea2-9461-e92efa27f505 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:53 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-bdaab1b9-63c6-445d-add4-b9fb7d78406a tempest-SnapshotsActionsTest-1836243303 None] Create snapshot completed successfully Nov 02 12:28:53 devstack sudo[94532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.2aa7ce74-7c7e-4ea2-9461-e92efa27f505 Nov 02 12:28:53 devstack sudo[94532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:53 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a8d5dc73-534c-4519-a114-c5da80835bfb tempest-SnapshotsActionsTest-1518372145 None] Acquiring lock "cinder-e18a6d78-c460-46bf-842a-c0813acbeee2-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:28:53 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a8d5dc73-534c-4519-a114-c5da80835bfb tempest-SnapshotsActionsTest-1518372145 None] Lock "cinder-e18a6d78-c460-46bf-842a-c0813acbeee2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:28:53 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a8d5dc73-534c-4519-a114-c5da80835bfb tempest-SnapshotsActionsTest-1518372145 None] Acquiring lock "cinder-quobyte-234cad9e-8649-4eca-babb-abeea8ea4d4d" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:28:53 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a8d5dc73-534c-4519-a114-c5da80835bfb tempest-SnapshotsActionsTest-1518372145 None] Lock "cinder-quobyte-234cad9e-8649-4eca-babb-abeea8ea4d4d" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:28:53 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a8d5dc73-534c-4519-a114-c5da80835bfb tempest-SnapshotsActionsTest-1518372145 None] Acquiring lock "cinder-quobyte-e18a6d78-c460-46bf-842a-c0813acbeee2" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:28:53 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a8d5dc73-534c-4519-a114-c5da80835bfb tempest-SnapshotsActionsTest-1518372145 None] Lock "cinder-quobyte-e18a6d78-c460-46bf-842a-c0813acbeee2" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:28:53 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-a8d5dc73-534c-4519-a114-c5da80835bfb tempest-SnapshotsActionsTest-1518372145 None] Deleting offline snapshot e18a6d78-c460-46bf-842a-c0813acbeee2 of volume 234cad9e-8649-4eca-babb-abeea8ea4d4d {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:28:53 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-a8d5dc73-534c-4519-a114-c5da80835bfb tempest-SnapshotsActionsTest-1518372145 None] snapshot_file for this snap is: volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.e18a6d78-c460-46bf-842a-c0813acbeee2 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:28:53 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f5cec9-758d-47ed-b53b-de98a51b3d2e]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:28:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a8d5dc73-534c-4519-a114-c5da80835bfb tempest-SnapshotsActionsTest-1518372145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.e18a6d78-c460-46bf-842a-c0813acbeee2 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:53 devstack sudo[94534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.e18a6d78-c460-46bf-842a-c0813acbeee2 Nov 02 12:28:53 devstack sudo[94534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:53 devstack sudo[94532]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-948c15d0-b1d3-47b1-bb80-888bcc3732a1 tempest-VolumesSnapshotListTestJSON-397503495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.2aa7ce74-7c7e-4ea2-9461-e92efa27f505" returned: 0 in 0.750s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:53 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-948c15d0-b1d3-47b1-bb80-888bcc3732a1 tempest-VolumesSnapshotListTestJSON-397503495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:28:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-948c15d0-b1d3-47b1-bb80-888bcc3732a1 tempest-VolumesSnapshotListTestJSON-397503495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.2aa7ce74-7c7e-4ea2-9461-e92efa27f505,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.e481bdd7-bffa-41c1-97fe-d2fe63800110 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:53 devstack sudo[94539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.2aa7ce74-7c7e-4ea2-9461-e92efa27f505,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.e481bdd7-bffa-41c1-97fe-d2fe63800110 1G Nov 02 12:28:53 devstack sudo[94539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:54 devstack sudo[94534]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a8d5dc73-534c-4519-a114-c5da80835bfb tempest-SnapshotsActionsTest-1518372145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.e18a6d78-c460-46bf-842a-c0813acbeee2" returned: 0 in 0.596s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-a8d5dc73-534c-4519-a114-c5da80835bfb tempest-SnapshotsActionsTest-1518372145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-234cad9e-8649-4eca-babb-abeea8ea4d4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:28:54 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ed6676-837b-4b45-b3cc-c2aa356892e4]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:28:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a8d5dc73-534c-4519-a114-c5da80835bfb tempest-SnapshotsActionsTest-1518372145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:54 devstack sudo[94544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 Nov 02 12:28:54 devstack sudo[94544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:54 devstack sudo[94539]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-948c15d0-b1d3-47b1-bb80-888bcc3732a1 tempest-VolumesSnapshotListTestJSON-397503495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.2aa7ce74-7c7e-4ea2-9461-e92efa27f505,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.e481bdd7-bffa-41c1-97fe-d2fe63800110 1G" returned: 0 in 1.099s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-948c15d0-b1d3-47b1-bb80-888bcc3732a1 tempest-VolumesSnapshotListTestJSON-397503495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.2aa7ce74-7c7e-4ea2-9461-e92efa27f505 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.e481bdd7-bffa-41c1-97fe-d2fe63800110 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:55 devstack sudo[94555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.2aa7ce74-7c7e-4ea2-9461-e92efa27f505 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.e481bdd7-bffa-41c1-97fe-d2fe63800110 Nov 02 12:28:55 devstack sudo[94555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:55 devstack sudo[94544]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a8d5dc73-534c-4519-a114-c5da80835bfb tempest-SnapshotsActionsTest-1518372145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845" returned: 0 in 0.970s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:55 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-a8d5dc73-534c-4519-a114-c5da80835bfb tempest-SnapshotsActionsTest-1518372145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-234cad9e-8649-4eca-babb-abeea8ea4d4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:28:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a8d5dc73-534c-4519-a114-c5da80835bfb tempest-SnapshotsActionsTest-1518372145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.e18a6d78-c460-46bf-842a-c0813acbeee2 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:55 devstack sudo[94560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.e18a6d78-c460-46bf-842a-c0813acbeee2 Nov 02 12:28:55 devstack sudo[94560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:55 devstack sudo[94555]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-948c15d0-b1d3-47b1-bb80-888bcc3732a1 tempest-VolumesSnapshotListTestJSON-397503495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.2aa7ce74-7c7e-4ea2-9461-e92efa27f505 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.e481bdd7-bffa-41c1-97fe-d2fe63800110" returned: 0 in 0.597s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:55 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-948c15d0-b1d3-47b1-bb80-888bcc3732a1 tempest-VolumesSnapshotListTestJSON-397503495 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.e481bdd7-bffa-41c1-97fe-d2fe63800110 is being set with open permissions: ugo+rw Nov 02 12:28:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-948c15d0-b1d3-47b1-bb80-888bcc3732a1 tempest-VolumesSnapshotListTestJSON-397503495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.e481bdd7-bffa-41c1-97fe-d2fe63800110 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:55 devstack sudo[94566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.e481bdd7-bffa-41c1-97fe-d2fe63800110 Nov 02 12:28:55 devstack sudo[94566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:55 devstack sudo[94566]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-948c15d0-b1d3-47b1-bb80-888bcc3732a1 tempest-VolumesSnapshotListTestJSON-397503495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.e481bdd7-bffa-41c1-97fe-d2fe63800110" returned: 0 in 0.391s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-948c15d0-b1d3-47b1-bb80-888bcc3732a1 tempest-VolumesSnapshotListTestJSON-397503495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.037s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:28:56 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-948c15d0-b1d3-47b1-bb80-888bcc3732a1 tempest-VolumesSnapshotListTestJSON-397503495 None] Create snapshot completed successfully Nov 02 12:28:56 devstack sudo[94560]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a8d5dc73-534c-4519-a114-c5da80835bfb tempest-SnapshotsActionsTest-1518372145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.e18a6d78-c460-46bf-842a-c0813acbeee2" returned: 0 in 0.832s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a8d5dc73-534c-4519-a114-c5da80835bfb tempest-SnapshotsActionsTest-1518372145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.e18a6d78-c460-46bf-842a-c0813acbeee2 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:56 devstack sudo[94573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.e18a6d78-c460-46bf-842a-c0813acbeee2 Nov 02 12:28:56 devstack sudo[94573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:56 devstack sudo[94573]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a8d5dc73-534c-4519-a114-c5da80835bfb tempest-SnapshotsActionsTest-1518372145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.e18a6d78-c460-46bf-842a-c0813acbeee2" returned: 0 in 0.475s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:56 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a8d5dc73-534c-4519-a114-c5da80835bfb tempest-SnapshotsActionsTest-1518372145 None] Lock "cinder-quobyte-e18a6d78-c460-46bf-842a-c0813acbeee2" released by "_delete_snapshot" :: held 3.053s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:28:56 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a8d5dc73-534c-4519-a114-c5da80835bfb tempest-SnapshotsActionsTest-1518372145 None] Lock "cinder-quobyte-234cad9e-8649-4eca-babb-abeea8ea4d4d" released by "delete_snapshot" :: held 3.089s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:28:56 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-a8d5dc73-534c-4519-a114-c5da80835bfb tempest-SnapshotsActionsTest-1518372145 None] Created reservations ['1b9fa658-23d6-4d47-a8a9-6012c633a0a4', 'e2017205-6e1a-4647-a5a9-d2dec01c924f', '1893afe4-b7ad-42f2-bab8-2ad1ffe28706', 'a6214dac-8d9e-4850-8d20-bda7131470cb'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:28:56 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-a8d5dc73-534c-4519-a114-c5da80835bfb tempest-SnapshotsActionsTest-1518372145 None] Delete snapshot completed successfully. Nov 02 12:28:56 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a8d5dc73-534c-4519-a114-c5da80835bfb tempest-SnapshotsActionsTest-1518372145 None] Lock "cinder-e18a6d78-c460-46bf-842a-c0813acbeee2-delete_snapshot" released by "delete_snapshot" :: held 3.361s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:28:57 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfdc3d68-bcf2-49b9-8500-5ff2016269df tempest-VolumesListAdminTestJSON-1411672450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:28:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bfdc3d68-bcf2-49b9-8500-5ff2016269df tempest-VolumesListAdminTestJSON-1411672450 None] Flow 'volume_create_manager' (d36e89af-f2a0-4b86-8d90-4c6b7fb42dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:28:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bfdc3d68-bcf2-49b9-8500-5ff2016269df tempest-VolumesListAdminTestJSON-1411672450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45087e04-36f9-41cc-b695-6432df034ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bfdc3d68-bcf2-49b9-8500-5ff2016269df tempest-VolumesListAdminTestJSON-1411672450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45087e04-36f9-41cc-b695-6432df034ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-147133557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fa7fe6f-b28d-4f2a-9d17-fa798bfd3bec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ef4c1df91a470d831f77a750f87cf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:28:58Z,use_quota=True,user_id='d95849bf56f548b6b58c182538a95139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bfdc3d68-bcf2-49b9-8500-5ff2016269df tempest-VolumesListAdminTestJSON-1411672450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (877d6ab7-6d55-4796-adf3-ed4883c56289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bfdc3d68-bcf2-49b9-8500-5ff2016269df tempest-VolumesListAdminTestJSON-1411672450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (877d6ab7-6d55-4796-adf3-ed4883c56289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bfdc3d68-bcf2-49b9-8500-5ff2016269df tempest-VolumesListAdminTestJSON-1411672450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104450a4-dd09-4d9d-a7b2-42be3a292efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bfdc3d68-bcf2-49b9-8500-5ff2016269df tempest-VolumesListAdminTestJSON-1411672450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104450a4-dd09-4d9d-a7b2-42be3a292efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fa7fe6f-b28d-4f2a-9d17-fa798bfd3bec', 'volume_name': 'volume-2fa7fe6f-b28d-4f2a-9d17-fa798bfd3bec', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bfdc3d68-bcf2-49b9-8500-5ff2016269df tempest-VolumesListAdminTestJSON-1411672450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc5340ec-e9df-49fb-8307-063fdf14141c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bfdc3d68-bcf2-49b9-8500-5ff2016269df tempest-VolumesListAdminTestJSON-1411672450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc5340ec-e9df-49fb-8307-063fdf14141c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bfdc3d68-bcf2-49b9-8500-5ff2016269df tempest-VolumesListAdminTestJSON-1411672450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (979eb3a2-4f40-4128-adc0-2b8b7c1e06cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:57 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-bfdc3d68-bcf2-49b9-8500-5ff2016269df tempest-VolumesListAdminTestJSON-1411672450 None] Volume 2fa7fe6f-b28d-4f2a-9d17-fa798bfd3bec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fa7fe6f-b28d-4f2a-9d17-fa798bfd3bec', 'volume_size': 1} Nov 02 12:28:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-bfdc3d68-bcf2-49b9-8500-5ff2016269df tempest-VolumesListAdminTestJSON-1411672450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:28:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-bfdc3d68-bcf2-49b9-8500-5ff2016269df tempest-VolumesListAdminTestJSON-1411672450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:28:57 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-bfdc3d68-bcf2-49b9-8500-5ff2016269df tempest-VolumesListAdminTestJSON-1411672450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-147133557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fa7fe6f-b28d-4f2a-9d17-fa798bfd3bec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ef4c1df91a470d831f77a750f87cf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:28:58Z,use_quota=True,user_id='d95849bf56f548b6b58c182538a95139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:28:57 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-bfdc3d68-bcf2-49b9-8500-5ff2016269df tempest-VolumesListAdminTestJSON-1411672450 None] Creating volume 2fa7fe6f-b28d-4f2a-9d17-fa798bfd3bec {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:28:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-bfdc3d68-bcf2-49b9-8500-5ff2016269df tempest-VolumesListAdminTestJSON-1411672450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:28:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-bfdc3d68-bcf2-49b9-8500-5ff2016269df tempest-VolumesListAdminTestJSON-1411672450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:28:57 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-bfdc3d68-bcf2-49b9-8500-5ff2016269df tempest-VolumesListAdminTestJSON-1411672450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:28:57 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-bfdc3d68-bcf2-49b9-8500-5ff2016269df tempest-VolumesListAdminTestJSON-1411672450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:28:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-bfdc3d68-bcf2-49b9-8500-5ff2016269df tempest-VolumesListAdminTestJSON-1411672450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:28:57 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-bfdc3d68-bcf2-49b9-8500-5ff2016269df tempest-VolumesListAdminTestJSON-1411672450 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:28:57 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-bfdc3d68-bcf2-49b9-8500-5ff2016269df tempest-VolumesListAdminTestJSON-1411672450 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:28:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bfdc3d68-bcf2-49b9-8500-5ff2016269df tempest-VolumesListAdminTestJSON-1411672450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2fa7fe6f-b28d-4f2a-9d17-fa798bfd3bec 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-cda3c436-fc53-441d-8247-589647187e51 tempest-SnapshotsActionsTest-1836243303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:28:57 devstack sudo[94577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2fa7fe6f-b28d-4f2a-9d17-fa798bfd3bec 1073741824 Nov 02 12:28:57 devstack sudo[94577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:58 devstack sudo[94577]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bfdc3d68-bcf2-49b9-8500-5ff2016269df tempest-VolumesListAdminTestJSON-1411672450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2fa7fe6f-b28d-4f2a-9d17-fa798bfd3bec 1073741824" returned: 0 in 0.832s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bfdc3d68-bcf2-49b9-8500-5ff2016269df tempest-VolumesListAdminTestJSON-1411672450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2fa7fe6f-b28d-4f2a-9d17-fa798bfd3bec {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:58 devstack sudo[94585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2fa7fe6f-b28d-4f2a-9d17-fa798bfd3bec Nov 02 12:28:58 devstack sudo[94585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:58 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0f0864a8-0fc9-4298-9b76-34f09c07291f tempest-VolumesSnapshotListTestJSON-397503495 None] Acquiring lock "cinder-e481bdd7-bffa-41c1-97fe-d2fe63800110-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:28:58 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0f0864a8-0fc9-4298-9b76-34f09c07291f tempest-VolumesSnapshotListTestJSON-397503495 None] Lock "cinder-e481bdd7-bffa-41c1-97fe-d2fe63800110-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:28:58 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0f0864a8-0fc9-4298-9b76-34f09c07291f tempest-VolumesSnapshotListTestJSON-397503495 None] Acquiring lock "cinder-quobyte-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:28:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0f0864a8-0fc9-4298-9b76-34f09c07291f tempest-VolumesSnapshotListTestJSON-397503495 None] Lock "cinder-quobyte-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:28:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0f0864a8-0fc9-4298-9b76-34f09c07291f tempest-VolumesSnapshotListTestJSON-397503495 None] Acquiring lock "cinder-quobyte-e481bdd7-bffa-41c1-97fe-d2fe63800110" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:28:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0f0864a8-0fc9-4298-9b76-34f09c07291f tempest-VolumesSnapshotListTestJSON-397503495 None] Lock "cinder-quobyte-e481bdd7-bffa-41c1-97fe-d2fe63800110" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:28:59 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-0f0864a8-0fc9-4298-9b76-34f09c07291f tempest-VolumesSnapshotListTestJSON-397503495 None] Deleting offline snapshot e481bdd7-bffa-41c1-97fe-d2fe63800110 of volume eef24cd6-1cc6-4c1a-a23c-498dc5ed1406 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:28:59 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-0f0864a8-0fc9-4298-9b76-34f09c07291f tempest-VolumesSnapshotListTestJSON-397503495 None] snapshot_file for this snap is: volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.e481bdd7-bffa-41c1-97fe-d2fe63800110 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:28:59 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbabdc06-4b00-47ad-bbfe-8c4978e31a97]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:28:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0f0864a8-0fc9-4298-9b76-34f09c07291f tempest-VolumesSnapshotListTestJSON-397503495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.e481bdd7-bffa-41c1-97fe-d2fe63800110 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:59 devstack sudo[94587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.e481bdd7-bffa-41c1-97fe-d2fe63800110 Nov 02 12:28:59 devstack sudo[94587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:59 devstack sudo[94585]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bfdc3d68-bcf2-49b9-8500-5ff2016269df tempest-VolumesListAdminTestJSON-1411672450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2fa7fe6f-b28d-4f2a-9d17-fa798bfd3bec" returned: 0 in 0.395s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:59 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-bfdc3d68-bcf2-49b9-8500-5ff2016269df tempest-VolumesListAdminTestJSON-1411672450 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:28:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-bfdc3d68-bcf2-49b9-8500-5ff2016269df tempest-VolumesListAdminTestJSON-1411672450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:28:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-cda3c436-fc53-441d-8247-589647187e51 tempest-SnapshotsActionsTest-1836243303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.273s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:28:59 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bfdc3d68-bcf2-49b9-8500-5ff2016269df tempest-VolumesListAdminTestJSON-1411672450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (979eb3a2-4f40-4128-adc0-2b8b7c1e06cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fa7fe6f-b28d-4f2a-9d17-fa798bfd3bec', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:59 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bfdc3d68-bcf2-49b9-8500-5ff2016269df tempest-VolumesListAdminTestJSON-1411672450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b3f2255-4b47-4e6e-b18e-8f96685490f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:28:59 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-cda3c436-fc53-441d-8247-589647187e51 tempest-SnapshotsActionsTest-1836243303 None] Creating offline snapshot 07500232-2318-4657-9181-7abb2a852a7b of volume 234cad9e-8649-4eca-babb-abeea8ea4d4d {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:28:59 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-bfdc3d68-bcf2-49b9-8500-5ff2016269df tempest-VolumesListAdminTestJSON-1411672450 None] Volume volume-2fa7fe6f-b28d-4f2a-9d17-fa798bfd3bec (2fa7fe6f-b28d-4f2a-9d17-fa798bfd3bec): created successfully Nov 02 12:28:59 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bfdc3d68-bcf2-49b9-8500-5ff2016269df tempest-VolumesListAdminTestJSON-1411672450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b3f2255-4b47-4e6e-b18e-8f96685490f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:28:59 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bfdc3d68-bcf2-49b9-8500-5ff2016269df tempest-VolumesListAdminTestJSON-1411672450 None] Flow 'volume_create_manager' (d36e89af-f2a0-4b86-8d90-4c6b7fb42dcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:28:59 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d05538f-0800-46f0-846b-b5841faf0052]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:28:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cda3c436-fc53-441d-8247-589647187e51 tempest-SnapshotsActionsTest-1836243303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:59 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-bfdc3d68-bcf2-49b9-8500-5ff2016269df tempest-VolumesListAdminTestJSON-1411672450 None] Created volume successfully. Nov 02 12:28:59 devstack sudo[94590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 Nov 02 12:28:59 devstack sudo[94590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:59 devstack sudo[94587]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0f0864a8-0fc9-4298-9b76-34f09c07291f tempest-VolumesSnapshotListTestJSON-397503495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.e481bdd7-bffa-41c1-97fe-d2fe63800110" returned: 0 in 0.523s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:59 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-0f0864a8-0fc9-4298-9b76-34f09c07291f tempest-VolumesSnapshotListTestJSON-397503495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:28:59 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a777e34-1654-4ec7-930d-32e832e50aeb]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:28:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0f0864a8-0fc9-4298-9b76-34f09c07291f tempest-VolumesSnapshotListTestJSON-397503495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.2aa7ce74-7c7e-4ea2-9461-e92efa27f505 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:59 devstack sudo[94597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.2aa7ce74-7c7e-4ea2-9461-e92efa27f505 Nov 02 12:28:59 devstack sudo[94597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:28:59 devstack sudo[94590]: pam_unix(sudo:session): session closed for user root Nov 02 12:28:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cda3c436-fc53-441d-8247-589647187e51 tempest-SnapshotsActionsTest-1836243303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845" returned: 0 in 0.478s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:28:59 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-cda3c436-fc53-441d-8247-589647187e51 tempest-SnapshotsActionsTest-1836243303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-234cad9e-8649-4eca-babb-abeea8ea4d4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:28:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cda3c436-fc53-441d-8247-589647187e51 tempest-SnapshotsActionsTest-1836243303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.07500232-2318-4657-9181-7abb2a852a7b 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:28:59 devstack sudo[94603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.07500232-2318-4657-9181-7abb2a852a7b 1G Nov 02 12:28:59 devstack sudo[94603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:00 devstack sudo[94597]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0f0864a8-0fc9-4298-9b76-34f09c07291f tempest-VolumesSnapshotListTestJSON-397503495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.2aa7ce74-7c7e-4ea2-9461-e92efa27f505" returned: 0 in 0.684s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:00 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-0f0864a8-0fc9-4298-9b76-34f09c07291f tempest-VolumesSnapshotListTestJSON-397503495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:29:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0f0864a8-0fc9-4298-9b76-34f09c07291f tempest-VolumesSnapshotListTestJSON-397503495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.e481bdd7-bffa-41c1-97fe-d2fe63800110 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:00 devstack sudo[94613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.e481bdd7-bffa-41c1-97fe-d2fe63800110 Nov 02 12:29:00 devstack sudo[94613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:00 devstack sudo[94603]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cda3c436-fc53-441d-8247-589647187e51 tempest-SnapshotsActionsTest-1836243303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.07500232-2318-4657-9181-7abb2a852a7b 1G" returned: 0 in 0.804s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cda3c436-fc53-441d-8247-589647187e51 tempest-SnapshotsActionsTest-1836243303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.07500232-2318-4657-9181-7abb2a852a7b {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:00 devstack sudo[94615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.07500232-2318-4657-9181-7abb2a852a7b Nov 02 12:29:00 devstack sudo[94615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:01 devstack sudo[94613]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0f0864a8-0fc9-4298-9b76-34f09c07291f tempest-VolumesSnapshotListTestJSON-397503495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.e481bdd7-bffa-41c1-97fe-d2fe63800110" returned: 0 in 0.872s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0f0864a8-0fc9-4298-9b76-34f09c07291f tempest-VolumesSnapshotListTestJSON-397503495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.e481bdd7-bffa-41c1-97fe-d2fe63800110 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:01 devstack sudo[94625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.e481bdd7-bffa-41c1-97fe-d2fe63800110 Nov 02 12:29:01 devstack sudo[94625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:01 devstack sudo[94615]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cda3c436-fc53-441d-8247-589647187e51 tempest-SnapshotsActionsTest-1836243303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.07500232-2318-4657-9181-7abb2a852a7b" returned: 0 in 0.624s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:01 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-cda3c436-fc53-441d-8247-589647187e51 tempest-SnapshotsActionsTest-1836243303 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.07500232-2318-4657-9181-7abb2a852a7b is being set with open permissions: ugo+rw Nov 02 12:29:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cda3c436-fc53-441d-8247-589647187e51 tempest-SnapshotsActionsTest-1836243303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.07500232-2318-4657-9181-7abb2a852a7b {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:01 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:UPDATE=116,cinder:SELECT=99,cinder:INSERT=36,cinder:DELETE=10 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:29:01 devstack sudo[94627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.07500232-2318-4657-9181-7abb2a852a7b Nov 02 12:29:01 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:01 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-7874b0be-19ac-4b00-b17c-50700a937bf5 tempest-VolumesListAdminTestJSON-1411672450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:29:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7874b0be-19ac-4b00-b17c-50700a937bf5 tempest-VolumesListAdminTestJSON-1411672450 None] Flow 'volume_create_manager' (4ebde56e-47cc-466e-ab5f-3a08ec2f25a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:29:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7874b0be-19ac-4b00-b17c-50700a937bf5 tempest-VolumesListAdminTestJSON-1411672450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8693f03-213c-44cb-ba9e-6a58a76fdafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7874b0be-19ac-4b00-b17c-50700a937bf5 tempest-VolumesListAdminTestJSON-1411672450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8693f03-213c-44cb-ba9e-6a58a76fdafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-603913347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07506afa-1ae1-4441-8e08-f7f2f18d6688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ef4c1df91a470d831f77a750f87cf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:29:01Z,use_quota=True,user_id='d95849bf56f548b6b58c182538a95139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7874b0be-19ac-4b00-b17c-50700a937bf5 tempest-VolumesListAdminTestJSON-1411672450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364a6dd3-0cc6-4b21-8b8b-9e09efab08eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7874b0be-19ac-4b00-b17c-50700a937bf5 tempest-VolumesListAdminTestJSON-1411672450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364a6dd3-0cc6-4b21-8b8b-9e09efab08eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7874b0be-19ac-4b00-b17c-50700a937bf5 tempest-VolumesListAdminTestJSON-1411672450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f429f36-73e5-43ca-93a5-4ae4b8a141bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7874b0be-19ac-4b00-b17c-50700a937bf5 tempest-VolumesListAdminTestJSON-1411672450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f429f36-73e5-43ca-93a5-4ae4b8a141bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07506afa-1ae1-4441-8e08-f7f2f18d6688', 'volume_name': 'volume-07506afa-1ae1-4441-8e08-f7f2f18d6688', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7874b0be-19ac-4b00-b17c-50700a937bf5 tempest-VolumesListAdminTestJSON-1411672450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61ce780a-07e1-4f22-b591-d139f4ba7288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7874b0be-19ac-4b00-b17c-50700a937bf5 tempest-VolumesListAdminTestJSON-1411672450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61ce780a-07e1-4f22-b591-d139f4ba7288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7874b0be-19ac-4b00-b17c-50700a937bf5 tempest-VolumesListAdminTestJSON-1411672450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d364baa-c7fb-48de-b6b1-f0d9623a5773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:01 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-7874b0be-19ac-4b00-b17c-50700a937bf5 tempest-VolumesListAdminTestJSON-1411672450 None] Volume 07506afa-1ae1-4441-8e08-f7f2f18d6688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07506afa-1ae1-4441-8e08-f7f2f18d6688', 'volume_size': 1} Nov 02 12:29:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7874b0be-19ac-4b00-b17c-50700a937bf5 tempest-VolumesListAdminTestJSON-1411672450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:01 devstack sudo[94625]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0f0864a8-0fc9-4298-9b76-34f09c07291f tempest-VolumesSnapshotListTestJSON-397503495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.e481bdd7-bffa-41c1-97fe-d2fe63800110" returned: 0 in 0.380s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0f0864a8-0fc9-4298-9b76-34f09c07291f tempest-VolumesSnapshotListTestJSON-397503495 None] Lock "cinder-quobyte-e481bdd7-bffa-41c1-97fe-d2fe63800110" released by "_delete_snapshot" :: held 2.615s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0f0864a8-0fc9-4298-9b76-34f09c07291f tempest-VolumesSnapshotListTestJSON-397503495 None] Lock "cinder-quobyte-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406" released by "delete_snapshot" :: held 2.652s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:01 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cda3c436-fc53-441d-8247-589647187e51 tempest-SnapshotsActionsTest-1836243303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.07500232-2318-4657-9181-7abb2a852a7b" returned: 0 in 0.400s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-cda3c436-fc53-441d-8247-589647187e51 tempest-SnapshotsActionsTest-1836243303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.494s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7874b0be-19ac-4b00-b17c-50700a937bf5 tempest-VolumesListAdminTestJSON-1411672450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.279s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:01 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-7874b0be-19ac-4b00-b17c-50700a937bf5 tempest-VolumesListAdminTestJSON-1411672450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-603913347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07506afa-1ae1-4441-8e08-f7f2f18d6688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ef4c1df91a470d831f77a750f87cf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:29:01Z,use_quota=True,user_id='d95849bf56f548b6b58c182538a95139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:29:01 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-7874b0be-19ac-4b00-b17c-50700a937bf5 tempest-VolumesListAdminTestJSON-1411672450 None] Creating volume 07506afa-1ae1-4441-8e08-f7f2f18d6688 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:29:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7874b0be-19ac-4b00-b17c-50700a937bf5 tempest-VolumesListAdminTestJSON-1411672450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7874b0be-19ac-4b00-b17c-50700a937bf5 tempest-VolumesListAdminTestJSON-1411672450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:01 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-7874b0be-19ac-4b00-b17c-50700a937bf5 tempest-VolumesListAdminTestJSON-1411672450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:29:01 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-7874b0be-19ac-4b00-b17c-50700a937bf5 tempest-VolumesListAdminTestJSON-1411672450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:29:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7874b0be-19ac-4b00-b17c-50700a937bf5 tempest-VolumesListAdminTestJSON-1411672450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:01 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-7874b0be-19ac-4b00-b17c-50700a937bf5 tempest-VolumesListAdminTestJSON-1411672450 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:29:01 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-7874b0be-19ac-4b00-b17c-50700a937bf5 tempest-VolumesListAdminTestJSON-1411672450 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:29:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7874b0be-19ac-4b00-b17c-50700a937bf5 tempest-VolumesListAdminTestJSON-1411672450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-07506afa-1ae1-4441-8e08-f7f2f18d6688 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:01 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:UPDATE=105,cinder:SELECT=126,cinder:INSERT=24,cinder:DELETE=8 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:29:01 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-0f0864a8-0fc9-4298-9b76-34f09c07291f tempest-VolumesSnapshotListTestJSON-397503495 None] Created reservations ['03aa554f-5f9e-49c9-ba24-5ce5cad2a7f3', 'f4d823e4-2f0e-425d-a0e9-f9e02b60c4ed', '4abda974-82c2-4fd4-ad8c-64e274b80a3a', 'a1151071-7838-4fc0-9231-6beec2d90774'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:29:01 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-cda3c436-fc53-441d-8247-589647187e51 tempest-SnapshotsActionsTest-1836243303 None] Create snapshot completed successfully Nov 02 12:29:01 devstack sudo[94631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-07506afa-1ae1-4441-8e08-f7f2f18d6688 1073741824 Nov 02 12:29:01 devstack sudo[94631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:01 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-0f0864a8-0fc9-4298-9b76-34f09c07291f tempest-VolumesSnapshotListTestJSON-397503495 None] Delete snapshot completed successfully. Nov 02 12:29:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0f0864a8-0fc9-4298-9b76-34f09c07291f tempest-VolumesSnapshotListTestJSON-397503495 None] Lock "cinder-e481bdd7-bffa-41c1-97fe-d2fe63800110-delete_snapshot" released by "delete_snapshot" :: held 2.938s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:02 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5a4ebd49-cecf-4ead-b03e-cc1cd0b914e9 tempest-VolumesSnapshotListTestJSON-397503495 None] Acquiring lock "cinder-2aa7ce74-7c7e-4ea2-9461-e92efa27f505-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:02 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5a4ebd49-cecf-4ead-b03e-cc1cd0b914e9 tempest-VolumesSnapshotListTestJSON-397503495 None] Lock "cinder-2aa7ce74-7c7e-4ea2-9461-e92efa27f505-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:02 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5a4ebd49-cecf-4ead-b03e-cc1cd0b914e9 tempest-VolumesSnapshotListTestJSON-397503495 None] Acquiring lock "cinder-quobyte-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:02 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5a4ebd49-cecf-4ead-b03e-cc1cd0b914e9 tempest-VolumesSnapshotListTestJSON-397503495 None] Lock "cinder-quobyte-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:02 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5a4ebd49-cecf-4ead-b03e-cc1cd0b914e9 tempest-VolumesSnapshotListTestJSON-397503495 None] Acquiring lock "cinder-quobyte-2aa7ce74-7c7e-4ea2-9461-e92efa27f505" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:02 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5a4ebd49-cecf-4ead-b03e-cc1cd0b914e9 tempest-VolumesSnapshotListTestJSON-397503495 None] Lock "cinder-quobyte-2aa7ce74-7c7e-4ea2-9461-e92efa27f505" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-5a4ebd49-cecf-4ead-b03e-cc1cd0b914e9 tempest-VolumesSnapshotListTestJSON-397503495 None] Deleting offline snapshot 2aa7ce74-7c7e-4ea2-9461-e92efa27f505 of volume eef24cd6-1cc6-4c1a-a23c-498dc5ed1406 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:29:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-5a4ebd49-cecf-4ead-b03e-cc1cd0b914e9 tempest-VolumesSnapshotListTestJSON-397503495 None] snapshot_file for this snap is: volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.2aa7ce74-7c7e-4ea2-9461-e92efa27f505 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:29:02 devstack sudo[94631]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7874b0be-19ac-4b00-b17c-50700a937bf5 tempest-VolumesListAdminTestJSON-1411672450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-07506afa-1ae1-4441-8e08-f7f2f18d6688 1073741824" returned: 0 in 0.750s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:02 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[58065912-aaa0-421e-b765-f339cd6291e2]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:29:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5a4ebd49-cecf-4ead-b03e-cc1cd0b914e9 tempest-VolumesSnapshotListTestJSON-397503495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.2aa7ce74-7c7e-4ea2-9461-e92efa27f505 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7874b0be-19ac-4b00-b17c-50700a937bf5 tempest-VolumesListAdminTestJSON-1411672450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-07506afa-1ae1-4441-8e08-f7f2f18d6688 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:02 devstack sudo[94686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-07506afa-1ae1-4441-8e08-f7f2f18d6688 Nov 02 12:29:02 devstack sudo[94686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:02 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8218df15-19c7-4419-9a8f-bb231e46b786 tempest-SnapshotsActionsTest-1518372145 None] Acquiring lock "cinder-07500232-2318-4657-9181-7abb2a852a7b-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:02 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-dd1f81f8-8ada-4055-ae26-8adbce40165b req-c554627b-1ed2-45af-8125-9e9f50c08346 tempest-ServerActionsTestOtherA-618205716 None] Terminate volume connection completed successfully. Nov 02 12:29:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-dd1f81f8-8ada-4055-ae26-8adbce40165b req-c554627b-1ed2-45af-8125-9e9f50c08346 tempest-ServerActionsTestOtherA-618205716 None] Deleting attachment f9f40510-071e-463a-8752-3d7aafe168c9. {{(pid=86515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:29:02 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8218df15-19c7-4419-9a8f-bb231e46b786 tempest-SnapshotsActionsTest-1518372145 None] Lock "cinder-07500232-2318-4657-9181-7abb2a852a7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:02 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8218df15-19c7-4419-9a8f-bb231e46b786 tempest-SnapshotsActionsTest-1518372145 None] Acquiring lock "cinder-quobyte-234cad9e-8649-4eca-babb-abeea8ea4d4d" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:02 devstack sudo[94684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.2aa7ce74-7c7e-4ea2-9461-e92efa27f505 Nov 02 12:29:02 devstack sudo[94684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:02 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8218df15-19c7-4419-9a8f-bb231e46b786 tempest-SnapshotsActionsTest-1518372145 None] Lock "cinder-quobyte-234cad9e-8649-4eca-babb-abeea8ea4d4d" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:02 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8218df15-19c7-4419-9a8f-bb231e46b786 tempest-SnapshotsActionsTest-1518372145 None] Acquiring lock "cinder-quobyte-07500232-2318-4657-9181-7abb2a852a7b" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:02 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8218df15-19c7-4419-9a8f-bb231e46b786 tempest-SnapshotsActionsTest-1518372145 None] Lock "cinder-quobyte-07500232-2318-4657-9181-7abb2a852a7b" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-8218df15-19c7-4419-9a8f-bb231e46b786 tempest-SnapshotsActionsTest-1518372145 None] Deleting offline snapshot 07500232-2318-4657-9181-7abb2a852a7b of volume 234cad9e-8649-4eca-babb-abeea8ea4d4d {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:29:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-8218df15-19c7-4419-9a8f-bb231e46b786 tempest-SnapshotsActionsTest-1518372145 None] snapshot_file for this snap is: volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.07500232-2318-4657-9181-7abb2a852a7b {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:29:02 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa216a9-a37a-4471-b72d-07dfb3b0c718]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:29:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8218df15-19c7-4419-9a8f-bb231e46b786 tempest-SnapshotsActionsTest-1518372145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.07500232-2318-4657-9181-7abb2a852a7b {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:02 devstack sudo[94686]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7874b0be-19ac-4b00-b17c-50700a937bf5 tempest-VolumesListAdminTestJSON-1411672450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-07506afa-1ae1-4441-8e08-f7f2f18d6688" returned: 0 in 0.327s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-7874b0be-19ac-4b00-b17c-50700a937bf5 tempest-VolumesListAdminTestJSON-1411672450 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:29:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7874b0be-19ac-4b00-b17c-50700a937bf5 tempest-VolumesListAdminTestJSON-1411672450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7874b0be-19ac-4b00-b17c-50700a937bf5 tempest-VolumesListAdminTestJSON-1411672450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d364baa-c7fb-48de-b6b1-f0d9623a5773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07506afa-1ae1-4441-8e08-f7f2f18d6688', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7874b0be-19ac-4b00-b17c-50700a937bf5 tempest-VolumesListAdminTestJSON-1411672450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fedd69b-0ed0-4e4d-81b5-ca4252a307db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:02 devstack sudo[94689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.07500232-2318-4657-9181-7abb2a852a7b Nov 02 12:29:02 devstack sudo[94689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:03 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-7874b0be-19ac-4b00-b17c-50700a937bf5 tempest-VolumesListAdminTestJSON-1411672450 None] Volume volume-07506afa-1ae1-4441-8e08-f7f2f18d6688 (07506afa-1ae1-4441-8e08-f7f2f18d6688): created successfully Nov 02 12:29:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7874b0be-19ac-4b00-b17c-50700a937bf5 tempest-VolumesListAdminTestJSON-1411672450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fedd69b-0ed0-4e4d-81b5-ca4252a307db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7874b0be-19ac-4b00-b17c-50700a937bf5 tempest-VolumesListAdminTestJSON-1411672450 None] Flow 'volume_create_manager' (4ebde56e-47cc-466e-ab5f-3a08ec2f25a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:29:03 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-7874b0be-19ac-4b00-b17c-50700a937bf5 tempest-VolumesListAdminTestJSON-1411672450 None] Created volume successfully. Nov 02 12:29:03 devstack sudo[94684]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5a4ebd49-cecf-4ead-b03e-cc1cd0b914e9 tempest-VolumesSnapshotListTestJSON-397503495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.2aa7ce74-7c7e-4ea2-9461-e92efa27f505" returned: 0 in 0.586s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:03 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-5a4ebd49-cecf-4ead-b03e-cc1cd0b914e9 tempest-VolumesSnapshotListTestJSON-397503495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:29:03 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[54209977-24de-41bd-9051-230f761c887e]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:29:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5a4ebd49-cecf-4ead-b03e-cc1cd0b914e9 tempest-VolumesSnapshotListTestJSON-397503495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.7d72fec5-83c3-434f-90be-982ed2ff6a92 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:03 devstack sudo[94696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.7d72fec5-83c3-434f-90be-982ed2ff6a92 Nov 02 12:29:03 devstack sudo[94696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:03 devstack sudo[94689]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8218df15-19c7-4419-9a8f-bb231e46b786 tempest-SnapshotsActionsTest-1518372145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.07500232-2318-4657-9181-7abb2a852a7b" returned: 0 in 0.583s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:03 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-8218df15-19c7-4419-9a8f-bb231e46b786 tempest-SnapshotsActionsTest-1518372145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-234cad9e-8649-4eca-babb-abeea8ea4d4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:29:03 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[019c0228-2c41-4233-a315-58f14ce9a685]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:29:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8218df15-19c7-4419-9a8f-bb231e46b786 tempest-SnapshotsActionsTest-1518372145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:03 devstack sudo[94696]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5a4ebd49-cecf-4ead-b03e-cc1cd0b914e9 tempest-VolumesSnapshotListTestJSON-397503495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.7d72fec5-83c3-434f-90be-982ed2ff6a92" returned: 0 in 0.439s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:03 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-5a4ebd49-cecf-4ead-b03e-cc1cd0b914e9 tempest-VolumesSnapshotListTestJSON-397503495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:29:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5a4ebd49-cecf-4ead-b03e-cc1cd0b914e9 tempest-VolumesSnapshotListTestJSON-397503495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.2aa7ce74-7c7e-4ea2-9461-e92efa27f505 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:03 devstack sudo[94706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.2aa7ce74-7c7e-4ea2-9461-e92efa27f505 Nov 02 12:29:03 devstack sudo[94706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:03 devstack sudo[94702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 Nov 02 12:29:03 devstack sudo[94702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:03 devstack sudo[94702]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8218df15-19c7-4419-9a8f-bb231e46b786 tempest-SnapshotsActionsTest-1518372145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845" returned: 0 in 0.511s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:03 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-8218df15-19c7-4419-9a8f-bb231e46b786 tempest-SnapshotsActionsTest-1518372145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-234cad9e-8649-4eca-babb-abeea8ea4d4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:29:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8218df15-19c7-4419-9a8f-bb231e46b786 tempest-SnapshotsActionsTest-1518372145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.07500232-2318-4657-9181-7abb2a852a7b {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:04 devstack sudo[94716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.07500232-2318-4657-9181-7abb2a852a7b Nov 02 12:29:04 devstack sudo[94716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:04 devstack sudo[94706]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5a4ebd49-cecf-4ead-b03e-cc1cd0b914e9 tempest-VolumesSnapshotListTestJSON-397503495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.2aa7ce74-7c7e-4ea2-9461-e92efa27f505" returned: 0 in 0.517s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5a4ebd49-cecf-4ead-b03e-cc1cd0b914e9 tempest-VolumesSnapshotListTestJSON-397503495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.2aa7ce74-7c7e-4ea2-9461-e92efa27f505 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaed6f6c-f3d0-44a0-b2fe-858495fbceb1 tempest-VolumesListAdminTestJSON-1411672450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:29:04 devstack sudo[94718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.2aa7ce74-7c7e-4ea2-9461-e92efa27f505 Nov 02 12:29:04 devstack sudo[94718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-aaed6f6c-f3d0-44a0-b2fe-858495fbceb1 tempest-VolumesListAdminTestJSON-1411672450 None] Flow 'volume_create_manager' (0e6293a7-f37f-4531-8d5e-88f5eff5e766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-aaed6f6c-f3d0-44a0-b2fe-858495fbceb1 tempest-VolumesListAdminTestJSON-1411672450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e6133f-35df-4e8d-bdb1-2ef3fa66edb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-aaed6f6c-f3d0-44a0-b2fe-858495fbceb1 tempest-VolumesListAdminTestJSON-1411672450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e6133f-35df-4e8d-bdb1-2ef3fa66edb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1599712544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ac4d7b3-5bca-4ef8-a02d-fb86d95d6426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ef4c1df91a470d831f77a750f87cf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:29:04Z,use_quota=True,user_id='d95849bf56f548b6b58c182538a95139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-aaed6f6c-f3d0-44a0-b2fe-858495fbceb1 tempest-VolumesListAdminTestJSON-1411672450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94d909da-24c6-44a6-bf06-1885404d9330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-aaed6f6c-f3d0-44a0-b2fe-858495fbceb1 tempest-VolumesListAdminTestJSON-1411672450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94d909da-24c6-44a6-bf06-1885404d9330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-aaed6f6c-f3d0-44a0-b2fe-858495fbceb1 tempest-VolumesListAdminTestJSON-1411672450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (650f9c33-0324-4b80-b335-0720f1cf7ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-aaed6f6c-f3d0-44a0-b2fe-858495fbceb1 tempest-VolumesListAdminTestJSON-1411672450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (650f9c33-0324-4b80-b335-0720f1cf7ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ac4d7b3-5bca-4ef8-a02d-fb86d95d6426', 'volume_name': 'volume-1ac4d7b3-5bca-4ef8-a02d-fb86d95d6426', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-aaed6f6c-f3d0-44a0-b2fe-858495fbceb1 tempest-VolumesListAdminTestJSON-1411672450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38f9ee6d-7c00-4c53-943e-27a44b9658ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-aaed6f6c-f3d0-44a0-b2fe-858495fbceb1 tempest-VolumesListAdminTestJSON-1411672450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38f9ee6d-7c00-4c53-943e-27a44b9658ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-aaed6f6c-f3d0-44a0-b2fe-858495fbceb1 tempest-VolumesListAdminTestJSON-1411672450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fd39714-c7a9-4270-ba59-b72d8fddff2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:04 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-aaed6f6c-f3d0-44a0-b2fe-858495fbceb1 tempest-VolumesListAdminTestJSON-1411672450 None] Volume 1ac4d7b3-5bca-4ef8-a02d-fb86d95d6426: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ac4d7b3-5bca-4ef8-a02d-fb86d95d6426', 'volume_size': 1} Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-aaed6f6c-f3d0-44a0-b2fe-858495fbceb1 tempest-VolumesListAdminTestJSON-1411672450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-aaed6f6c-f3d0-44a0-b2fe-858495fbceb1 tempest-VolumesListAdminTestJSON-1411672450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-aaed6f6c-f3d0-44a0-b2fe-858495fbceb1 tempest-VolumesListAdminTestJSON-1411672450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1599712544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ac4d7b3-5bca-4ef8-a02d-fb86d95d6426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0ef4c1df91a470d831f77a750f87cf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:29:04Z,use_quota=True,user_id='d95849bf56f548b6b58c182538a95139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-aaed6f6c-f3d0-44a0-b2fe-858495fbceb1 tempest-VolumesListAdminTestJSON-1411672450 None] Creating volume 1ac4d7b3-5bca-4ef8-a02d-fb86d95d6426 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-aaed6f6c-f3d0-44a0-b2fe-858495fbceb1 tempest-VolumesListAdminTestJSON-1411672450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-aaed6f6c-f3d0-44a0-b2fe-858495fbceb1 tempest-VolumesListAdminTestJSON-1411672450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-aaed6f6c-f3d0-44a0-b2fe-858495fbceb1 tempest-VolumesListAdminTestJSON-1411672450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-aaed6f6c-f3d0-44a0-b2fe-858495fbceb1 tempest-VolumesListAdminTestJSON-1411672450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-aaed6f6c-f3d0-44a0-b2fe-858495fbceb1 tempest-VolumesListAdminTestJSON-1411672450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-aaed6f6c-f3d0-44a0-b2fe-858495fbceb1 tempest-VolumesListAdminTestJSON-1411672450 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:29:04 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-aaed6f6c-f3d0-44a0-b2fe-858495fbceb1 tempest-VolumesListAdminTestJSON-1411672450 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-aaed6f6c-f3d0-44a0-b2fe-858495fbceb1 tempest-VolumesListAdminTestJSON-1411672450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1ac4d7b3-5bca-4ef8-a02d-fb86d95d6426 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:04 devstack sudo[94722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1ac4d7b3-5bca-4ef8-a02d-fb86d95d6426 1073741824 Nov 02 12:29:04 devstack sudo[94722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:04 devstack sudo[94718]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5a4ebd49-cecf-4ead-b03e-cc1cd0b914e9 tempest-VolumesSnapshotListTestJSON-397503495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.2aa7ce74-7c7e-4ea2-9461-e92efa27f505" returned: 0 in 0.341s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5a4ebd49-cecf-4ead-b03e-cc1cd0b914e9 tempest-VolumesSnapshotListTestJSON-397503495 None] Lock "cinder-quobyte-2aa7ce74-7c7e-4ea2-9461-e92efa27f505" released by "_delete_snapshot" :: held 2.074s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:04 devstack sudo[94716]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8218df15-19c7-4419-9a8f-bb231e46b786 tempest-SnapshotsActionsTest-1518372145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.07500232-2318-4657-9181-7abb2a852a7b" returned: 0 in 0.520s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8218df15-19c7-4419-9a8f-bb231e46b786 tempest-SnapshotsActionsTest-1518372145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.07500232-2318-4657-9181-7abb2a852a7b {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5a4ebd49-cecf-4ead-b03e-cc1cd0b914e9 tempest-VolumesSnapshotListTestJSON-397503495 None] Lock "cinder-quobyte-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406" released by "delete_snapshot" :: held 2.117s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:04 devstack sudo[94736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.07500232-2318-4657-9181-7abb2a852a7b Nov 02 12:29:04 devstack sudo[94736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-dd1f81f8-8ada-4055-ae26-8adbce40165b req-285fa14e-4807-407d-9c3c-4fcacd769e05 tempest-ServerActionsTestOtherA-618205716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-5a4ebd49-cecf-4ead-b03e-cc1cd0b914e9 tempest-VolumesSnapshotListTestJSON-397503495 None] Created reservations ['515b5b73-373b-4aaa-8075-57f43b87d5c6', '1031a423-ec67-49c6-838d-be4675ab56f1', '7869e8d5-8454-4ed4-a321-52e11215e9a3', '309d1f73-7c1b-4511-a10f-e1a51da5c99a'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:29:04 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-5a4ebd49-cecf-4ead-b03e-cc1cd0b914e9 tempest-VolumesSnapshotListTestJSON-397503495 None] Delete snapshot completed successfully. Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5a4ebd49-cecf-4ead-b03e-cc1cd0b914e9 tempest-VolumesSnapshotListTestJSON-397503495 None] Lock "cinder-2aa7ce74-7c7e-4ea2-9461-e92efa27f505-delete_snapshot" released by "delete_snapshot" :: held 2.348s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:04 devstack sudo[94722]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-aaed6f6c-f3d0-44a0-b2fe-858495fbceb1 tempest-VolumesListAdminTestJSON-1411672450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1ac4d7b3-5bca-4ef8-a02d-fb86d95d6426 1073741824" returned: 0 in 0.560s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:04 devstack sudo[94736]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-aaed6f6c-f3d0-44a0-b2fe-858495fbceb1 tempest-VolumesListAdminTestJSON-1411672450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1ac4d7b3-5bca-4ef8-a02d-fb86d95d6426 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8218df15-19c7-4419-9a8f-bb231e46b786 tempest-SnapshotsActionsTest-1518372145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.07500232-2318-4657-9181-7abb2a852a7b" returned: 0 in 0.382s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:04 devstack sudo[94743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1ac4d7b3-5bca-4ef8-a02d-fb86d95d6426 Nov 02 12:29:04 devstack sudo[94743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8218df15-19c7-4419-9a8f-bb231e46b786 tempest-SnapshotsActionsTest-1518372145 None] Lock "cinder-quobyte-07500232-2318-4657-9181-7abb2a852a7b" released by "_delete_snapshot" :: held 2.162s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8218df15-19c7-4419-9a8f-bb231e46b786 tempest-SnapshotsActionsTest-1518372145 None] Lock "cinder-quobyte-234cad9e-8649-4eca-babb-abeea8ea4d4d" released by "delete_snapshot" :: held 2.196s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:04 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-8218df15-19c7-4419-9a8f-bb231e46b786 tempest-SnapshotsActionsTest-1518372145 None] Created reservations ['87171a7a-5415-4020-bcd8-b162515efe21', '01a58975-a01a-4afd-9e96-bb8b7e1a4c41', '7d7068a6-cbcf-4953-9202-fdc51e5e8377', '2b838bf8-fba8-447b-bc42-f67449d1e3e2'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:29:05 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-8218df15-19c7-4419-9a8f-bb231e46b786 tempest-SnapshotsActionsTest-1518372145 None] Delete snapshot completed successfully. Nov 02 12:29:05 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8218df15-19c7-4419-9a8f-bb231e46b786 tempest-SnapshotsActionsTest-1518372145 None] Lock "cinder-07500232-2318-4657-9181-7abb2a852a7b-delete_snapshot" released by "delete_snapshot" :: held 2.358s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:05 devstack sudo[94743]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-aaed6f6c-f3d0-44a0-b2fe-858495fbceb1 tempest-VolumesListAdminTestJSON-1411672450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1ac4d7b3-5bca-4ef8-a02d-fb86d95d6426" returned: 0 in 0.265s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:05 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-aaed6f6c-f3d0-44a0-b2fe-858495fbceb1 tempest-VolumesListAdminTestJSON-1411672450 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:29:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-aaed6f6c-f3d0-44a0-b2fe-858495fbceb1 tempest-VolumesListAdminTestJSON-1411672450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-dd1f81f8-8ada-4055-ae26-8adbce40165b req-285fa14e-4807-407d-9c3c-4fcacd769e05 tempest-ServerActionsTestOtherA-618205716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.520s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-aaed6f6c-f3d0-44a0-b2fe-858495fbceb1 tempest-VolumesListAdminTestJSON-1411672450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fd39714-c7a9-4270-ba59-b72d8fddff2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ac4d7b3-5bca-4ef8-a02d-fb86d95d6426', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-aaed6f6c-f3d0-44a0-b2fe-858495fbceb1 tempest-VolumesListAdminTestJSON-1411672450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (349e3647-a0bd-4278-aae5-d19ab464b526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-dd1f81f8-8ada-4055-ae26-8adbce40165b req-285fa14e-4807-407d-9c3c-4fcacd769e05 tempest-ServerActionsTestOtherA-618205716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:05 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-aaed6f6c-f3d0-44a0-b2fe-858495fbceb1 tempest-VolumesListAdminTestJSON-1411672450 None] Volume volume-1ac4d7b3-5bca-4ef8-a02d-fb86d95d6426 (1ac4d7b3-5bca-4ef8-a02d-fb86d95d6426): created successfully Nov 02 12:29:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-aaed6f6c-f3d0-44a0-b2fe-858495fbceb1 tempest-VolumesListAdminTestJSON-1411672450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (349e3647-a0bd-4278-aae5-d19ab464b526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-aaed6f6c-f3d0-44a0-b2fe-858495fbceb1 tempest-VolumesListAdminTestJSON-1411672450 None] Flow 'volume_create_manager' (0e6293a7-f37f-4531-8d5e-88f5eff5e766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:29:05 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-aaed6f6c-f3d0-44a0-b2fe-858495fbceb1 tempest-VolumesListAdminTestJSON-1411672450 None] Created volume successfully. Nov 02 12:29:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-dd1f81f8-8ada-4055-ae26-8adbce40165b req-285fa14e-4807-407d-9c3c-4fcacd769e05 tempest-ServerActionsTestOtherA-618205716 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae', 'name': 'volume-dab32c4f-0a42-4330-9a05-0d6ec70f2441', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '25cf2556-d6cd-4e3e-b60f-aaae2dfafce0', 'enforce_multipath': True} {{(pid=86515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:29:05 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-dd1f81f8-8ada-4055-ae26-8adbce40165b req-285fa14e-4807-407d-9c3c-4fcacd769e05 tempest-ServerActionsTestOtherA-618205716 None] attachment_update completed successfully. Nov 02 12:29:05 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-395feba0-17fc-4b4e-a777-4967b682dc50 tempest-VolumesSnapshotListTestJSON-397503495 None] Acquiring lock "cinder-7d72fec5-83c3-434f-90be-982ed2ff6a92-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:05 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-395feba0-17fc-4b4e-a777-4967b682dc50 tempest-VolumesSnapshotListTestJSON-397503495 None] Lock "cinder-7d72fec5-83c3-434f-90be-982ed2ff6a92-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:05 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-395feba0-17fc-4b4e-a777-4967b682dc50 tempest-VolumesSnapshotListTestJSON-397503495 None] Acquiring lock "cinder-quobyte-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:05 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-395feba0-17fc-4b4e-a777-4967b682dc50 tempest-VolumesSnapshotListTestJSON-397503495 None] Lock "cinder-quobyte-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:05 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-395feba0-17fc-4b4e-a777-4967b682dc50 tempest-VolumesSnapshotListTestJSON-397503495 None] Acquiring lock "cinder-quobyte-7d72fec5-83c3-434f-90be-982ed2ff6a92" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:05 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-395feba0-17fc-4b4e-a777-4967b682dc50 tempest-VolumesSnapshotListTestJSON-397503495 None] Lock "cinder-quobyte-7d72fec5-83c3-434f-90be-982ed2ff6a92" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:05 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-395feba0-17fc-4b4e-a777-4967b682dc50 tempest-VolumesSnapshotListTestJSON-397503495 None] Deleting offline snapshot 7d72fec5-83c3-434f-90be-982ed2ff6a92 of volume eef24cd6-1cc6-4c1a-a23c-498dc5ed1406 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:29:05 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-395feba0-17fc-4b4e-a777-4967b682dc50 tempest-VolumesSnapshotListTestJSON-397503495 None] snapshot_file for this snap is: volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.7d72fec5-83c3-434f-90be-982ed2ff6a92 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:29:05 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb77684-d053-427d-a37f-324e59b5d867]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:29:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-395feba0-17fc-4b4e-a777-4967b682dc50 tempest-VolumesSnapshotListTestJSON-397503495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.7d72fec5-83c3-434f-90be-982ed2ff6a92 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:05 devstack sudo[94846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.7d72fec5-83c3-434f-90be-982ed2ff6a92 Nov 02 12:29:05 devstack sudo[94846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:06 devstack sudo[94846]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-395feba0-17fc-4b4e-a777-4967b682dc50 tempest-VolumesSnapshotListTestJSON-397503495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.7d72fec5-83c3-434f-90be-982ed2ff6a92" returned: 0 in 0.746s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:06 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-395feba0-17fc-4b4e-a777-4967b682dc50 tempest-VolumesSnapshotListTestJSON-397503495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:29:06 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7e3781-eaa0-4312-b6b0-27debc942b35]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:29:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-395feba0-17fc-4b4e-a777-4967b682dc50 tempest-VolumesSnapshotListTestJSON-397503495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-02dc4926-ebb7-43b4-9297-bbf8d9e57589 tempest-SnapshotsActionsTest-1836243303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-02dc4926-ebb7-43b4-9297-bbf8d9e57589 tempest-SnapshotsActionsTest-1836243303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:06 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-02dc4926-ebb7-43b4-9297-bbf8d9e57589 tempest-SnapshotsActionsTest-1836243303 None] Creating offline snapshot fa794412-cca7-4d1e-8d26-87c4a7143985 of volume 234cad9e-8649-4eca-babb-abeea8ea4d4d {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:29:06 devstack sudo[95193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406 Nov 02 12:29:06 devstack sudo[95193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:06 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e29198-c96d-43bc-aa01-044c231f870f]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:29:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-02dc4926-ebb7-43b4-9297-bbf8d9e57589 tempest-SnapshotsActionsTest-1836243303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:06 devstack sudo[95204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 Nov 02 12:29:06 devstack sudo[95204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:07 devstack sudo[95193]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-395feba0-17fc-4b4e-a777-4967b682dc50 tempest-VolumesSnapshotListTestJSON-397503495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406" returned: 0 in 0.668s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-395feba0-17fc-4b4e-a777-4967b682dc50 tempest-VolumesSnapshotListTestJSON-397503495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.7d72fec5-83c3-434f-90be-982ed2ff6a92 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:07 devstack sudo[95213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.7d72fec5-83c3-434f-90be-982ed2ff6a92 Nov 02 12:29:07 devstack sudo[95213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:07 devstack sudo[95204]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-02dc4926-ebb7-43b4-9297-bbf8d9e57589 tempest-SnapshotsActionsTest-1836243303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845" returned: 0 in 0.539s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:07 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-02dc4926-ebb7-43b4-9297-bbf8d9e57589 tempest-SnapshotsActionsTest-1836243303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-234cad9e-8649-4eca-babb-abeea8ea4d4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:29:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-02dc4926-ebb7-43b4-9297-bbf8d9e57589 tempest-SnapshotsActionsTest-1836243303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.fa794412-cca7-4d1e-8d26-87c4a7143985 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:07 devstack sudo[95215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.fa794412-cca7-4d1e-8d26-87c4a7143985 1G Nov 02 12:29:07 devstack sudo[95215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:07 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d3edec9-ba6a-456c-8643-ee670509c548 tempest-VolumesListAdminTestJSON-710114066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:29:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4d3edec9-ba6a-456c-8643-ee670509c548 tempest-VolumesListAdminTestJSON-710114066 None] Flow 'volume_create_manager' (6abfad90-576d-47ac-8382-42151ec30335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:29:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4d3edec9-ba6a-456c-8643-ee670509c548 tempest-VolumesListAdminTestJSON-710114066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d96728-7e90-47f2-a0fc-e3f40afca277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4d3edec9-ba6a-456c-8643-ee670509c548 tempest-VolumesListAdminTestJSON-710114066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d96728-7e90-47f2-a0fc-e3f40afca277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2932d56d-5f0c-4d76-a04a-88df9b875de3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cbc3161b815458d9b32de1aea29d23d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:29:07Z,use_quota=True,user_id='838586780f954435aafe818a8162e1e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4d3edec9-ba6a-456c-8643-ee670509c548 tempest-VolumesListAdminTestJSON-710114066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7584ff64-bd50-450f-a558-66f0e8f51751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4d3edec9-ba6a-456c-8643-ee670509c548 tempest-VolumesListAdminTestJSON-710114066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7584ff64-bd50-450f-a558-66f0e8f51751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4d3edec9-ba6a-456c-8643-ee670509c548 tempest-VolumesListAdminTestJSON-710114066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec6ce8a-49ce-4d17-be75-3ec483140943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4d3edec9-ba6a-456c-8643-ee670509c548 tempest-VolumesListAdminTestJSON-710114066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec6ce8a-49ce-4d17-be75-3ec483140943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2932d56d-5f0c-4d76-a04a-88df9b875de3', 'volume_name': 'volume-2932d56d-5f0c-4d76-a04a-88df9b875de3', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4d3edec9-ba6a-456c-8643-ee670509c548 tempest-VolumesListAdminTestJSON-710114066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af2a984-f2cf-4cc0-81b3-653dbc1e9d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4d3edec9-ba6a-456c-8643-ee670509c548 tempest-VolumesListAdminTestJSON-710114066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af2a984-f2cf-4cc0-81b3-653dbc1e9d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4d3edec9-ba6a-456c-8643-ee670509c548 tempest-VolumesListAdminTestJSON-710114066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (680e87bc-5718-43b6-8afa-1b21c0e955f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:07 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-4d3edec9-ba6a-456c-8643-ee670509c548 tempest-VolumesListAdminTestJSON-710114066 None] Volume 2932d56d-5f0c-4d76-a04a-88df9b875de3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2932d56d-5f0c-4d76-a04a-88df9b875de3', 'volume_size': 1} Nov 02 12:29:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4d3edec9-ba6a-456c-8643-ee670509c548 tempest-VolumesListAdminTestJSON-710114066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:07 devstack sudo[95213]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-395feba0-17fc-4b4e-a777-4967b682dc50 tempest-VolumesSnapshotListTestJSON-397503495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.7d72fec5-83c3-434f-90be-982ed2ff6a92" returned: 0 in 0.462s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-395feba0-17fc-4b4e-a777-4967b682dc50 tempest-VolumesSnapshotListTestJSON-397503495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.7d72fec5-83c3-434f-90be-982ed2ff6a92 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:07 devstack sudo[95221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.7d72fec5-83c3-434f-90be-982ed2ff6a92 Nov 02 12:29:07 devstack sudo[95221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:07 devstack sudo[95221]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-395feba0-17fc-4b4e-a777-4967b682dc50 tempest-VolumesSnapshotListTestJSON-397503495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406.7d72fec5-83c3-434f-90be-982ed2ff6a92" returned: 0 in 0.350s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:08 devstack sudo[95215]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-02dc4926-ebb7-43b4-9297-bbf8d9e57589 tempest-SnapshotsActionsTest-1836243303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.fa794412-cca7-4d1e-8d26-87c4a7143985 1G" returned: 0 in 0.787s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-02dc4926-ebb7-43b4-9297-bbf8d9e57589 tempest-SnapshotsActionsTest-1836243303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.fa794412-cca7-4d1e-8d26-87c4a7143985 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:08 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-395feba0-17fc-4b4e-a777-4967b682dc50 tempest-VolumesSnapshotListTestJSON-397503495 None] Lock "cinder-quobyte-7d72fec5-83c3-434f-90be-982ed2ff6a92" released by "_delete_snapshot" :: held 2.409s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:08 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-395feba0-17fc-4b4e-a777-4967b682dc50 tempest-VolumesSnapshotListTestJSON-397503495 None] Lock "cinder-quobyte-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406" released by "delete_snapshot" :: held 2.438s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:08 devstack sudo[95230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.fa794412-cca7-4d1e-8d26-87c4a7143985 Nov 02 12:29:08 devstack sudo[95230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:08 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-395feba0-17fc-4b4e-a777-4967b682dc50 tempest-VolumesSnapshotListTestJSON-397503495 None] Created reservations ['694114ae-9650-43d7-808e-fa7fb24edce5', '334617d6-be86-4a8d-83cd-a6db33e545e7', '1881bfbd-5464-4d35-a38b-22e359278b13', '5889480c-2bcd-48f1-bcbf-9b046a6c5477'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:29:08 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-395feba0-17fc-4b4e-a777-4967b682dc50 tempest-VolumesSnapshotListTestJSON-397503495 None] Delete snapshot completed successfully. Nov 02 12:29:08 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-395feba0-17fc-4b4e-a777-4967b682dc50 tempest-VolumesSnapshotListTestJSON-397503495 None] Lock "cinder-7d72fec5-83c3-434f-90be-982ed2ff6a92-delete_snapshot" released by "delete_snapshot" :: held 2.599s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:08 devstack sudo[95230]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-02dc4926-ebb7-43b4-9297-bbf8d9e57589 tempest-SnapshotsActionsTest-1836243303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.fa794412-cca7-4d1e-8d26-87c4a7143985" returned: 0 in 0.358s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:08 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-02dc4926-ebb7-43b4-9297-bbf8d9e57589 tempest-SnapshotsActionsTest-1836243303 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.fa794412-cca7-4d1e-8d26-87c4a7143985 is being set with open permissions: ugo+rw Nov 02 12:29:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-02dc4926-ebb7-43b4-9297-bbf8d9e57589 tempest-SnapshotsActionsTest-1836243303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.fa794412-cca7-4d1e-8d26-87c4a7143985 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:08 devstack sudo[95235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.fa794412-cca7-4d1e-8d26-87c4a7143985 Nov 02 12:29:08 devstack sudo[95235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:08 devstack sudo[95235]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-02dc4926-ebb7-43b4-9297-bbf8d9e57589 tempest-SnapshotsActionsTest-1836243303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.fa794412-cca7-4d1e-8d26-87c4a7143985" returned: 0 in 0.283s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-02dc4926-ebb7-43b4-9297-bbf8d9e57589 tempest-SnapshotsActionsTest-1836243303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.118s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4d3edec9-ba6a-456c-8643-ee670509c548 tempest-VolumesListAdminTestJSON-710114066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.159s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:08 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-4d3edec9-ba6a-456c-8643-ee670509c548 tempest-VolumesListAdminTestJSON-710114066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2932d56d-5f0c-4d76-a04a-88df9b875de3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cbc3161b815458d9b32de1aea29d23d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:29:07Z,use_quota=True,user_id='838586780f954435aafe818a8162e1e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:29:08 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-4d3edec9-ba6a-456c-8643-ee670509c548 tempest-VolumesListAdminTestJSON-710114066 None] Creating volume 2932d56d-5f0c-4d76-a04a-88df9b875de3 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:29:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4d3edec9-ba6a-456c-8643-ee670509c548 tempest-VolumesListAdminTestJSON-710114066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4d3edec9-ba6a-456c-8643-ee670509c548 tempest-VolumesListAdminTestJSON-710114066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:08 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-4d3edec9-ba6a-456c-8643-ee670509c548 tempest-VolumesListAdminTestJSON-710114066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:29:08 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-4d3edec9-ba6a-456c-8643-ee670509c548 tempest-VolumesListAdminTestJSON-710114066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:29:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4d3edec9-ba6a-456c-8643-ee670509c548 tempest-VolumesListAdminTestJSON-710114066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:08 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-4d3edec9-ba6a-456c-8643-ee670509c548 tempest-VolumesListAdminTestJSON-710114066 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:29:08 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-4d3edec9-ba6a-456c-8643-ee670509c548 tempest-VolumesListAdminTestJSON-710114066 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:29:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4d3edec9-ba6a-456c-8643-ee670509c548 tempest-VolumesListAdminTestJSON-710114066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2932d56d-5f0c-4d76-a04a-88df9b875de3 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:08 devstack sudo[95238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2932d56d-5f0c-4d76-a04a-88df9b875de3 1073741824 Nov 02 12:29:08 devstack sudo[95238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:08 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-02dc4926-ebb7-43b4-9297-bbf8d9e57589 tempest-SnapshotsActionsTest-1836243303 None] Create snapshot completed successfully Nov 02 12:29:09 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f4f65423-b7b2-4825-8e88-19dec2cb5266 tempest-VolumesSnapshotListTestJSON-397503495 None] Acquiring lock "cinder-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:09 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f4f65423-b7b2-4825-8e88-19dec2cb5266 tempest-VolumesSnapshotListTestJSON-397503495 None] Lock "cinder-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:09 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f4f65423-b7b2-4825-8e88-19dec2cb5266 tempest-VolumesSnapshotListTestJSON-397503495 None] Acquiring lock "cinder-quobyte-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:09 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f4f65423-b7b2-4825-8e88-19dec2cb5266 tempest-VolumesSnapshotListTestJSON-397503495 None] Lock "cinder-quobyte-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406" acquired by "delete_volume" :: waited 0.039s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:09 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e15b8a4-62bd-42c8-8cf4-0dacc4440012]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:29:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f4f65423-b7b2-4825-8e88-19dec2cb5266 tempest-VolumesSnapshotListTestJSON-397503495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:09 devstack sudo[95244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406 Nov 02 12:29:09 devstack sudo[95244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:09 devstack sudo[95238]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4d3edec9-ba6a-456c-8643-ee670509c548 tempest-VolumesListAdminTestJSON-710114066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2932d56d-5f0c-4d76-a04a-88df9b875de3 1073741824" returned: 0 in 0.747s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4d3edec9-ba6a-456c-8643-ee670509c548 tempest-VolumesListAdminTestJSON-710114066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2932d56d-5f0c-4d76-a04a-88df9b875de3 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:09 devstack sudo[95247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2932d56d-5f0c-4d76-a04a-88df9b875de3 Nov 02 12:29:09 devstack sudo[95247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:09 devstack sudo[95244]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f4f65423-b7b2-4825-8e88-19dec2cb5266 tempest-VolumesSnapshotListTestJSON-397503495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406" returned: 0 in 0.708s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f4f65423-b7b2-4825-8e88-19dec2cb5266 tempest-VolumesSnapshotListTestJSON-397503495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:09 devstack sudo[95247]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4d3edec9-ba6a-456c-8643-ee670509c548 tempest-VolumesListAdminTestJSON-710114066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2932d56d-5f0c-4d76-a04a-88df9b875de3" returned: 0 in 0.453s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:10 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-4d3edec9-ba6a-456c-8643-ee670509c548 tempest-VolumesListAdminTestJSON-710114066 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:29:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4d3edec9-ba6a-456c-8643-ee670509c548 tempest-VolumesListAdminTestJSON-710114066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:10 devstack sudo[95253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406 Nov 02 12:29:10 devstack sudo[95253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:10 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4d3edec9-ba6a-456c-8643-ee670509c548 tempest-VolumesListAdminTestJSON-710114066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (680e87bc-5718-43b6-8afa-1b21c0e955f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2932d56d-5f0c-4d76-a04a-88df9b875de3', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:10 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4d3edec9-ba6a-456c-8643-ee670509c548 tempest-VolumesListAdminTestJSON-710114066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062625f3-bf17-4cf6-b860-e5dd6c73f6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:10 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-4d3edec9-ba6a-456c-8643-ee670509c548 tempest-VolumesListAdminTestJSON-710114066 None] Volume volume-2932d56d-5f0c-4d76-a04a-88df9b875de3 (2932d56d-5f0c-4d76-a04a-88df9b875de3): created successfully Nov 02 12:29:10 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4d3edec9-ba6a-456c-8643-ee670509c548 tempest-VolumesListAdminTestJSON-710114066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062625f3-bf17-4cf6-b860-e5dd6c73f6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:10 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4d3edec9-ba6a-456c-8643-ee670509c548 tempest-VolumesListAdminTestJSON-710114066 None] Flow 'volume_create_manager' (6abfad90-576d-47ac-8382-42151ec30335) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:29:10 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-1a23ab8c-08e4-440b-aef2-ebe9694ef322 tempest-SnapshotsActionsTest-1518372145 None] Acquiring lock "cinder-fa794412-cca7-4d1e-8d26-87c4a7143985-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:10 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-4d3edec9-ba6a-456c-8643-ee670509c548 tempest-VolumesListAdminTestJSON-710114066 None] Created volume successfully. Nov 02 12:29:10 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-1a23ab8c-08e4-440b-aef2-ebe9694ef322 tempest-SnapshotsActionsTest-1518372145 None] Lock "cinder-fa794412-cca7-4d1e-8d26-87c4a7143985-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:10 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-1a23ab8c-08e4-440b-aef2-ebe9694ef322 tempest-SnapshotsActionsTest-1518372145 None] Acquiring lock "cinder-quobyte-234cad9e-8649-4eca-babb-abeea8ea4d4d" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:10 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-1a23ab8c-08e4-440b-aef2-ebe9694ef322 tempest-SnapshotsActionsTest-1518372145 None] Lock "cinder-quobyte-234cad9e-8649-4eca-babb-abeea8ea4d4d" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:10 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-1a23ab8c-08e4-440b-aef2-ebe9694ef322 tempest-SnapshotsActionsTest-1518372145 None] Acquiring lock "cinder-quobyte-fa794412-cca7-4d1e-8d26-87c4a7143985" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:10 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-1a23ab8c-08e4-440b-aef2-ebe9694ef322 tempest-SnapshotsActionsTest-1518372145 None] Lock "cinder-quobyte-fa794412-cca7-4d1e-8d26-87c4a7143985" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:10 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-1a23ab8c-08e4-440b-aef2-ebe9694ef322 tempest-SnapshotsActionsTest-1518372145 None] Deleting offline snapshot fa794412-cca7-4d1e-8d26-87c4a7143985 of volume 234cad9e-8649-4eca-babb-abeea8ea4d4d {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:29:10 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-1a23ab8c-08e4-440b-aef2-ebe9694ef322 tempest-SnapshotsActionsTest-1518372145 None] snapshot_file for this snap is: volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.fa794412-cca7-4d1e-8d26-87c4a7143985 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:29:10 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd26ab95-7260-47df-9a77-a458e61d42d0]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:29:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1a23ab8c-08e4-440b-aef2-ebe9694ef322 tempest-SnapshotsActionsTest-1518372145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.fa794412-cca7-4d1e-8d26-87c4a7143985 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:10 devstack sudo[95255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.fa794412-cca7-4d1e-8d26-87c4a7143985 Nov 02 12:29:10 devstack sudo[95255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:10 devstack sudo[95253]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f4f65423-b7b2-4825-8e88-19dec2cb5266 tempest-VolumesSnapshotListTestJSON-397503495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406" returned: 0 in 0.454s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:10 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f4f65423-b7b2-4825-8e88-19dec2cb5266 tempest-VolumesSnapshotListTestJSON-397503495 None] Lock "cinder-quobyte-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406" released by "delete_volume" :: held 1.310s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:10 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-f4f65423-b7b2-4825-8e88-19dec2cb5266 tempest-VolumesSnapshotListTestJSON-397503495 None] Created reservations ['8e91fc83-b18c-464e-8d8f-6fbcd7ddb87a', '87580c2e-d77e-4a74-bd78-6bf36f06f25c', '9e0bdea6-0d68-44cb-a694-a1ac843a441e', '88c0fba5-f01f-45bf-b16a-42d8c69162c0'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:29:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f4f65423-b7b2-4825-8e88-19dec2cb5266 tempest-VolumesSnapshotListTestJSON-397503495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f4f65423-b7b2-4825-8e88-19dec2cb5266 tempest-VolumesSnapshotListTestJSON-397503495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:10 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f4f65423-b7b2-4825-8e88-19dec2cb5266 tempest-VolumesSnapshotListTestJSON-397503495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:29:10 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f4f65423-b7b2-4825-8e88-19dec2cb5266 tempest-VolumesSnapshotListTestJSON-397503495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:29:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f4f65423-b7b2-4825-8e88-19dec2cb5266 tempest-VolumesSnapshotListTestJSON-397503495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f4f65423-b7b2-4825-8e88-19dec2cb5266 tempest-VolumesSnapshotListTestJSON-397503495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:10 devstack sudo[95260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:29:10 devstack sudo[95260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:10 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-74d88a49-8ac3-4521-a457-53e71d1dbf23 tempest-VolumesListAdminTestJSON-710114066 None] Acquiring lock "cinder-2932d56d-5f0c-4d76-a04a-88df9b875de3-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:10 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-74d88a49-8ac3-4521-a457-53e71d1dbf23 tempest-VolumesListAdminTestJSON-710114066 None] Lock "cinder-2932d56d-5f0c-4d76-a04a-88df9b875de3-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:10 devstack sudo[95255]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1a23ab8c-08e4-440b-aef2-ebe9694ef322 tempest-SnapshotsActionsTest-1518372145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.fa794412-cca7-4d1e-8d26-87c4a7143985" returned: 0 in 0.668s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:10 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-1a23ab8c-08e4-440b-aef2-ebe9694ef322 tempest-SnapshotsActionsTest-1518372145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-234cad9e-8649-4eca-babb-abeea8ea4d4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:29:11 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2783693-214c-4300-8167-4507f4908531]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:29:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1a23ab8c-08e4-440b-aef2-ebe9694ef322 tempest-SnapshotsActionsTest-1518372145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:11 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-74d88a49-8ac3-4521-a457-53e71d1dbf23 tempest-VolumesListAdminTestJSON-710114066 None] Acquiring lock "cinder-quobyte-2932d56d-5f0c-4d76-a04a-88df9b875de3" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:11 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-74d88a49-8ac3-4521-a457-53e71d1dbf23 tempest-VolumesListAdminTestJSON-710114066 None] Lock "cinder-quobyte-2932d56d-5f0c-4d76-a04a-88df9b875de3" acquired by "delete_volume" :: waited 0.041s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:11 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-48e62b8e-db71-4723-8b47-39c5d454a568 tempest-VolumesListAdminTestJSON-1411672450 None] Acquiring lock "cinder-1ac4d7b3-5bca-4ef8-a02d-fb86d95d6426-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:11 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c4463a-db2f-45a7-987e-6d8714265253]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:29:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-74d88a49-8ac3-4521-a457-53e71d1dbf23 tempest-VolumesListAdminTestJSON-710114066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2932d56d-5f0c-4d76-a04a-88df9b875de3 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:11 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-48e62b8e-db71-4723-8b47-39c5d454a568 tempest-VolumesListAdminTestJSON-1411672450 None] Lock "cinder-1ac4d7b3-5bca-4ef8-a02d-fb86d95d6426-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:11 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-48e62b8e-db71-4723-8b47-39c5d454a568 tempest-VolumesListAdminTestJSON-1411672450 None] Acquiring lock "cinder-quobyte-1ac4d7b3-5bca-4ef8-a02d-fb86d95d6426" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:11 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-48e62b8e-db71-4723-8b47-39c5d454a568 tempest-VolumesListAdminTestJSON-1411672450 None] Lock "cinder-quobyte-1ac4d7b3-5bca-4ef8-a02d-fb86d95d6426" acquired by "delete_volume" :: waited 0.053s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:11 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab6a7df-d902-4b78-875c-f14d3561d0f6]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:29:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-48e62b8e-db71-4723-8b47-39c5d454a568 tempest-VolumesListAdminTestJSON-1411672450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1ac4d7b3-5bca-4ef8-a02d-fb86d95d6426 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:11 devstack sudo[95265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 Nov 02 12:29:11 devstack sudo[95265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:11 devstack sudo[95260]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f4f65423-b7b2-4825-8e88-19dec2cb5266 tempest-VolumesSnapshotListTestJSON-397503495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.766s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:11 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-f4f65423-b7b2-4825-8e88-19dec2cb5266 tempest-VolumesSnapshotListTestJSON-397503495 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:29:11 devstack sudo[95266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2932d56d-5f0c-4d76-a04a-88df9b875de3 Nov 02 12:29:11 devstack sudo[95266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:11 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-f4f65423-b7b2-4825-8e88-19dec2cb5266 tempest-VolumesSnapshotListTestJSON-397503495 None] Deleted volume successfully. Nov 02 12:29:11 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f4f65423-b7b2-4825-8e88-19dec2cb5266 tempest-VolumesSnapshotListTestJSON-397503495 None] Lock "cinder-eef24cd6-1cc6-4c1a-a23c-498dc5ed1406-delete_volume" released by "delete_volume" :: held 2.566s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:11 devstack sudo[95267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1ac4d7b3-5bca-4ef8-a02d-fb86d95d6426 Nov 02 12:29:11 devstack sudo[95267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:12 devstack sudo[95266]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-74d88a49-8ac3-4521-a457-53e71d1dbf23 tempest-VolumesListAdminTestJSON-710114066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2932d56d-5f0c-4d76-a04a-88df9b875de3" returned: 0 in 0.922s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-74d88a49-8ac3-4521-a457-53e71d1dbf23 tempest-VolumesListAdminTestJSON-710114066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2932d56d-5f0c-4d76-a04a-88df9b875de3 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:12 devstack sudo[95267]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-48e62b8e-db71-4723-8b47-39c5d454a568 tempest-VolumesListAdminTestJSON-1411672450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1ac4d7b3-5bca-4ef8-a02d-fb86d95d6426" returned: 0 in 0.741s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-48e62b8e-db71-4723-8b47-39c5d454a568 tempest-VolumesListAdminTestJSON-1411672450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1ac4d7b3-5bca-4ef8-a02d-fb86d95d6426 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:12 devstack sudo[95282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2932d56d-5f0c-4d76-a04a-88df9b875de3 Nov 02 12:29:12 devstack sudo[95282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:12 devstack sudo[95283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1ac4d7b3-5bca-4ef8-a02d-fb86d95d6426 Nov 02 12:29:12 devstack sudo[95283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:12 devstack sudo[95265]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1a23ab8c-08e4-440b-aef2-ebe9694ef322 tempest-SnapshotsActionsTest-1518372145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845" returned: 0 in 1.271s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:12 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-1a23ab8c-08e4-440b-aef2-ebe9694ef322 tempest-SnapshotsActionsTest-1518372145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-234cad9e-8649-4eca-babb-abeea8ea4d4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:29:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1a23ab8c-08e4-440b-aef2-ebe9694ef322 tempest-SnapshotsActionsTest-1518372145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.fa794412-cca7-4d1e-8d26-87c4a7143985 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:12 devstack sudo[95286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.fa794412-cca7-4d1e-8d26-87c4a7143985 Nov 02 12:29:12 devstack sudo[95286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:12 devstack sudo[95283]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-48e62b8e-db71-4723-8b47-39c5d454a568 tempest-VolumesListAdminTestJSON-1411672450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1ac4d7b3-5bca-4ef8-a02d-fb86d95d6426" returned: 0 in 0.548s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:12 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-48e62b8e-db71-4723-8b47-39c5d454a568 tempest-VolumesListAdminTestJSON-1411672450 None] Lock "cinder-quobyte-1ac4d7b3-5bca-4ef8-a02d-fb86d95d6426" released by "delete_volume" :: held 1.365s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:12 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-48e62b8e-db71-4723-8b47-39c5d454a568 tempest-VolumesListAdminTestJSON-1411672450 None] Created reservations ['6e53c2c5-9ae1-4122-83b3-b816928f0e28', '73f98bee-e7ba-45f9-a1d0-f141986d331d', 'fec65bc2-fd1f-4037-97ac-5218e802fcb4', '038b81c2-1ac4-4679-840e-19cdece21a37'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:29:12 devstack sudo[95282]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-74d88a49-8ac3-4521-a457-53e71d1dbf23 tempest-VolumesListAdminTestJSON-710114066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2932d56d-5f0c-4d76-a04a-88df9b875de3" returned: 0 in 0.771s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:12 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-74d88a49-8ac3-4521-a457-53e71d1dbf23 tempest-VolumesListAdminTestJSON-710114066 None] Lock "cinder-quobyte-2932d56d-5f0c-4d76-a04a-88df9b875de3" released by "delete_volume" :: held 1.784s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-48e62b8e-db71-4723-8b47-39c5d454a568 tempest-VolumesListAdminTestJSON-1411672450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-48e62b8e-db71-4723-8b47-39c5d454a568 tempest-VolumesListAdminTestJSON-1411672450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:12 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-48e62b8e-db71-4723-8b47-39c5d454a568 tempest-VolumesListAdminTestJSON-1411672450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:29:12 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-48e62b8e-db71-4723-8b47-39c5d454a568 tempest-VolumesListAdminTestJSON-1411672450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:29:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-48e62b8e-db71-4723-8b47-39c5d454a568 tempest-VolumesListAdminTestJSON-1411672450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-48e62b8e-db71-4723-8b47-39c5d454a568 tempest-VolumesListAdminTestJSON-1411672450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:13 devstack sudo[95295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:29:13 devstack sudo[95295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:13 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-74d88a49-8ac3-4521-a457-53e71d1dbf23 tempest-VolumesListAdminTestJSON-710114066 None] Created reservations ['09a0061c-204f-4917-a2bc-afc771eecebb', '538608a5-3dec-4d48-8508-b29a9e33b147', 'e01dbef9-e6d4-4128-a39a-2ea40e129e56', '2b972824-6c2f-42a5-84c9-2ca060ef7d6e'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:29:13 devstack sudo[95286]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1a23ab8c-08e4-440b-aef2-ebe9694ef322 tempest-SnapshotsActionsTest-1518372145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.fa794412-cca7-4d1e-8d26-87c4a7143985" returned: 0 in 0.869s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1a23ab8c-08e4-440b-aef2-ebe9694ef322 tempest-SnapshotsActionsTest-1518372145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.fa794412-cca7-4d1e-8d26-87c4a7143985 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:13 devstack sudo[95297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.fa794412-cca7-4d1e-8d26-87c4a7143985 Nov 02 12:29:13 devstack sudo[95297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-74d88a49-8ac3-4521-a457-53e71d1dbf23 tempest-VolumesListAdminTestJSON-710114066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-74d88a49-8ac3-4521-a457-53e71d1dbf23 tempest-VolumesListAdminTestJSON-710114066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:13 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-74d88a49-8ac3-4521-a457-53e71d1dbf23 tempest-VolumesListAdminTestJSON-710114066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:29:13 devstack sudo[95295]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:13 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-74d88a49-8ac3-4521-a457-53e71d1dbf23 tempest-VolumesListAdminTestJSON-710114066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:29:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-74d88a49-8ac3-4521-a457-53e71d1dbf23 tempest-VolumesListAdminTestJSON-710114066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-74d88a49-8ac3-4521-a457-53e71d1dbf23 tempest-VolumesListAdminTestJSON-710114066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-48e62b8e-db71-4723-8b47-39c5d454a568 tempest-VolumesListAdminTestJSON-1411672450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.371s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:13 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-48e62b8e-db71-4723-8b47-39c5d454a568 tempest-VolumesListAdminTestJSON-1411672450 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:29:13 devstack sudo[95300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:29:13 devstack sudo[95300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:13 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-48e62b8e-db71-4723-8b47-39c5d454a568 tempest-VolumesListAdminTestJSON-1411672450 None] Deleted volume successfully. Nov 02 12:29:13 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-48e62b8e-db71-4723-8b47-39c5d454a568 tempest-VolumesListAdminTestJSON-1411672450 None] Lock "cinder-1ac4d7b3-5bca-4ef8-a02d-fb86d95d6426-delete_volume" released by "delete_volume" :: held 2.246s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:13 devstack sudo[95297]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1a23ab8c-08e4-440b-aef2-ebe9694ef322 tempest-SnapshotsActionsTest-1518372145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.fa794412-cca7-4d1e-8d26-87c4a7143985" returned: 0 in 0.356s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:13 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-1a23ab8c-08e4-440b-aef2-ebe9694ef322 tempest-SnapshotsActionsTest-1518372145 None] Lock "cinder-quobyte-fa794412-cca7-4d1e-8d26-87c4a7143985" released by "_delete_snapshot" :: held 3.404s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:13 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-1a23ab8c-08e4-440b-aef2-ebe9694ef322 tempest-SnapshotsActionsTest-1518372145 None] Lock "cinder-quobyte-234cad9e-8649-4eca-babb-abeea8ea4d4d" released by "delete_snapshot" :: held 3.452s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:13 devstack sudo[95300]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-74d88a49-8ac3-4521-a457-53e71d1dbf23 tempest-VolumesListAdminTestJSON-710114066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.429s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:13 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-74d88a49-8ac3-4521-a457-53e71d1dbf23 tempest-VolumesListAdminTestJSON-710114066 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:29:13 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-74d88a49-8ac3-4521-a457-53e71d1dbf23 tempest-VolumesListAdminTestJSON-710114066 None] Deleted volume successfully. Nov 02 12:29:13 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-74d88a49-8ac3-4521-a457-53e71d1dbf23 tempest-VolumesListAdminTestJSON-710114066 None] Lock "cinder-2932d56d-5f0c-4d76-a04a-88df9b875de3-delete_volume" released by "delete_volume" :: held 2.919s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:13 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-1a23ab8c-08e4-440b-aef2-ebe9694ef322 tempest-SnapshotsActionsTest-1518372145 None] Created reservations ['f8c480ea-d13f-486d-b6bc-aa50f5ddb69e', 'e32490e3-aa8c-41d1-babf-0d22dcbe74db', '507e844c-e6c5-4355-8001-0cb963bbc2ef', 'c4e9b6e6-c339-45a1-8f39-f297ed5c2d61'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:29:13 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-acac941d-8b36-4efe-97d4-1bace6a47a56 tempest-VolumesListAdminTestJSON-1411672450 None] Acquiring lock "cinder-07506afa-1ae1-4441-8e08-f7f2f18d6688-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:13 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-acac941d-8b36-4efe-97d4-1bace6a47a56 tempest-VolumesListAdminTestJSON-1411672450 None] Lock "cinder-07506afa-1ae1-4441-8e08-f7f2f18d6688-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:13 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-1a23ab8c-08e4-440b-aef2-ebe9694ef322 tempest-SnapshotsActionsTest-1518372145 None] Delete snapshot completed successfully. Nov 02 12:29:13 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-1a23ab8c-08e4-440b-aef2-ebe9694ef322 tempest-SnapshotsActionsTest-1518372145 None] Lock "cinder-fa794412-cca7-4d1e-8d26-87c4a7143985-delete_snapshot" released by "delete_snapshot" :: held 3.807s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:13 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-acac941d-8b36-4efe-97d4-1bace6a47a56 tempest-VolumesListAdminTestJSON-1411672450 None] Acquiring lock "cinder-quobyte-07506afa-1ae1-4441-8e08-f7f2f18d6688" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:13 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-acac941d-8b36-4efe-97d4-1bace6a47a56 tempest-VolumesListAdminTestJSON-1411672450 None] Lock "cinder-quobyte-07506afa-1ae1-4441-8e08-f7f2f18d6688" acquired by "delete_volume" :: waited 0.018s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:14 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cec317-e0d5-4b66-9a72-0818ba000df7]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:29:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-acac941d-8b36-4efe-97d4-1bace6a47a56 tempest-VolumesListAdminTestJSON-1411672450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-07506afa-1ae1-4441-8e08-f7f2f18d6688 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:14 devstack sudo[95306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-07506afa-1ae1-4441-8e08-f7f2f18d6688 Nov 02 12:29:14 devstack sudo[95306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:14 devstack sudo[95306]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-acac941d-8b36-4efe-97d4-1bace6a47a56 tempest-VolumesListAdminTestJSON-1411672450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-07506afa-1ae1-4441-8e08-f7f2f18d6688" returned: 0 in 0.437s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-acac941d-8b36-4efe-97d4-1bace6a47a56 tempest-VolumesListAdminTestJSON-1411672450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-07506afa-1ae1-4441-8e08-f7f2f18d6688 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:14 devstack sudo[95311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-07506afa-1ae1-4441-8e08-f7f2f18d6688 Nov 02 12:29:14 devstack sudo[95311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:14 devstack sudo[95311]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-acac941d-8b36-4efe-97d4-1bace6a47a56 tempest-VolumesListAdminTestJSON-1411672450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-07506afa-1ae1-4441-8e08-f7f2f18d6688" returned: 0 in 0.463s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:14 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-acac941d-8b36-4efe-97d4-1bace6a47a56 tempest-VolumesListAdminTestJSON-1411672450 None] Lock "cinder-quobyte-07506afa-1ae1-4441-8e08-f7f2f18d6688" released by "delete_volume" :: held 0.961s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:15 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-acac941d-8b36-4efe-97d4-1bace6a47a56 tempest-VolumesListAdminTestJSON-1411672450 None] Created reservations ['ee751313-3804-4ac0-b80d-fef7e3d21845', '2977f0c1-91f5-40b6-b2ff-698a7c81e308', '24d93761-5ee2-4952-b1ae-f7912280f2dd', '0f7f1eb9-dff9-4802-b649-763b5bd68c3d'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:29:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-acac941d-8b36-4efe-97d4-1bace6a47a56 tempest-VolumesListAdminTestJSON-1411672450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-acac941d-8b36-4efe-97d4-1bace6a47a56 tempest-VolumesListAdminTestJSON-1411672450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:15 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-acac941d-8b36-4efe-97d4-1bace6a47a56 tempest-VolumesListAdminTestJSON-1411672450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:29:15 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-acac941d-8b36-4efe-97d4-1bace6a47a56 tempest-VolumesListAdminTestJSON-1411672450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:29:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-acac941d-8b36-4efe-97d4-1bace6a47a56 tempest-VolumesListAdminTestJSON-1411672450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-acac941d-8b36-4efe-97d4-1bace6a47a56 tempest-VolumesListAdminTestJSON-1411672450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:15 devstack sudo[95314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:29:15 devstack sudo[95314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:15 devstack sudo[95314]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-acac941d-8b36-4efe-97d4-1bace6a47a56 tempest-VolumesListAdminTestJSON-1411672450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.349s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:15 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-acac941d-8b36-4efe-97d4-1bace6a47a56 tempest-VolumesListAdminTestJSON-1411672450 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:29:15 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-acac941d-8b36-4efe-97d4-1bace6a47a56 tempest-VolumesListAdminTestJSON-1411672450 None] Deleted volume successfully. Nov 02 12:29:15 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-acac941d-8b36-4efe-97d4-1bace6a47a56 tempest-VolumesListAdminTestJSON-1411672450 None] Lock "cinder-07506afa-1ae1-4441-8e08-f7f2f18d6688-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:15 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a9b69e79-44d4-4044-8fe8-4689151dcf43 tempest-SnapshotsActionsTest-1836243303 None] Acquiring lock "cinder-008ca792-2770-49a6-9e17-3e8548b65845-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:15 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a9b69e79-44d4-4044-8fe8-4689151dcf43 tempest-SnapshotsActionsTest-1836243303 None] Lock "cinder-008ca792-2770-49a6-9e17-3e8548b65845-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:15 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a9b69e79-44d4-4044-8fe8-4689151dcf43 tempest-SnapshotsActionsTest-1836243303 None] Acquiring lock "cinder-quobyte-234cad9e-8649-4eca-babb-abeea8ea4d4d" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:15 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a9b69e79-44d4-4044-8fe8-4689151dcf43 tempest-SnapshotsActionsTest-1836243303 None] Lock "cinder-quobyte-234cad9e-8649-4eca-babb-abeea8ea4d4d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:15 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a9b69e79-44d4-4044-8fe8-4689151dcf43 tempest-SnapshotsActionsTest-1836243303 None] Acquiring lock "cinder-quobyte-008ca792-2770-49a6-9e17-3e8548b65845" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:15 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a9b69e79-44d4-4044-8fe8-4689151dcf43 tempest-SnapshotsActionsTest-1836243303 None] Lock "cinder-quobyte-008ca792-2770-49a6-9e17-3e8548b65845" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:15 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-a9b69e79-44d4-4044-8fe8-4689151dcf43 tempest-SnapshotsActionsTest-1836243303 None] Deleting offline snapshot 008ca792-2770-49a6-9e17-3e8548b65845 of volume 234cad9e-8649-4eca-babb-abeea8ea4d4d {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:29:15 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-a9b69e79-44d4-4044-8fe8-4689151dcf43 tempest-SnapshotsActionsTest-1836243303 None] snapshot_file for this snap is: volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:29:15 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bd87e8-4737-4206-b816-591db2eed5fa]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:29:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a9b69e79-44d4-4044-8fe8-4689151dcf43 tempest-SnapshotsActionsTest-1836243303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:15 devstack sudo[95317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 Nov 02 12:29:15 devstack sudo[95317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:16 devstack sudo[95317]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a9b69e79-44d4-4044-8fe8-4689151dcf43 tempest-SnapshotsActionsTest-1836243303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845" returned: 0 in 0.376s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:16 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-a9b69e79-44d4-4044-8fe8-4689151dcf43 tempest-SnapshotsActionsTest-1836243303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-234cad9e-8649-4eca-babb-abeea8ea4d4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:29:16 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb8dadf-0c2a-4827-90ba-b3478f972d5c]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:29:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a9b69e79-44d4-4044-8fe8-4689151dcf43 tempest-SnapshotsActionsTest-1836243303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:16 devstack sudo[95322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d Nov 02 12:29:16 devstack sudo[95322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:16 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f12a1acf-1cfc-4324-9042-414b64767921 tempest-VolumesListAdminTestJSON-1411672450 None] Acquiring lock "cinder-2fa7fe6f-b28d-4f2a-9d17-fa798bfd3bec-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:16 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f12a1acf-1cfc-4324-9042-414b64767921 tempest-VolumesListAdminTestJSON-1411672450 None] Lock "cinder-2fa7fe6f-b28d-4f2a-9d17-fa798bfd3bec-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:16 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f12a1acf-1cfc-4324-9042-414b64767921 tempest-VolumesListAdminTestJSON-1411672450 None] Acquiring lock "cinder-quobyte-2fa7fe6f-b28d-4f2a-9d17-fa798bfd3bec" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:16 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f12a1acf-1cfc-4324-9042-414b64767921 tempest-VolumesListAdminTestJSON-1411672450 None] Lock "cinder-quobyte-2fa7fe6f-b28d-4f2a-9d17-fa798bfd3bec" acquired by "delete_volume" :: waited 0.024s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:16 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edb0439-7831-4320-8a90-7665d497785c]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:29:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f12a1acf-1cfc-4324-9042-414b64767921 tempest-VolumesListAdminTestJSON-1411672450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2fa7fe6f-b28d-4f2a-9d17-fa798bfd3bec {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:16 devstack sudo[95322]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a9b69e79-44d4-4044-8fe8-4689151dcf43 tempest-SnapshotsActionsTest-1836243303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d" returned: 0 in 0.430s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a9b69e79-44d4-4044-8fe8-4689151dcf43 tempest-SnapshotsActionsTest-1836243303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:16 devstack sudo[95328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 Nov 02 12:29:16 devstack sudo[95328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:16 devstack sudo[95327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2fa7fe6f-b28d-4f2a-9d17-fa798bfd3bec Nov 02 12:29:16 devstack sudo[95327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:16 devstack sudo[95327]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f12a1acf-1cfc-4324-9042-414b64767921 tempest-VolumesListAdminTestJSON-1411672450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2fa7fe6f-b28d-4f2a-9d17-fa798bfd3bec" returned: 0 in 0.433s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f12a1acf-1cfc-4324-9042-414b64767921 tempest-VolumesListAdminTestJSON-1411672450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2fa7fe6f-b28d-4f2a-9d17-fa798bfd3bec {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:16 devstack sudo[95328]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a9b69e79-44d4-4044-8fe8-4689151dcf43 tempest-SnapshotsActionsTest-1836243303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845" returned: 0 in 0.407s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a9b69e79-44d4-4044-8fe8-4689151dcf43 tempest-SnapshotsActionsTest-1836243303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:16 devstack sudo[95337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2fa7fe6f-b28d-4f2a-9d17-fa798bfd3bec Nov 02 12:29:16 devstack sudo[95337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:16 devstack sudo[95339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845 Nov 02 12:29:16 devstack sudo[95339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:17 devstack sudo[95337]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f12a1acf-1cfc-4324-9042-414b64767921 tempest-VolumesListAdminTestJSON-1411672450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2fa7fe6f-b28d-4f2a-9d17-fa798bfd3bec" returned: 0 in 0.301s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:17 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f12a1acf-1cfc-4324-9042-414b64767921 tempest-VolumesListAdminTestJSON-1411672450 None] Lock "cinder-quobyte-2fa7fe6f-b28d-4f2a-9d17-fa798bfd3bec" released by "delete_volume" :: held 0.805s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:17 devstack sudo[95339]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a9b69e79-44d4-4044-8fe8-4689151dcf43 tempest-SnapshotsActionsTest-1836243303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d.008ca792-2770-49a6-9e17-3e8548b65845" returned: 0 in 0.348s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:17 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-f12a1acf-1cfc-4324-9042-414b64767921 tempest-VolumesListAdminTestJSON-1411672450 None] Created reservations ['cfece783-90c9-4b01-bc30-8f4097c16cbf', '692fd640-81c8-4b4b-90f3-1fabf435008d', 'f60cba7f-b471-4543-98c0-a28dd552a287', 'f12b2552-9803-44d7-9e26-8775f2110100'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:29:17 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a9b69e79-44d4-4044-8fe8-4689151dcf43 tempest-SnapshotsActionsTest-1836243303 None] Lock "cinder-quobyte-008ca792-2770-49a6-9e17-3e8548b65845" released by "_delete_snapshot" :: held 1.680s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:17 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a9b69e79-44d4-4044-8fe8-4689151dcf43 tempest-SnapshotsActionsTest-1836243303 None] Lock "cinder-quobyte-234cad9e-8649-4eca-babb-abeea8ea4d4d" released by "delete_snapshot" :: held 1.707s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f12a1acf-1cfc-4324-9042-414b64767921 tempest-VolumesListAdminTestJSON-1411672450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f12a1acf-1cfc-4324-9042-414b64767921 tempest-VolumesListAdminTestJSON-1411672450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f12a1acf-1cfc-4324-9042-414b64767921 tempest-VolumesListAdminTestJSON-1411672450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:29:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f12a1acf-1cfc-4324-9042-414b64767921 tempest-VolumesListAdminTestJSON-1411672450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:29:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f12a1acf-1cfc-4324-9042-414b64767921 tempest-VolumesListAdminTestJSON-1411672450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f12a1acf-1cfc-4324-9042-414b64767921 tempest-VolumesListAdminTestJSON-1411672450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:17 devstack sudo[95343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:29:17 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:17 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-a9b69e79-44d4-4044-8fe8-4689151dcf43 tempest-SnapshotsActionsTest-1836243303 None] Created reservations ['c68c38aa-3ef7-40d6-afaf-b74ee1487a6f', '8cd5fc42-5c42-41b0-84ba-3b4c1db37db5', 'cf0a02b3-5d66-46b5-8818-8649f2d774b5', 'e7ea9783-64a7-4474-b95b-77bba3d49d0e'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:29:17 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-a9b69e79-44d4-4044-8fe8-4689151dcf43 tempest-SnapshotsActionsTest-1836243303 None] Delete snapshot completed successfully. Nov 02 12:29:17 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a9b69e79-44d4-4044-8fe8-4689151dcf43 tempest-SnapshotsActionsTest-1836243303 None] Lock "cinder-008ca792-2770-49a6-9e17-3e8548b65845-delete_snapshot" released by "delete_snapshot" :: held 2.100s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:17 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f12a1acf-1cfc-4324-9042-414b64767921 tempest-VolumesListAdminTestJSON-1411672450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.325s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:17 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-f12a1acf-1cfc-4324-9042-414b64767921 tempest-VolumesListAdminTestJSON-1411672450 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:29:17 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-f12a1acf-1cfc-4324-9042-414b64767921 tempest-VolumesListAdminTestJSON-1411672450 None] Deleted volume successfully. Nov 02 12:29:17 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f12a1acf-1cfc-4324-9042-414b64767921 tempest-VolumesListAdminTestJSON-1411672450 None] Lock "cinder-2fa7fe6f-b28d-4f2a-9d17-fa798bfd3bec-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:18 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-cf501e0d-ef84-41f0-822b-9afc289f8183 tempest-SnapshotsActionsTest-1836243303 None] Acquiring lock "cinder-234cad9e-8649-4eca-babb-abeea8ea4d4d-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:18 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-cf501e0d-ef84-41f0-822b-9afc289f8183 tempest-SnapshotsActionsTest-1836243303 None] Lock "cinder-234cad9e-8649-4eca-babb-abeea8ea4d4d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:18 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-cf501e0d-ef84-41f0-822b-9afc289f8183 tempest-SnapshotsActionsTest-1836243303 None] Acquiring lock "cinder-quobyte-234cad9e-8649-4eca-babb-abeea8ea4d4d" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:18 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-cf501e0d-ef84-41f0-822b-9afc289f8183 tempest-SnapshotsActionsTest-1836243303 None] Lock "cinder-quobyte-234cad9e-8649-4eca-babb-abeea8ea4d4d" acquired by "delete_volume" :: waited 0.021s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:18 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed73ce19-21e6-45a9-a077-eab18dd461ee]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:29:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cf501e0d-ef84-41f0-822b-9afc289f8183 tempest-SnapshotsActionsTest-1836243303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:18 devstack sudo[95346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d Nov 02 12:29:18 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:18 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cf501e0d-ef84-41f0-822b-9afc289f8183 tempest-SnapshotsActionsTest-1836243303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d" returned: 0 in 0.467s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cf501e0d-ef84-41f0-822b-9afc289f8183 tempest-SnapshotsActionsTest-1836243303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:18 devstack sudo[95352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d Nov 02 12:29:18 devstack sudo[95352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:18 devstack sudo[95352]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cf501e0d-ef84-41f0-822b-9afc289f8183 tempest-SnapshotsActionsTest-1836243303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-234cad9e-8649-4eca-babb-abeea8ea4d4d" returned: 0 in 0.317s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:18 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-cf501e0d-ef84-41f0-822b-9afc289f8183 tempest-SnapshotsActionsTest-1836243303 None] Lock "cinder-quobyte-234cad9e-8649-4eca-babb-abeea8ea4d4d" released by "delete_volume" :: held 0.864s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:19 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-cf501e0d-ef84-41f0-822b-9afc289f8183 tempest-SnapshotsActionsTest-1836243303 None] Created reservations ['3fb0737e-4c10-4d6b-a657-b8b37513af5b', '7eb99833-f9c7-4b46-9dc3-8f61d2363442', 'b5cc2a2e-0d02-4052-a017-593ff7d2846a', 'd19722b8-9522-4990-b997-640c9a75e1e8'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:29:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-cf501e0d-ef84-41f0-822b-9afc289f8183 tempest-SnapshotsActionsTest-1836243303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-cf501e0d-ef84-41f0-822b-9afc289f8183 tempest-SnapshotsActionsTest-1836243303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:19 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-cf501e0d-ef84-41f0-822b-9afc289f8183 tempest-SnapshotsActionsTest-1836243303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:29:19 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-cf501e0d-ef84-41f0-822b-9afc289f8183 tempest-SnapshotsActionsTest-1836243303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:29:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-cf501e0d-ef84-41f0-822b-9afc289f8183 tempest-SnapshotsActionsTest-1836243303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cf501e0d-ef84-41f0-822b-9afc289f8183 tempest-SnapshotsActionsTest-1836243303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:19 devstack sudo[95355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:29:19 devstack sudo[95355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:19 devstack sudo[95355]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cf501e0d-ef84-41f0-822b-9afc289f8183 tempest-SnapshotsActionsTest-1836243303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.462s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:19 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-cf501e0d-ef84-41f0-822b-9afc289f8183 tempest-SnapshotsActionsTest-1836243303 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:29:19 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-cf501e0d-ef84-41f0-822b-9afc289f8183 tempest-SnapshotsActionsTest-1836243303 None] Deleted volume successfully. Nov 02 12:29:19 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-cf501e0d-ef84-41f0-822b-9afc289f8183 tempest-SnapshotsActionsTest-1836243303 None] Lock "cinder-234cad9e-8649-4eca-babb-abeea8ea4d4d-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:23 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:29:23 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Flow 'volume_create_manager' (b06c759c-9747-488a-a4a9-1d422867998c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:29:23 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6390ddd3-a5c1-4ffb-84b4-2159b390c31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:23 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6390ddd3-a5c1-4ffb-84b4-2159b390c31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6848fd58-cf58-43cf-946b-499946751efb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44abb6f893e047c9a629c84ea555b373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:29:23Z,use_quota=True,user_id='087cf1c908b74948b8a0fef8979279c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffd50b6f-0413-44f7-ae85-2e1351df17c5),volume_type_id=ffd50b6f-0413-44f7-ae85-2e1351df17c5)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:23 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b522b1a-b146-4ecb-8ec8-bce6f6af2fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:23 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b522b1a-b146-4ecb-8ec8-bce6f6af2fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:23 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0090df77-dddd-41f5-a68b-e370a3ac804f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:23 devstack cinder-volume[86515]: DEBUG cinder.image.glance [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Creating Keystone auth plugin from conf {{(pid=86515) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 12:29:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0090df77-dddd-41f5-a68b-e370a3ac804f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6848fd58-cf58-43cf-946b-499946751efb', 'volume_name': 'volume-6848fd58-cf58-43cf-946b-499946751efb', 'volume_size': 1, 'image_id': '85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b1df18ac685d1ea94534aacca7b33ac4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '44abb6f893e047c9a629c84ea555b373', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6030b16e75d3b0b88c89a49e531a0cb67860d13b63dce4f80d43bbf44b4155b792f7e1474f6d36439264835cf545e7f837b46cb883a8eef4da32ca0f656f4088', 'id': '85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb', 'created_at': datetime.datetime(2026, 11, 2, 11, 29, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 29, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f033946-cb7b-4ecb-82ac-a2c37926bcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f033946-cb7b-4ecb-82ac-a2c37926bcf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc30cd76-b9a3-4ce2-be55-63d9696c434e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:24 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Volume 6848fd58-cf58-43cf-946b-499946751efb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6848fd58-cf58-43cf-946b-499946751efb', 'volume_size': 1, 'image_id': '85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b1df18ac685d1ea94534aacca7b33ac4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '44abb6f893e047c9a629c84ea555b373', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6030b16e75d3b0b88c89a49e531a0cb67860d13b63dce4f80d43bbf44b4155b792f7e1474f6d36439264835cf545e7f837b46cb883a8eef4da32ca0f656f4088', 'id': '85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb', 'created_at': datetime.datetime(2026, 11, 2, 11, 29, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 29, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 02 12:29:24 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Trying to clone 6848fd58-cf58-43cf-946b-499946751efb from image 85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb at location (None, [{'url': 'file:///opt/stack/data/glance/images/85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb', 'metadata': {}}]). {{(pid=86515) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1127}} Nov 02 12:29:24 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb_zsaqtx5idevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86515) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 12:29:24 devstack cinder-volume[86515]: INFO cinder.image.image_utils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Image download 0.00 MB at 0.00 MB/s Nov 02 12:29:24 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9aa4626-66a7-4db8-bfac-5a09ca72f9fd]: (4, 'raw') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:29:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb_zsaqtx5idevstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:24 devstack sudo[95360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb_zsaqtx5idevstack@QuobyteHD Nov 02 12:29:24 devstack sudo[95360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb_zsaqtx5idevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:24 devstack sudo[95360]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb_zsaqtx5idevstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:24 devstack sudo[95365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb_zsaqtx5idevstack@QuobyteHD Nov 02 12:29:24 devstack sudo[95365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:25 devstack sudo[95365]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb_zsaqtx5idevstack@QuobyteHD" returned: 1 in 0.438s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb_zsaqtx5idevstack@QuobyteHD' failed. Not Retrying. {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:29:25 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Temporary image 85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb is fetched for user 087cf1c908b74948b8a0fef8979279c0. {{(pid=86515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 12:29:25 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[2421b644-13c0-4807-ab68-9258a830d793]: (4, 'raw') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:29:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb_zsaqtx5idevstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:25 devstack sudo[95373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb_zsaqtx5idevstack@QuobyteHD Nov 02 12:29:25 devstack sudo[95373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:25 devstack sudo[95373]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb_zsaqtx5idevstack@QuobyteHD" returned: 0 in 0.358s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb_zsaqtx5idevstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:25 devstack sudo[95401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb_zsaqtx5idevstack@QuobyteHD Nov 02 12:29:25 devstack sudo[95401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:25 devstack sudo[95401]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb_zsaqtx5idevstack@QuobyteHD" returned: 1 in 0.340s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb_zsaqtx5idevstack@QuobyteHD' failed. Not Retrying. {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:29:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:26 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6848fd58-cf58-43cf-946b-499946751efb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44abb6f893e047c9a629c84ea555b373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:29:23Z,use_quota=True,user_id='087cf1c908b74948b8a0fef8979279c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffd50b6f-0413-44f7-ae85-2e1351df17c5),volume_type_id=ffd50b6f-0413-44f7-ae85-2e1351df17c5)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:29:26 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Creating volume 6848fd58-cf58-43cf-946b-499946751efb {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:29:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:26 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:29:26 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:29:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:26 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:29:26 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:29:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6848fd58-cf58-43cf-946b-499946751efb 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:26 devstack sudo[95406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6848fd58-cf58-43cf-946b-499946751efb 1073741824 Nov 02 12:29:26 devstack sudo[95406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:26 devstack sudo[95406]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6848fd58-cf58-43cf-946b-499946751efb 1073741824" returned: 0 in 0.555s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6848fd58-cf58-43cf-946b-499946751efb {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:26 devstack sudo[95418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6848fd58-cf58-43cf-946b-499946751efb Nov 02 12:29:26 devstack sudo[95418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:26 devstack sudo[95418]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6848fd58-cf58-43cf-946b-499946751efb" returned: 0 in 0.301s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:26 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:29:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:26 devstack cinder-volume[86515]: DEBUG cinder.volume.volume_utils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Attempting download of 85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb ((None, [{'url': 'file:///opt/stack/data/glance/images/85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb', 'metadata': {}}])) to volume 6848fd58-cf58-43cf-946b-499946751efb. {{(pid=86515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 12:29:27 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[70781c8d-47c0-443c-82e4-efaee52ce4ce]: (4, 'raw') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:29:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb_apu3xa31 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:27 devstack sudo[95421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb_apu3xa31 Nov 02 12:29:27 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:27 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb_apu3xa31" returned: 0 in 0.395s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb_apu3xa31 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:27 devstack sudo[95425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb_apu3xa31 Nov 02 12:29:27 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:27 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb_apu3xa31" returned: 1 in 0.344s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb_apu3xa31' failed. Not Retrying. {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:29:27 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff16f038-00c6-4164-ad79-795f23d58456]: (4, 'raw') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:29:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb_zsaqtx5idevstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:27 devstack sudo[95429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb_zsaqtx5idevstack@QuobyteHD Nov 02 12:29:27 devstack sudo[95429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:28 devstack sudo[95429]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb_zsaqtx5idevstack@QuobyteHD" returned: 0 in 0.376s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb_zsaqtx5idevstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:28 devstack sudo[95433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb_zsaqtx5idevstack@QuobyteHD Nov 02 12:29:28 devstack sudo[95433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:28 devstack sudo[95433]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb_zsaqtx5idevstack@QuobyteHD" returned: 1 in 0.434s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb_zsaqtx5idevstack@QuobyteHD' failed. Not Retrying. {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:29:28 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] 85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb was raw, converting to qcow2 {{(pid=86515) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 12:29:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb_zsaqtx5idevstack@QuobyteHD /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6848fd58-cf58-43cf-946b-499946751efb {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:28 devstack sudo[95438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb_zsaqtx5idevstack@QuobyteHD /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6848fd58-cf58-43cf-946b-499946751efb Nov 02 12:29:28 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:29 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb_zsaqtx5idevstack@QuobyteHD /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6848fd58-cf58-43cf-946b-499946751efb" returned: 0 in 0.477s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:29 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb_zsaqtx5idevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6848fd58-cf58-43cf-946b-499946751efb {{(pid=86515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 12:29:29 devstack cinder-volume[86515]: INFO cinder.image.image_utils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 12:29:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6848fd58-cf58-43cf-946b-499946751efb 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:29 devstack sudo[95444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6848fd58-cf58-43cf-946b-499946751efb 1G Nov 02 12:29:29 devstack sudo[95444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:29 devstack sudo[95444]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6848fd58-cf58-43cf-946b-499946751efb 1G" returned: 0 in 0.316s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:29 devstack cinder-volume[86515]: DEBUG cinder.volume.volume_utils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Downloaded image 85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb ((None, [{'url': 'file:///opt/stack/data/glance/images/85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb', 'metadata': {}}])) to volume 6848fd58-cf58-43cf-946b-499946751efb successfully. {{(pid=86515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 12:29:29 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Temporary image 85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb for user 087cf1c908b74948b8a0fef8979279c0 is deleted. {{(pid=86515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 12:29:29 devstack cinder-volume[86515]: DEBUG cinder.volume.volume_utils [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Marking volume 6848fd58-cf58-43cf-946b-499946751efb as bootable. {{(pid=86515) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 12:29:29 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Copying metadata from image 85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb to 6848fd58-cf58-43cf-946b-499946751efb. {{(pid=86515) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 12:29:29 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Creating volume glance metadata for volume 6848fd58-cf58-43cf-946b-499946751efb backed by image 85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'b1df18ac685d1ea94534aacca7b33ac4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86515) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 12:29:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc30cd76-b9a3-4ce2-be55-63d9696c434e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6848fd58-cf58-43cf-946b-499946751efb', 'volume_size': 1, 'image_id': '85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b1df18ac685d1ea94534aacca7b33ac4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '44abb6f893e047c9a629c84ea555b373', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6030b16e75d3b0b88c89a49e531a0cb67860d13b63dce4f80d43bbf44b4155b792f7e1474f6d36439264835cf545e7f837b46cb883a8eef4da32ca0f656f4088', 'id': '85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb', 'created_at': datetime.datetime(2026, 11, 2, 11, 29, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 29, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/85fb2937-3e70-4e1f-a5ba-5713c4e2bcfb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52e23d66-eb9c-4127-8b11-f00fa8482b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:29 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Volume volume-6848fd58-cf58-43cf-946b-499946751efb (6848fd58-cf58-43cf-946b-499946751efb): created successfully Nov 02 12:29:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52e23d66-eb9c-4127-8b11-f00fa8482b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Flow 'volume_create_manager' (b06c759c-9747-488a-a4a9-1d422867998c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:29:29 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-ee703c97-dd11-4624-8b04-cf534d99d391 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Created volume successfully. Nov 02 12:29:29 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c93e5a47-03ab-46f3-b9dc-5ab2e3b2bec6 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Acquiring lock "cinder-6848fd58-cf58-43cf-946b-499946751efb-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:29 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c93e5a47-03ab-46f3-b9dc-5ab2e3b2bec6 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Lock "cinder-6848fd58-cf58-43cf-946b-499946751efb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:29 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c93e5a47-03ab-46f3-b9dc-5ab2e3b2bec6 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Acquiring lock "cinder-quobyte-6848fd58-cf58-43cf-946b-499946751efb" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:29 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c93e5a47-03ab-46f3-b9dc-5ab2e3b2bec6 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Lock "cinder-quobyte-6848fd58-cf58-43cf-946b-499946751efb" acquired by "delete_volume" :: waited 0.017s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[9140a9b5-687e-4199-8b05-ca9985901db2]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c93e5a47-03ab-46f3-b9dc-5ab2e3b2bec6 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6848fd58-cf58-43cf-946b-499946751efb {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:30 devstack sudo[95449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6848fd58-cf58-43cf-946b-499946751efb Nov 02 12:29:30 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b336e59-b181-4c94-9fbe-1155d4dfcd93 tempest-AbsoluteLimitsTests-1768649772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5b336e59-b181-4c94-9fbe-1155d4dfcd93 tempest-AbsoluteLimitsTests-1768649772 None] Flow 'volume_create_manager' (ee69597e-a61e-4265-8a11-d5a15ac33014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5b336e59-b181-4c94-9fbe-1155d4dfcd93 tempest-AbsoluteLimitsTests-1768649772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (130ca462-8319-4ac8-900a-86bbc594a806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5b336e59-b181-4c94-9fbe-1155d4dfcd93 tempest-AbsoluteLimitsTests-1768649772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (130ca462-8319-4ac8-900a-86bbc594a806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-538201068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e79b0a9-8770-4da2-948a-9b0b18e528a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c700fc53b449d6a99db6a336a0d1cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:29:30Z,use_quota=True,user_id='9b14132fab9e4c40be9f6329e97adad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5b336e59-b181-4c94-9fbe-1155d4dfcd93 tempest-AbsoluteLimitsTests-1768649772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec15a49f-75ab-4561-a0b0-38cb8081ed16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5b336e59-b181-4c94-9fbe-1155d4dfcd93 tempest-AbsoluteLimitsTests-1768649772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec15a49f-75ab-4561-a0b0-38cb8081ed16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:30 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5b336e59-b181-4c94-9fbe-1155d4dfcd93 tempest-AbsoluteLimitsTests-1768649772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9cc7e59-f2c6-4dfe-a7a1-8bab71b3635e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5b336e59-b181-4c94-9fbe-1155d4dfcd93 tempest-AbsoluteLimitsTests-1768649772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9cc7e59-f2c6-4dfe-a7a1-8bab71b3635e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e79b0a9-8770-4da2-948a-9b0b18e528a6', 'volume_name': 'volume-6e79b0a9-8770-4da2-948a-9b0b18e528a6', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5b336e59-b181-4c94-9fbe-1155d4dfcd93 tempest-AbsoluteLimitsTests-1768649772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61fa3b75-58fc-439d-af68-bc11c39b59af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5b336e59-b181-4c94-9fbe-1155d4dfcd93 tempest-AbsoluteLimitsTests-1768649772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61fa3b75-58fc-439d-af68-bc11c39b59af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5b336e59-b181-4c94-9fbe-1155d4dfcd93 tempest-AbsoluteLimitsTests-1768649772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b11d7f-6425-49df-8055-a63436bc862a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:30 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-5b336e59-b181-4c94-9fbe-1155d4dfcd93 tempest-AbsoluteLimitsTests-1768649772 None] Volume 6e79b0a9-8770-4da2-948a-9b0b18e528a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e79b0a9-8770-4da2-948a-9b0b18e528a6', 'volume_size': 1} Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5b336e59-b181-4c94-9fbe-1155d4dfcd93 tempest-AbsoluteLimitsTests-1768649772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5b336e59-b181-4c94-9fbe-1155d4dfcd93 tempest-AbsoluteLimitsTests-1768649772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5b336e59-b181-4c94-9fbe-1155d4dfcd93 tempest-AbsoluteLimitsTests-1768649772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-538201068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e79b0a9-8770-4da2-948a-9b0b18e528a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c700fc53b449d6a99db6a336a0d1cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:29:30Z,use_quota=True,user_id='9b14132fab9e4c40be9f6329e97adad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-5b336e59-b181-4c94-9fbe-1155d4dfcd93 tempest-AbsoluteLimitsTests-1768649772 None] Creating volume 6e79b0a9-8770-4da2-948a-9b0b18e528a6 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5b336e59-b181-4c94-9fbe-1155d4dfcd93 tempest-AbsoluteLimitsTests-1768649772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5b336e59-b181-4c94-9fbe-1155d4dfcd93 tempest-AbsoluteLimitsTests-1768649772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5b336e59-b181-4c94-9fbe-1155d4dfcd93 tempest-AbsoluteLimitsTests-1768649772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5b336e59-b181-4c94-9fbe-1155d4dfcd93 tempest-AbsoluteLimitsTests-1768649772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5b336e59-b181-4c94-9fbe-1155d4dfcd93 tempest-AbsoluteLimitsTests-1768649772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5b336e59-b181-4c94-9fbe-1155d4dfcd93 tempest-AbsoluteLimitsTests-1768649772 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:29:30 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-5b336e59-b181-4c94-9fbe-1155d4dfcd93 tempest-AbsoluteLimitsTests-1768649772 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5b336e59-b181-4c94-9fbe-1155d4dfcd93 tempest-AbsoluteLimitsTests-1768649772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6e79b0a9-8770-4da2-948a-9b0b18e528a6 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c93e5a47-03ab-46f3-b9dc-5ab2e3b2bec6 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6848fd58-cf58-43cf-946b-499946751efb" returned: 0 in 0.461s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c93e5a47-03ab-46f3-b9dc-5ab2e3b2bec6 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6848fd58-cf58-43cf-946b-499946751efb {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:30 devstack sudo[95455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6e79b0a9-8770-4da2-948a-9b0b18e528a6 1073741824 Nov 02 12:29:30 devstack sudo[95455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:30 devstack sudo[95456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6848fd58-cf58-43cf-946b-499946751efb Nov 02 12:29:30 devstack sudo[95456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:30 devstack sudo[95456]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c93e5a47-03ab-46f3-b9dc-5ab2e3b2bec6 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6848fd58-cf58-43cf-946b-499946751efb" returned: 0 in 0.294s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c93e5a47-03ab-46f3-b9dc-5ab2e3b2bec6 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Lock "cinder-quobyte-6848fd58-cf58-43cf-946b-499946751efb" released by "delete_volume" :: held 0.809s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:30 devstack cinder-volume[86515]: WARNING cinder.quota [None req-c93e5a47-03ab-46f3-b9dc-5ab2e3b2bec6 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:29:30 devstack cinder-volume[86515]: WARNING cinder.quota [None req-c93e5a47-03ab-46f3-b9dc-5ab2e3b2bec6 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-c93e5a47-03ab-46f3-b9dc-5ab2e3b2bec6 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Created reservations ['959320a9-10a7-467e-beaf-d3f6a2887c9c', '0c1a083a-2def-415b-981e-789bae6636b3', '8fe62d53-e0ed-4ef8-9740-818f9e294dc8', '3a4ad1fb-ed16-4b59-a426-6944268a4bdf'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c93e5a47-03ab-46f3-b9dc-5ab2e3b2bec6 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c93e5a47-03ab-46f3-b9dc-5ab2e3b2bec6 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-c93e5a47-03ab-46f3-b9dc-5ab2e3b2bec6 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-c93e5a47-03ab-46f3-b9dc-5ab2e3b2bec6 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c93e5a47-03ab-46f3-b9dc-5ab2e3b2bec6 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c93e5a47-03ab-46f3-b9dc-5ab2e3b2bec6 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:30 devstack sudo[95455]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5b336e59-b181-4c94-9fbe-1155d4dfcd93 tempest-AbsoluteLimitsTests-1768649772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6e79b0a9-8770-4da2-948a-9b0b18e528a6 1073741824" returned: 0 in 0.482s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:30 devstack sudo[95465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:29:30 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5b336e59-b181-4c94-9fbe-1155d4dfcd93 tempest-AbsoluteLimitsTests-1768649772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6e79b0a9-8770-4da2-948a-9b0b18e528a6 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:31 devstack sudo[95467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6e79b0a9-8770-4da2-948a-9b0b18e528a6 Nov 02 12:29:31 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:31 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c93e5a47-03ab-46f3-b9dc-5ab2e3b2bec6 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.252s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:31 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-c93e5a47-03ab-46f3-b9dc-5ab2e3b2bec6 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:29:31 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-c93e5a47-03ab-46f3-b9dc-5ab2e3b2bec6 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Deleted volume successfully. Nov 02 12:29:31 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c93e5a47-03ab-46f3-b9dc-5ab2e3b2bec6 tempest-VolumeAndVolumeTypeFromImageTest-1780125341 None] Lock "cinder-6848fd58-cf58-43cf-946b-499946751efb-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:31 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5b336e59-b181-4c94-9fbe-1155d4dfcd93 tempest-AbsoluteLimitsTests-1768649772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6e79b0a9-8770-4da2-948a-9b0b18e528a6" returned: 0 in 0.278s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:31 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5b336e59-b181-4c94-9fbe-1155d4dfcd93 tempest-AbsoluteLimitsTests-1768649772 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:29:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5b336e59-b181-4c94-9fbe-1155d4dfcd93 tempest-AbsoluteLimitsTests-1768649772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5b336e59-b181-4c94-9fbe-1155d4dfcd93 tempest-AbsoluteLimitsTests-1768649772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b11d7f-6425-49df-8055-a63436bc862a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e79b0a9-8770-4da2-948a-9b0b18e528a6', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5b336e59-b181-4c94-9fbe-1155d4dfcd93 tempest-AbsoluteLimitsTests-1768649772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed1ab43b-3963-4418-b37e-0de5721bc97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:31 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-5b336e59-b181-4c94-9fbe-1155d4dfcd93 tempest-AbsoluteLimitsTests-1768649772 None] Volume volume-6e79b0a9-8770-4da2-948a-9b0b18e528a6 (6e79b0a9-8770-4da2-948a-9b0b18e528a6): created successfully Nov 02 12:29:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5b336e59-b181-4c94-9fbe-1155d4dfcd93 tempest-AbsoluteLimitsTests-1768649772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed1ab43b-3963-4418-b37e-0de5721bc97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5b336e59-b181-4c94-9fbe-1155d4dfcd93 tempest-AbsoluteLimitsTests-1768649772 None] Flow 'volume_create_manager' (ee69597e-a61e-4265-8a11-d5a15ac33014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:29:31 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-5b336e59-b181-4c94-9fbe-1155d4dfcd93 tempest-AbsoluteLimitsTests-1768649772 None] Created volume successfully. Nov 02 12:29:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-77b9f8eb-efd0-499f-ac88-62805c52b22f tempest-AbsoluteLimitsTests-1768649772 None] Acquiring lock "cinder-6e79b0a9-8770-4da2-948a-9b0b18e528a6-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-77b9f8eb-efd0-499f-ac88-62805c52b22f tempest-AbsoluteLimitsTests-1768649772 None] Lock "cinder-6e79b0a9-8770-4da2-948a-9b0b18e528a6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-77b9f8eb-efd0-499f-ac88-62805c52b22f tempest-AbsoluteLimitsTests-1768649772 None] Acquiring lock "cinder-quobyte-6e79b0a9-8770-4da2-948a-9b0b18e528a6" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-77b9f8eb-efd0-499f-ac88-62805c52b22f tempest-AbsoluteLimitsTests-1768649772 None] Lock "cinder-quobyte-6e79b0a9-8770-4da2-948a-9b0b18e528a6" acquired by "delete_volume" :: waited 0.031s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:33 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[1620ca0d-0e3e-4ecc-a04e-e0177e3c6492]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:29:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-77b9f8eb-efd0-499f-ac88-62805c52b22f tempest-AbsoluteLimitsTests-1768649772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6e79b0a9-8770-4da2-948a-9b0b18e528a6 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:33 devstack sudo[95471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6e79b0a9-8770-4da2-948a-9b0b18e528a6 Nov 02 12:29:33 devstack sudo[95471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:33 devstack sudo[95471]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-77b9f8eb-efd0-499f-ac88-62805c52b22f tempest-AbsoluteLimitsTests-1768649772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6e79b0a9-8770-4da2-948a-9b0b18e528a6" returned: 0 in 0.427s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-77b9f8eb-efd0-499f-ac88-62805c52b22f tempest-AbsoluteLimitsTests-1768649772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6e79b0a9-8770-4da2-948a-9b0b18e528a6 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:33 devstack sudo[95477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6e79b0a9-8770-4da2-948a-9b0b18e528a6 Nov 02 12:29:33 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:33 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-77b9f8eb-efd0-499f-ac88-62805c52b22f tempest-AbsoluteLimitsTests-1768649772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6e79b0a9-8770-4da2-948a-9b0b18e528a6" returned: 0 in 0.280s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-77b9f8eb-efd0-499f-ac88-62805c52b22f tempest-AbsoluteLimitsTests-1768649772 None] Lock "cinder-quobyte-6e79b0a9-8770-4da2-948a-9b0b18e528a6" released by "delete_volume" :: held 0.763s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:33 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-77b9f8eb-efd0-499f-ac88-62805c52b22f tempest-AbsoluteLimitsTests-1768649772 None] Created reservations ['7b4887b7-f0a8-4e9d-9eb9-e388311c4cee', 'bdc0a64b-b65d-42eb-bddb-ad4d4fa3cf86', '266fbc0f-34dd-435b-8f92-8f0353ef232c', '12445485-cd15-445b-82de-cfa76f0b3acc'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:29:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-77b9f8eb-efd0-499f-ac88-62805c52b22f tempest-AbsoluteLimitsTests-1768649772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-77b9f8eb-efd0-499f-ac88-62805c52b22f tempest-AbsoluteLimitsTests-1768649772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-77b9f8eb-efd0-499f-ac88-62805c52b22f tempest-AbsoluteLimitsTests-1768649772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:29:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-77b9f8eb-efd0-499f-ac88-62805c52b22f tempest-AbsoluteLimitsTests-1768649772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:29:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-77b9f8eb-efd0-499f-ac88-62805c52b22f tempest-AbsoluteLimitsTests-1768649772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-77b9f8eb-efd0-499f-ac88-62805c52b22f tempest-AbsoluteLimitsTests-1768649772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:34 devstack sudo[95480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:29:34 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:34 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-77b9f8eb-efd0-499f-ac88-62805c52b22f tempest-AbsoluteLimitsTests-1768649772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.396s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:34 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-77b9f8eb-efd0-499f-ac88-62805c52b22f tempest-AbsoluteLimitsTests-1768649772 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:29:34 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-77b9f8eb-efd0-499f-ac88-62805c52b22f tempest-AbsoluteLimitsTests-1768649772 None] Deleted volume successfully. Nov 02 12:29:34 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-77b9f8eb-efd0-499f-ac88-62805c52b22f tempest-AbsoluteLimitsTests-1768649772 None] Lock "cinder-6e79b0a9-8770-4da2-948a-9b0b18e528a6-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:40 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:29:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Flow 'volume_create_manager' (a05ba6b7-0b5e-4c5a-99f4-bcdbaa96b65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:29:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85566d11-8098-49cb-8235-0c91d05c5958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85566d11-8098-49cb-8235-0c91d05c5958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=858ad4aa-4936-4bf3-8133-14c7e8a15425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdb171a2237a4eac9f236fc90e5f2288',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:29:40Z,use_quota=True,user_id='35755f4d85e845508cd8ccef529a58a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2981d649-0845-415b-b2c3-f8ac0449db96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2981d649-0845-415b-b2c3-f8ac0449db96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9c3bae7-5951-4f57-ae7d-6113c176073a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:40 devstack cinder-volume[86515]: DEBUG cinder.image.glance [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Creating Keystone auth plugin from conf {{(pid=86515) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 12:29:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9c3bae7-5951-4f57-ae7d-6113c176073a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '858ad4aa-4936-4bf3-8133-14c7e8a15425', 'volume_name': 'volume-858ad4aa-4936-4bf3-8133-14c7e8a15425', 'volume_size': 1, 'image_id': '9252602f-27eb-40d6-8a32-b6e64676d1e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9252602f-27eb-40d6-8a32-b6e64676d1e6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '21926fac2cbd159f40610649424d98cf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bdb171a2237a4eac9f236fc90e5f2288', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '62fc9e9b29f4e8d2e2a9ced36006ea75055acce58403f2a30b09a4ed9397ce58711e0d8ccc3967536e976eead5be475d7b5e14721d6b31d944ad98184e646baf', 'id': '9252602f-27eb-40d6-8a32-b6e64676d1e6', 'created_at': datetime.datetime(2026, 11, 2, 11, 29, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 29, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9252602f-27eb-40d6-8a32-b6e64676d1e6/file', 'properties': {}}, 'image_service': }' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7984d3e9-09ea-4a99-a682-8fb138f23448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7984d3e9-09ea-4a99-a682-8fb138f23448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dbb44a2-8966-4b8b-bc52-13f91ac1aae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:40 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Volume 858ad4aa-4936-4bf3-8133-14c7e8a15425: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-858ad4aa-4936-4bf3-8133-14c7e8a15425', 'volume_size': 1, 'image_id': '9252602f-27eb-40d6-8a32-b6e64676d1e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9252602f-27eb-40d6-8a32-b6e64676d1e6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '21926fac2cbd159f40610649424d98cf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bdb171a2237a4eac9f236fc90e5f2288', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '62fc9e9b29f4e8d2e2a9ced36006ea75055acce58403f2a30b09a4ed9397ce58711e0d8ccc3967536e976eead5be475d7b5e14721d6b31d944ad98184e646baf', 'id': '9252602f-27eb-40d6-8a32-b6e64676d1e6', 'created_at': datetime.datetime(2026, 11, 2, 11, 29, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 29, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9252602f-27eb-40d6-8a32-b6e64676d1e6/file', 'properties': {}}, 'image_service': } Nov 02 12:29:40 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Trying to clone 858ad4aa-4936-4bf3-8133-14c7e8a15425 from image 9252602f-27eb-40d6-8a32-b6e64676d1e6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9252602f-27eb-40d6-8a32-b6e64676d1e6', 'metadata': {}}]). {{(pid=86515) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1127}} Nov 02 12:29:40 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9252602f-27eb-40d6-8a32-b6e64676d1e6_nvcb03judevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86515) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 12:29:40 devstack cinder-volume[86515]: INFO cinder.image.image_utils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Image download 0.00 MB at 0.00 MB/s Nov 02 12:29:40 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b74f9c1-ffd0-4edb-85ee-31a7f54cc6f8]: (4, 'raw') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:29:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9252602f-27eb-40d6-8a32-b6e64676d1e6_nvcb03judevstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:41 devstack sudo[95530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9252602f-27eb-40d6-8a32-b6e64676d1e6_nvcb03judevstack@QuobyteHD Nov 02 12:29:41 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:41 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9252602f-27eb-40d6-8a32-b6e64676d1e6_nvcb03judevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9252602f-27eb-40d6-8a32-b6e64676d1e6_nvcb03judevstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:41 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9252602f-27eb-40d6-8a32-b6e64676d1e6_nvcb03judevstack@QuobyteHD Nov 02 12:29:41 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:41 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9252602f-27eb-40d6-8a32-b6e64676d1e6_nvcb03judevstack@QuobyteHD" returned: 1 in 0.378s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9252602f-27eb-40d6-8a32-b6e64676d1e6_nvcb03judevstack@QuobyteHD' failed. Not Retrying. {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:29:41 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Temporary image 9252602f-27eb-40d6-8a32-b6e64676d1e6 is fetched for user 35755f4d85e845508cd8ccef529a58a7. {{(pid=86515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 12:29:41 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c92562-6664-443b-87d6-3ffa4ad7a3ad]: (4, 'raw') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:29:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9252602f-27eb-40d6-8a32-b6e64676d1e6_nvcb03judevstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:41 devstack sudo[95539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9252602f-27eb-40d6-8a32-b6e64676d1e6_nvcb03judevstack@QuobyteHD Nov 02 12:29:41 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:42 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9252602f-27eb-40d6-8a32-b6e64676d1e6_nvcb03judevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9252602f-27eb-40d6-8a32-b6e64676d1e6_nvcb03judevstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:42 devstack sudo[95543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9252602f-27eb-40d6-8a32-b6e64676d1e6_nvcb03judevstack@QuobyteHD Nov 02 12:29:42 devstack sudo[95543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:42 devstack sudo[95543]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9252602f-27eb-40d6-8a32-b6e64676d1e6_nvcb03judevstack@QuobyteHD" returned: 1 in 0.377s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9252602f-27eb-40d6-8a32-b6e64676d1e6_nvcb03judevstack@QuobyteHD' failed. Not Retrying. {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:29:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:42 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=858ad4aa-4936-4bf3-8133-14c7e8a15425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdb171a2237a4eac9f236fc90e5f2288',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:29:40Z,use_quota=True,user_id='35755f4d85e845508cd8ccef529a58a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:29:42 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Creating volume 858ad4aa-4936-4bf3-8133-14c7e8a15425 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:29:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:42 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:29:42 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:29:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:42 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:29:42 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:29:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-858ad4aa-4936-4bf3-8133-14c7e8a15425 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:42 devstack sudo[95549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-858ad4aa-4936-4bf3-8133-14c7e8a15425 1073741824 Nov 02 12:29:42 devstack sudo[95549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:42 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-74672649-e4f4-41fc-a8d8-fff50ea9c58e tempest-VolumesTransfersV357Test-2112887839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:29:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-74672649-e4f4-41fc-a8d8-fff50ea9c58e tempest-VolumesTransfersV357Test-2112887839 None] Flow 'volume_create_manager' (4866fb52-ae08-4cf8-aac7-e13bfff488d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:29:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-74672649-e4f4-41fc-a8d8-fff50ea9c58e tempest-VolumesTransfersV357Test-2112887839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b43012f7-0e31-4c08-9293-ef9f14800d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-74672649-e4f4-41fc-a8d8-fff50ea9c58e tempest-VolumesTransfersV357Test-2112887839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b43012f7-0e31-4c08-9293-ef9f14800d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1852473085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c45ccdf6-18d6-421f-b221-eba9afcfba5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b24d0a021d824236a8692fb211f3c4fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:29:43Z,use_quota=True,user_id='1595681ae57c4803b7171235f24f3c38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-74672649-e4f4-41fc-a8d8-fff50ea9c58e tempest-VolumesTransfersV357Test-2112887839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d4cf7a5-ec7a-4856-8f7e-257611492ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-74672649-e4f4-41fc-a8d8-fff50ea9c58e tempest-VolumesTransfersV357Test-2112887839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d4cf7a5-ec7a-4856-8f7e-257611492ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-74672649-e4f4-41fc-a8d8-fff50ea9c58e tempest-VolumesTransfersV357Test-2112887839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c0d91bf-72a8-4274-8d15-4abf55e1a4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-74672649-e4f4-41fc-a8d8-fff50ea9c58e tempest-VolumesTransfersV357Test-2112887839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c0d91bf-72a8-4274-8d15-4abf55e1a4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c45ccdf6-18d6-421f-b221-eba9afcfba5f', 'volume_name': 'volume-c45ccdf6-18d6-421f-b221-eba9afcfba5f', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-74672649-e4f4-41fc-a8d8-fff50ea9c58e tempest-VolumesTransfersV357Test-2112887839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14a4f75-a494-49ff-93e4-ac7bb36e8958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-74672649-e4f4-41fc-a8d8-fff50ea9c58e tempest-VolumesTransfersV357Test-2112887839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14a4f75-a494-49ff-93e4-ac7bb36e8958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-74672649-e4f4-41fc-a8d8-fff50ea9c58e tempest-VolumesTransfersV357Test-2112887839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b5e4b6c-0b3c-4464-b8eb-469e4360257f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:42 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-74672649-e4f4-41fc-a8d8-fff50ea9c58e tempest-VolumesTransfersV357Test-2112887839 None] Volume c45ccdf6-18d6-421f-b221-eba9afcfba5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c45ccdf6-18d6-421f-b221-eba9afcfba5f', 'volume_size': 1} Nov 02 12:29:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-74672649-e4f4-41fc-a8d8-fff50ea9c58e tempest-VolumesTransfersV357Test-2112887839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:43 devstack sudo[95549]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-858ad4aa-4936-4bf3-8133-14c7e8a15425 1073741824" returned: 0 in 0.473s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-858ad4aa-4936-4bf3-8133-14c7e8a15425 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:43 devstack sudo[95555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-858ad4aa-4936-4bf3-8133-14c7e8a15425 Nov 02 12:29:43 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:43 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-858ad4aa-4936-4bf3-8133-14c7e8a15425" returned: 0 in 0.288s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:29:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-74672649-e4f4-41fc-a8d8-fff50ea9c58e tempest-VolumesTransfersV357Test-2112887839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.536s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-74672649-e4f4-41fc-a8d8-fff50ea9c58e tempest-VolumesTransfersV357Test-2112887839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1852473085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c45ccdf6-18d6-421f-b221-eba9afcfba5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b24d0a021d824236a8692fb211f3c4fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:29:43Z,use_quota=True,user_id='1595681ae57c4803b7171235f24f3c38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:29:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-74672649-e4f4-41fc-a8d8-fff50ea9c58e tempest-VolumesTransfersV357Test-2112887839 None] Creating volume c45ccdf6-18d6-421f-b221-eba9afcfba5f {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:29:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-74672649-e4f4-41fc-a8d8-fff50ea9c58e tempest-VolumesTransfersV357Test-2112887839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-74672649-e4f4-41fc-a8d8-fff50ea9c58e tempest-VolumesTransfersV357Test-2112887839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-74672649-e4f4-41fc-a8d8-fff50ea9c58e tempest-VolumesTransfersV357Test-2112887839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:29:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-74672649-e4f4-41fc-a8d8-fff50ea9c58e tempest-VolumesTransfersV357Test-2112887839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:29:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-74672649-e4f4-41fc-a8d8-fff50ea9c58e tempest-VolumesTransfersV357Test-2112887839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-74672649-e4f4-41fc-a8d8-fff50ea9c58e tempest-VolumesTransfersV357Test-2112887839 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:29:43 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-74672649-e4f4-41fc-a8d8-fff50ea9c58e tempest-VolumesTransfersV357Test-2112887839 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:29:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-74672649-e4f4-41fc-a8d8-fff50ea9c58e tempest-VolumesTransfersV357Test-2112887839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c45ccdf6-18d6-421f-b221-eba9afcfba5f 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:43 devstack sudo[95558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c45ccdf6-18d6-421f-b221-eba9afcfba5f 1073741824 Nov 02 12:29:43 devstack sudo[95558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:43 devstack cinder-volume[86515]: DEBUG cinder.volume.volume_utils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Attempting download of 9252602f-27eb-40d6-8a32-b6e64676d1e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/9252602f-27eb-40d6-8a32-b6e64676d1e6', 'metadata': {}}])) to volume 858ad4aa-4936-4bf3-8133-14c7e8a15425. {{(pid=86515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 12:29:43 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3edb72-2d6d-490a-aee9-d809ac06888b]: (4, 'raw') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:29:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9252602f-27eb-40d6-8a32-b6e64676d1e6_9j78yrp3 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:43 devstack sudo[95560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9252602f-27eb-40d6-8a32-b6e64676d1e6_9j78yrp3 Nov 02 12:29:43 devstack sudo[95560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:43 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:29:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:43 devstack sudo[95560]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:29:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:29:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:43 devstack sudo[95558]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-74672649-e4f4-41fc-a8d8-fff50ea9c58e tempest-VolumesTransfersV357Test-2112887839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c45ccdf6-18d6-421f-b221-eba9afcfba5f 1073741824" returned: 0 in 0.489s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9252602f-27eb-40d6-8a32-b6e64676d1e6_9j78yrp3" returned: 0 in 0.393s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9252602f-27eb-40d6-8a32-b6e64676d1e6_9j78yrp3 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:43 devstack sudo[95568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:29:43 devstack sudo[95568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-74672649-e4f4-41fc-a8d8-fff50ea9c58e tempest-VolumesTransfersV357Test-2112887839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c45ccdf6-18d6-421f-b221-eba9afcfba5f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:43 devstack sudo[95571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c45ccdf6-18d6-421f-b221-eba9afcfba5f Nov 02 12:29:43 devstack sudo[95571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:44 devstack sudo[95570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9252602f-27eb-40d6-8a32-b6e64676d1e6_9j78yrp3 Nov 02 12:29:44 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:44 devstack sudo[95568]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.297s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:44 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:29:44 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager._thread_info {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:29:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread count: 28 {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:29:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread info: [<_MainThread(MainThread, started 129944084402304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:29:44 devstack sudo[95571]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-74672649-e4f4-41fc-a8d8-fff50ea9c58e tempest-VolumesTransfersV357Test-2112887839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c45ccdf6-18d6-421f-b221-eba9afcfba5f" returned: 0 in 0.300s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:44 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-74672649-e4f4-41fc-a8d8-fff50ea9c58e tempest-VolumesTransfersV357Test-2112887839 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:29:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-74672649-e4f4-41fc-a8d8-fff50ea9c58e tempest-VolumesTransfersV357Test-2112887839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-74672649-e4f4-41fc-a8d8-fff50ea9c58e tempest-VolumesTransfersV357Test-2112887839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b5e4b6c-0b3c-4464-b8eb-469e4360257f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c45ccdf6-18d6-421f-b221-eba9afcfba5f', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-74672649-e4f4-41fc-a8d8-fff50ea9c58e tempest-VolumesTransfersV357Test-2112887839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849bf5cd-0959-4113-b228-12501c6b912b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:44 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-74672649-e4f4-41fc-a8d8-fff50ea9c58e tempest-VolumesTransfersV357Test-2112887839 None] Volume volume-c45ccdf6-18d6-421f-b221-eba9afcfba5f (c45ccdf6-18d6-421f-b221-eba9afcfba5f): created successfully Nov 02 12:29:44 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-74672649-e4f4-41fc-a8d8-fff50ea9c58e tempest-VolumesTransfersV357Test-2112887839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849bf5cd-0959-4113-b228-12501c6b912b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-74672649-e4f4-41fc-a8d8-fff50ea9c58e tempest-VolumesTransfersV357Test-2112887839 None] Flow 'volume_create_manager' (4866fb52-ae08-4cf8-aac7-e13bfff488d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:29:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9252602f-27eb-40d6-8a32-b6e64676d1e6_9j78yrp3" returned: 1 in 0.400s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9252602f-27eb-40d6-8a32-b6e64676d1e6_9j78yrp3' failed. Not Retrying. {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:29:44 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[857e7e13-cd31-4781-81dd-001fd1412832]: (4, 'raw') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:29:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9252602f-27eb-40d6-8a32-b6e64676d1e6_nvcb03judevstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:44 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-74672649-e4f4-41fc-a8d8-fff50ea9c58e tempest-VolumesTransfersV357Test-2112887839 None] Created volume successfully. Nov 02 12:29:44 devstack sudo[95579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9252602f-27eb-40d6-8a32-b6e64676d1e6_nvcb03judevstack@QuobyteHD Nov 02 12:29:44 devstack sudo[95579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:44 devstack sudo[95579]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9252602f-27eb-40d6-8a32-b6e64676d1e6_nvcb03judevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9252602f-27eb-40d6-8a32-b6e64676d1e6_nvcb03judevstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:44 devstack sudo[95583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9252602f-27eb-40d6-8a32-b6e64676d1e6_nvcb03judevstack@QuobyteHD Nov 02 12:29:44 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:44 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9252602f-27eb-40d6-8a32-b6e64676d1e6_nvcb03judevstack@QuobyteHD" returned: 1 in 0.315s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9252602f-27eb-40d6-8a32-b6e64676d1e6_nvcb03judevstack@QuobyteHD' failed. Not Retrying. {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:29:44 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] 9252602f-27eb-40d6-8a32-b6e64676d1e6 was raw, converting to qcow2 {{(pid=86515) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 12:29:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9252602f-27eb-40d6-8a32-b6e64676d1e6_nvcb03judevstack@QuobyteHD /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-858ad4aa-4936-4bf3-8133-14c7e8a15425 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:45 devstack sudo[95588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9252602f-27eb-40d6-8a32-b6e64676d1e6_nvcb03judevstack@QuobyteHD /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-858ad4aa-4936-4bf3-8133-14c7e8a15425 Nov 02 12:29:45 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:45 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9252602f-27eb-40d6-8a32-b6e64676d1e6_nvcb03judevstack@QuobyteHD /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-858ad4aa-4936-4bf3-8133-14c7e8a15425" returned: 0 in 0.577s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:45 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9252602f-27eb-40d6-8a32-b6e64676d1e6_nvcb03judevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-858ad4aa-4936-4bf3-8133-14c7e8a15425 {{(pid=86515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 12:29:45 devstack cinder-volume[86515]: INFO cinder.image.image_utils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 12:29:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-858ad4aa-4936-4bf3-8133-14c7e8a15425 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:45 devstack sudo[95602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-858ad4aa-4936-4bf3-8133-14c7e8a15425 1G Nov 02 12:29:45 devstack sudo[95602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:45 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-5fdf5316-5f4a-47b0-9502-12c4a5e36464 tempest-VolumesTransfersV357Test-353701502 None] Transfer volume completed successfully. Nov 02 12:29:45 devstack sudo[95602]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-858ad4aa-4936-4bf3-8133-14c7e8a15425 1G" returned: 0 in 0.369s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:45 devstack cinder-volume[86515]: DEBUG cinder.volume.volume_utils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Downloaded image 9252602f-27eb-40d6-8a32-b6e64676d1e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/9252602f-27eb-40d6-8a32-b6e64676d1e6', 'metadata': {}}])) to volume 858ad4aa-4936-4bf3-8133-14c7e8a15425 successfully. {{(pid=86515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 12:29:45 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Temporary image 9252602f-27eb-40d6-8a32-b6e64676d1e6 for user 35755f4d85e845508cd8ccef529a58a7 is deleted. {{(pid=86515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 12:29:45 devstack cinder-volume[86515]: DEBUG cinder.volume.volume_utils [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Marking volume 858ad4aa-4936-4bf3-8133-14c7e8a15425 as bootable. {{(pid=86515) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 12:29:45 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Copying metadata from image 9252602f-27eb-40d6-8a32-b6e64676d1e6 to 858ad4aa-4936-4bf3-8133-14c7e8a15425. {{(pid=86515) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 12:29:45 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Creating volume glance metadata for volume 858ad4aa-4936-4bf3-8133-14c7e8a15425 backed by image 9252602f-27eb-40d6-8a32-b6e64676d1e6 with: {'image_id': '9252602f-27eb-40d6-8a32-b6e64676d1e6', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '21926fac2cbd159f40610649424d98cf', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86515) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 12:29:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dbb44a2-8966-4b8b-bc52-13f91ac1aae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-858ad4aa-4936-4bf3-8133-14c7e8a15425', 'volume_size': 1, 'image_id': '9252602f-27eb-40d6-8a32-b6e64676d1e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9252602f-27eb-40d6-8a32-b6e64676d1e6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '21926fac2cbd159f40610649424d98cf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bdb171a2237a4eac9f236fc90e5f2288', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '62fc9e9b29f4e8d2e2a9ced36006ea75055acce58403f2a30b09a4ed9397ce58711e0d8ccc3967536e976eead5be475d7b5e14721d6b31d944ad98184e646baf', 'id': '9252602f-27eb-40d6-8a32-b6e64676d1e6', 'created_at': datetime.datetime(2026, 11, 2, 11, 29, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 29, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9252602f-27eb-40d6-8a32-b6e64676d1e6/file', 'properties': {}}, 'image_service': }' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec0d944f-3ccf-4017-9c75-d24aa8e57c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:46 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Volume volume-858ad4aa-4936-4bf3-8133-14c7e8a15425 (858ad4aa-4936-4bf3-8133-14c7e8a15425): created successfully Nov 02 12:29:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec0d944f-3ccf-4017-9c75-d24aa8e57c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Flow 'volume_create_manager' (a05ba6b7-0b5e-4c5a-99f4-bcdbaa96b65b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:29:46 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-7c5ce16e-ad96-4a7f-9b4f-7c8b71f90cad tempest-VolumeImageDependencyTests-325336807 None] Created volume successfully. Nov 02 12:29:46 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e63b0048-943a-4eff-8b85-ebae9bb2ab02 tempest-VolumesTransfersV357Test-1567754953 None] Acquiring lock "cinder-c45ccdf6-18d6-421f-b221-eba9afcfba5f-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:46 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e63b0048-943a-4eff-8b85-ebae9bb2ab02 tempest-VolumesTransfersV357Test-1567754953 None] Lock "cinder-c45ccdf6-18d6-421f-b221-eba9afcfba5f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:46 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e63b0048-943a-4eff-8b85-ebae9bb2ab02 tempest-VolumesTransfersV357Test-1567754953 None] Acquiring lock "cinder-quobyte-c45ccdf6-18d6-421f-b221-eba9afcfba5f" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:46 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e63b0048-943a-4eff-8b85-ebae9bb2ab02 tempest-VolumesTransfersV357Test-1567754953 None] Lock "cinder-quobyte-c45ccdf6-18d6-421f-b221-eba9afcfba5f" acquired by "delete_volume" :: waited 0.022s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:46 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a19cbf-9cfd-4b70-94ce-ca60a1e6fea9]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:29:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e63b0048-943a-4eff-8b85-ebae9bb2ab02 tempest-VolumesTransfersV357Test-1567754953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c45ccdf6-18d6-421f-b221-eba9afcfba5f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:46 devstack sudo[95607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c45ccdf6-18d6-421f-b221-eba9afcfba5f Nov 02 12:29:46 devstack sudo[95607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:46 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b7ba7e02-bdb2-4bb0-a118-b312ed191701 tempest-VolumeImageDependencyTests-325336807 None] Acquiring lock "cinder-858ad4aa-4936-4bf3-8133-14c7e8a15425-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:46 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b7ba7e02-bdb2-4bb0-a118-b312ed191701 tempest-VolumeImageDependencyTests-325336807 None] Lock "cinder-858ad4aa-4936-4bf3-8133-14c7e8a15425-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:46 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b7ba7e02-bdb2-4bb0-a118-b312ed191701 tempest-VolumeImageDependencyTests-325336807 None] Acquiring lock "cinder-quobyte-858ad4aa-4936-4bf3-8133-14c7e8a15425" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:46 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b7ba7e02-bdb2-4bb0-a118-b312ed191701 tempest-VolumeImageDependencyTests-325336807 None] Lock "cinder-quobyte-858ad4aa-4936-4bf3-8133-14c7e8a15425" acquired by "delete_volume" :: waited 0.016s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:46 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f2a625-5f6e-49d7-90f3-3009dcdd9483]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:29:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b7ba7e02-bdb2-4bb0-a118-b312ed191701 tempest-VolumeImageDependencyTests-325336807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-858ad4aa-4936-4bf3-8133-14c7e8a15425 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:46 devstack sudo[95609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-858ad4aa-4936-4bf3-8133-14c7e8a15425 Nov 02 12:29:46 devstack sudo[95609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:46 devstack sudo[95607]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e63b0048-943a-4eff-8b85-ebae9bb2ab02 tempest-VolumesTransfersV357Test-1567754953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c45ccdf6-18d6-421f-b221-eba9afcfba5f" returned: 0 in 0.438s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e63b0048-943a-4eff-8b85-ebae9bb2ab02 tempest-VolumesTransfersV357Test-1567754953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c45ccdf6-18d6-421f-b221-eba9afcfba5f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:47 devstack sudo[95614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c45ccdf6-18d6-421f-b221-eba9afcfba5f Nov 02 12:29:47 devstack sudo[95614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:47 devstack sudo[95609]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b7ba7e02-bdb2-4bb0-a118-b312ed191701 tempest-VolumeImageDependencyTests-325336807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-858ad4aa-4936-4bf3-8133-14c7e8a15425" returned: 0 in 0.411s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b7ba7e02-bdb2-4bb0-a118-b312ed191701 tempest-VolumeImageDependencyTests-325336807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-858ad4aa-4936-4bf3-8133-14c7e8a15425 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:47 devstack sudo[95620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-858ad4aa-4936-4bf3-8133-14c7e8a15425 Nov 02 12:29:47 devstack sudo[95620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:47 devstack sudo[95614]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e63b0048-943a-4eff-8b85-ebae9bb2ab02 tempest-VolumesTransfersV357Test-1567754953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c45ccdf6-18d6-421f-b221-eba9afcfba5f" returned: 0 in 0.285s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:47 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e63b0048-943a-4eff-8b85-ebae9bb2ab02 tempest-VolumesTransfersV357Test-1567754953 None] Lock "cinder-quobyte-c45ccdf6-18d6-421f-b221-eba9afcfba5f" released by "delete_volume" :: held 0.781s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:47 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-e63b0048-943a-4eff-8b85-ebae9bb2ab02 tempest-VolumesTransfersV357Test-1567754953 None] Created reservations ['389bb916-5c90-481d-9b8f-2dadb0a7a56a', '3885e098-0ff1-47f0-9079-3f6e5038b8e4', '55e70947-637a-41bb-99bb-332acb0a12f8', '817973fa-9e5a-49a8-8c98-03d79b035f09'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:29:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e63b0048-943a-4eff-8b85-ebae9bb2ab02 tempest-VolumesTransfersV357Test-1567754953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e63b0048-943a-4eff-8b85-ebae9bb2ab02 tempest-VolumesTransfersV357Test-1567754953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:47 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e63b0048-943a-4eff-8b85-ebae9bb2ab02 tempest-VolumesTransfersV357Test-1567754953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:29:47 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e63b0048-943a-4eff-8b85-ebae9bb2ab02 tempest-VolumesTransfersV357Test-1567754953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:29:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e63b0048-943a-4eff-8b85-ebae9bb2ab02 tempest-VolumesTransfersV357Test-1567754953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e63b0048-943a-4eff-8b85-ebae9bb2ab02 tempest-VolumesTransfersV357Test-1567754953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:47 devstack sudo[95622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:29:47 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:47 devstack sudo[95620]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b7ba7e02-bdb2-4bb0-a118-b312ed191701 tempest-VolumeImageDependencyTests-325336807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-858ad4aa-4936-4bf3-8133-14c7e8a15425" returned: 0 in 0.293s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:47 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b7ba7e02-bdb2-4bb0-a118-b312ed191701 tempest-VolumeImageDependencyTests-325336807 None] Lock "cinder-quobyte-858ad4aa-4936-4bf3-8133-14c7e8a15425" released by "delete_volume" :: held 0.767s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:47 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-b7ba7e02-bdb2-4bb0-a118-b312ed191701 tempest-VolumeImageDependencyTests-325336807 None] Created reservations ['2c559a1e-3b50-425b-a5f4-4807776c3cfe', 'efb52550-740c-40c6-9d0f-6c09e7782229', '88f9cc60-fad4-4560-934b-3530653b6259', '36e767ee-1c1c-4be8-b2de-b505aa60218e'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:29:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b7ba7e02-bdb2-4bb0-a118-b312ed191701 tempest-VolumeImageDependencyTests-325336807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b7ba7e02-bdb2-4bb0-a118-b312ed191701 tempest-VolumeImageDependencyTests-325336807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:47 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b7ba7e02-bdb2-4bb0-a118-b312ed191701 tempest-VolumeImageDependencyTests-325336807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:29:47 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b7ba7e02-bdb2-4bb0-a118-b312ed191701 tempest-VolumeImageDependencyTests-325336807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:29:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b7ba7e02-bdb2-4bb0-a118-b312ed191701 tempest-VolumeImageDependencyTests-325336807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b7ba7e02-bdb2-4bb0-a118-b312ed191701 tempest-VolumeImageDependencyTests-325336807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:47 devstack sudo[95626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:29:47 devstack sudo[95626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:47 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e63b0048-943a-4eff-8b85-ebae9bb2ab02 tempest-VolumesTransfersV357Test-1567754953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.305s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:47 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-e63b0048-943a-4eff-8b85-ebae9bb2ab02 tempest-VolumesTransfersV357Test-1567754953 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:29:47 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-e63b0048-943a-4eff-8b85-ebae9bb2ab02 tempest-VolumesTransfersV357Test-1567754953 None] Deleted volume successfully. Nov 02 12:29:47 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e63b0048-943a-4eff-8b85-ebae9bb2ab02 tempest-VolumesTransfersV357Test-1567754953 None] Lock "cinder-c45ccdf6-18d6-421f-b221-eba9afcfba5f-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:47 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-72348672-0cea-4dc3-bd41-48617f4dac0e tempest-VolumeQuotasAdminTestJSON-651660576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:29:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-72348672-0cea-4dc3-bd41-48617f4dac0e tempest-VolumeQuotasAdminTestJSON-651660576 None] Flow 'volume_create_manager' (94be3ea9-4ec9-486b-983c-4e6d8bc0bae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:29:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-72348672-0cea-4dc3-bd41-48617f4dac0e tempest-VolumeQuotasAdminTestJSON-651660576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73ea1b41-1ba0-430f-a4a6-e679d0c4f320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-72348672-0cea-4dc3-bd41-48617f4dac0e tempest-VolumeQuotasAdminTestJSON-651660576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73ea1b41-1ba0-430f-a4a6-e679d0c4f320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-118683858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf62c1f7-12f0-4de7-8754-0bec7e2095d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea93ebb879574239ac0f98ed0c8b3e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:29:48Z,use_quota=True,user_id='56aed13603fd47f3944ba6020f36011a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-72348672-0cea-4dc3-bd41-48617f4dac0e tempest-VolumeQuotasAdminTestJSON-651660576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5862f3f-aec0-4dfe-9a7b-a03cce83fa1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-72348672-0cea-4dc3-bd41-48617f4dac0e tempest-VolumeQuotasAdminTestJSON-651660576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5862f3f-aec0-4dfe-9a7b-a03cce83fa1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-72348672-0cea-4dc3-bd41-48617f4dac0e tempest-VolumeQuotasAdminTestJSON-651660576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4d0a613-0233-4d30-b9d3-e3cd876a65c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-72348672-0cea-4dc3-bd41-48617f4dac0e tempest-VolumeQuotasAdminTestJSON-651660576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4d0a613-0233-4d30-b9d3-e3cd876a65c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf62c1f7-12f0-4de7-8754-0bec7e2095d5', 'volume_name': 'volume-cf62c1f7-12f0-4de7-8754-0bec7e2095d5', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:48 devstack sudo[95626]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-72348672-0cea-4dc3-bd41-48617f4dac0e tempest-VolumeQuotasAdminTestJSON-651660576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf5ecf18-ca87-42f3-9d61-2c75710b6f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-72348672-0cea-4dc3-bd41-48617f4dac0e tempest-VolumeQuotasAdminTestJSON-651660576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf5ecf18-ca87-42f3-9d61-2c75710b6f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-72348672-0cea-4dc3-bd41-48617f4dac0e tempest-VolumeQuotasAdminTestJSON-651660576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cae479c-96b7-4048-8626-a8520840735a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:48 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-72348672-0cea-4dc3-bd41-48617f4dac0e tempest-VolumeQuotasAdminTestJSON-651660576 None] Volume cf62c1f7-12f0-4de7-8754-0bec7e2095d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf62c1f7-12f0-4de7-8754-0bec7e2095d5', 'volume_size': 1} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-72348672-0cea-4dc3-bd41-48617f4dac0e tempest-VolumeQuotasAdminTestJSON-651660576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-72348672-0cea-4dc3-bd41-48617f4dac0e tempest-VolumeQuotasAdminTestJSON-651660576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-72348672-0cea-4dc3-bd41-48617f4dac0e tempest-VolumeQuotasAdminTestJSON-651660576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-118683858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf62c1f7-12f0-4de7-8754-0bec7e2095d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea93ebb879574239ac0f98ed0c8b3e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:29:48Z,use_quota=True,user_id='56aed13603fd47f3944ba6020f36011a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-72348672-0cea-4dc3-bd41-48617f4dac0e tempest-VolumeQuotasAdminTestJSON-651660576 None] Creating volume cf62c1f7-12f0-4de7-8754-0bec7e2095d5 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-72348672-0cea-4dc3-bd41-48617f4dac0e tempest-VolumeQuotasAdminTestJSON-651660576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-72348672-0cea-4dc3-bd41-48617f4dac0e tempest-VolumeQuotasAdminTestJSON-651660576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-72348672-0cea-4dc3-bd41-48617f4dac0e tempest-VolumeQuotasAdminTestJSON-651660576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-72348672-0cea-4dc3-bd41-48617f4dac0e tempest-VolumeQuotasAdminTestJSON-651660576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-72348672-0cea-4dc3-bd41-48617f4dac0e tempest-VolumeQuotasAdminTestJSON-651660576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-72348672-0cea-4dc3-bd41-48617f4dac0e tempest-VolumeQuotasAdminTestJSON-651660576 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:29:48 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-72348672-0cea-4dc3-bd41-48617f4dac0e tempest-VolumeQuotasAdminTestJSON-651660576 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-72348672-0cea-4dc3-bd41-48617f4dac0e tempest-VolumeQuotasAdminTestJSON-651660576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cf62c1f7-12f0-4de7-8754-0bec7e2095d5 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b7ba7e02-bdb2-4bb0-a118-b312ed191701 tempest-VolumeImageDependencyTests-325336807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.338s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-b7ba7e02-bdb2-4bb0-a118-b312ed191701 tempest-VolumeImageDependencyTests-325336807 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:29:48 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-b7ba7e02-bdb2-4bb0-a118-b312ed191701 tempest-VolumeImageDependencyTests-325336807 None] Deleted volume successfully. Nov 02 12:29:48 devstack sudo[95629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cf62c1f7-12f0-4de7-8754-0bec7e2095d5 1073741824 Nov 02 12:29:48 devstack sudo[95629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b7ba7e02-bdb2-4bb0-a118-b312ed191701 tempest-VolumeImageDependencyTests-325336807 None] Lock "cinder-858ad4aa-4936-4bf3-8133-14c7e8a15425-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-54190e6e-048e-4b91-92b2-270f227e0120 tempest-VolumesTransfersV357Test-2112887839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-54190e6e-048e-4b91-92b2-270f227e0120 tempest-VolumesTransfersV357Test-2112887839 None] Flow 'volume_create_manager' (ef9f4a45-4850-4882-9d73-9e74a4db83a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-54190e6e-048e-4b91-92b2-270f227e0120 tempest-VolumesTransfersV357Test-2112887839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb3603f-b948-46df-953e-0fb495edc5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-54190e6e-048e-4b91-92b2-270f227e0120 tempest-VolumesTransfersV357Test-2112887839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb3603f-b948-46df-953e-0fb495edc5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1097085811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c4d5d8-d904-4fab-85ea-de4e17ace840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b24d0a021d824236a8692fb211f3c4fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:29:48Z,use_quota=True,user_id='1595681ae57c4803b7171235f24f3c38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-54190e6e-048e-4b91-92b2-270f227e0120 tempest-VolumesTransfersV357Test-2112887839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe77d99a-8a36-4a23-a9ed-a999850209ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-54190e6e-048e-4b91-92b2-270f227e0120 tempest-VolumesTransfersV357Test-2112887839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe77d99a-8a36-4a23-a9ed-a999850209ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-54190e6e-048e-4b91-92b2-270f227e0120 tempest-VolumesTransfersV357Test-2112887839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33b84085-6961-4459-abbd-78a74bac9cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-54190e6e-048e-4b91-92b2-270f227e0120 tempest-VolumesTransfersV357Test-2112887839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33b84085-6961-4459-abbd-78a74bac9cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41c4d5d8-d904-4fab-85ea-de4e17ace840', 'volume_name': 'volume-41c4d5d8-d904-4fab-85ea-de4e17ace840', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-54190e6e-048e-4b91-92b2-270f227e0120 tempest-VolumesTransfersV357Test-2112887839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a638cfe-dad2-4b0d-8dac-7961dff32c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-54190e6e-048e-4b91-92b2-270f227e0120 tempest-VolumesTransfersV357Test-2112887839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a638cfe-dad2-4b0d-8dac-7961dff32c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-54190e6e-048e-4b91-92b2-270f227e0120 tempest-VolumesTransfersV357Test-2112887839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1077e9d-aa09-4c33-bbed-222e00d9bc05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:48 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-54190e6e-048e-4b91-92b2-270f227e0120 tempest-VolumesTransfersV357Test-2112887839 None] Volume 41c4d5d8-d904-4fab-85ea-de4e17ace840: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41c4d5d8-d904-4fab-85ea-de4e17ace840', 'volume_size': 1} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-54190e6e-048e-4b91-92b2-270f227e0120 tempest-VolumesTransfersV357Test-2112887839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:48 devstack sudo[95629]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-72348672-0cea-4dc3-bd41-48617f4dac0e tempest-VolumeQuotasAdminTestJSON-651660576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cf62c1f7-12f0-4de7-8754-0bec7e2095d5 1073741824" returned: 0 in 0.550s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-72348672-0cea-4dc3-bd41-48617f4dac0e tempest-VolumeQuotasAdminTestJSON-651660576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cf62c1f7-12f0-4de7-8754-0bec7e2095d5 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:48 devstack sudo[95635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cf62c1f7-12f0-4de7-8754-0bec7e2095d5 Nov 02 12:29:48 devstack sudo[95635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:48 devstack sudo[95635]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-72348672-0cea-4dc3-bd41-48617f4dac0e tempest-VolumeQuotasAdminTestJSON-651660576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cf62c1f7-12f0-4de7-8754-0bec7e2095d5" returned: 0 in 0.267s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-72348672-0cea-4dc3-bd41-48617f4dac0e tempest-VolumeQuotasAdminTestJSON-651660576 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-72348672-0cea-4dc3-bd41-48617f4dac0e tempest-VolumeQuotasAdminTestJSON-651660576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-54190e6e-048e-4b91-92b2-270f227e0120 tempest-VolumesTransfersV357Test-2112887839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.400s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-54190e6e-048e-4b91-92b2-270f227e0120 tempest-VolumesTransfersV357Test-2112887839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1097085811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c4d5d8-d904-4fab-85ea-de4e17ace840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b24d0a021d824236a8692fb211f3c4fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:29:48Z,use_quota=True,user_id='1595681ae57c4803b7171235f24f3c38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-54190e6e-048e-4b91-92b2-270f227e0120 tempest-VolumesTransfersV357Test-2112887839 None] Creating volume 41c4d5d8-d904-4fab-85ea-de4e17ace840 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-54190e6e-048e-4b91-92b2-270f227e0120 tempest-VolumesTransfersV357Test-2112887839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-54190e6e-048e-4b91-92b2-270f227e0120 tempest-VolumesTransfersV357Test-2112887839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-54190e6e-048e-4b91-92b2-270f227e0120 tempest-VolumesTransfersV357Test-2112887839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-54190e6e-048e-4b91-92b2-270f227e0120 tempest-VolumesTransfersV357Test-2112887839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-54190e6e-048e-4b91-92b2-270f227e0120 tempest-VolumesTransfersV357Test-2112887839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-54190e6e-048e-4b91-92b2-270f227e0120 tempest-VolumesTransfersV357Test-2112887839 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:29:48 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-54190e6e-048e-4b91-92b2-270f227e0120 tempest-VolumesTransfersV357Test-2112887839 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-54190e6e-048e-4b91-92b2-270f227e0120 tempest-VolumesTransfersV357Test-2112887839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-41c4d5d8-d904-4fab-85ea-de4e17ace840 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-72348672-0cea-4dc3-bd41-48617f4dac0e tempest-VolumeQuotasAdminTestJSON-651660576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cae479c-96b7-4048-8626-a8520840735a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf62c1f7-12f0-4de7-8754-0bec7e2095d5', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-72348672-0cea-4dc3-bd41-48617f4dac0e tempest-VolumeQuotasAdminTestJSON-651660576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cb21c0d-87a3-476f-93a3-954ced42cd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:48 devstack sudo[95638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-41c4d5d8-d904-4fab-85ea-de4e17ace840 1073741824 Nov 02 12:29:48 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:48 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-72348672-0cea-4dc3-bd41-48617f4dac0e tempest-VolumeQuotasAdminTestJSON-651660576 None] Volume volume-cf62c1f7-12f0-4de7-8754-0bec7e2095d5 (cf62c1f7-12f0-4de7-8754-0bec7e2095d5): created successfully Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-72348672-0cea-4dc3-bd41-48617f4dac0e tempest-VolumeQuotasAdminTestJSON-651660576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cb21c0d-87a3-476f-93a3-954ced42cd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-72348672-0cea-4dc3-bd41-48617f4dac0e tempest-VolumeQuotasAdminTestJSON-651660576 None] Flow 'volume_create_manager' (94be3ea9-4ec9-486b-983c-4e6d8bc0bae3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:29:48 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-72348672-0cea-4dc3-bd41-48617f4dac0e tempest-VolumeQuotasAdminTestJSON-651660576 None] Created volume successfully. Nov 02 12:29:49 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-54190e6e-048e-4b91-92b2-270f227e0120 tempest-VolumesTransfersV357Test-2112887839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-41c4d5d8-d904-4fab-85ea-de4e17ace840 1073741824" returned: 0 in 0.530s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-54190e6e-048e-4b91-92b2-270f227e0120 tempest-VolumesTransfersV357Test-2112887839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-41c4d5d8-d904-4fab-85ea-de4e17ace840 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:49 devstack sudo[95645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-41c4d5d8-d904-4fab-85ea-de4e17ace840 Nov 02 12:29:49 devstack sudo[95645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:49 devstack sudo[95645]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-54190e6e-048e-4b91-92b2-270f227e0120 tempest-VolumesTransfersV357Test-2112887839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-41c4d5d8-d904-4fab-85ea-de4e17ace840" returned: 0 in 0.296s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:49 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-54190e6e-048e-4b91-92b2-270f227e0120 tempest-VolumesTransfersV357Test-2112887839 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:29:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-54190e6e-048e-4b91-92b2-270f227e0120 tempest-VolumesTransfersV357Test-2112887839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-54190e6e-048e-4b91-92b2-270f227e0120 tempest-VolumesTransfersV357Test-2112887839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1077e9d-aa09-4c33-bbed-222e00d9bc05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41c4d5d8-d904-4fab-85ea-de4e17ace840', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-54190e6e-048e-4b91-92b2-270f227e0120 tempest-VolumesTransfersV357Test-2112887839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccf96177-8668-40cc-9967-f428ba624c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:49 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-54190e6e-048e-4b91-92b2-270f227e0120 tempest-VolumesTransfersV357Test-2112887839 None] Volume volume-41c4d5d8-d904-4fab-85ea-de4e17ace840 (41c4d5d8-d904-4fab-85ea-de4e17ace840): created successfully Nov 02 12:29:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-54190e6e-048e-4b91-92b2-270f227e0120 tempest-VolumesTransfersV357Test-2112887839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccf96177-8668-40cc-9967-f428ba624c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-54190e6e-048e-4b91-92b2-270f227e0120 tempest-VolumesTransfersV357Test-2112887839 None] Flow 'volume_create_manager' (ef9f4a45-4850-4882-9d73-9e74a4db83a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:29:49 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-54190e6e-048e-4b91-92b2-270f227e0120 tempest-VolumesTransfersV357Test-2112887839 None] Created volume successfully. Nov 02 12:29:50 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-49be725d-4227-4dba-9dbe-262e1b752a61 tempest-VolumeQuotasAdminTestJSON-651660576 None] Acquiring lock "cinder-cf62c1f7-12f0-4de7-8754-0bec7e2095d5-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:50 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-49be725d-4227-4dba-9dbe-262e1b752a61 tempest-VolumeQuotasAdminTestJSON-651660576 None] Lock "cinder-cf62c1f7-12f0-4de7-8754-0bec7e2095d5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:50 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-49be725d-4227-4dba-9dbe-262e1b752a61 tempest-VolumeQuotasAdminTestJSON-651660576 None] Acquiring lock "cinder-quobyte-cf62c1f7-12f0-4de7-8754-0bec7e2095d5" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:50 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-49be725d-4227-4dba-9dbe-262e1b752a61 tempest-VolumeQuotasAdminTestJSON-651660576 None] Lock "cinder-quobyte-cf62c1f7-12f0-4de7-8754-0bec7e2095d5" acquired by "delete_volume" :: waited 0.016s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:50 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09dbc29-39cd-4e77-bf88-0f414d186d56]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:29:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-49be725d-4227-4dba-9dbe-262e1b752a61 tempest-VolumeQuotasAdminTestJSON-651660576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cf62c1f7-12f0-4de7-8754-0bec7e2095d5 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:50 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cf62c1f7-12f0-4de7-8754-0bec7e2095d5 Nov 02 12:29:50 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:50 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-49be725d-4227-4dba-9dbe-262e1b752a61 tempest-VolumeQuotasAdminTestJSON-651660576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cf62c1f7-12f0-4de7-8754-0bec7e2095d5" returned: 0 in 0.530s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-49be725d-4227-4dba-9dbe-262e1b752a61 tempest-VolumeQuotasAdminTestJSON-651660576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cf62c1f7-12f0-4de7-8754-0bec7e2095d5 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:50 devstack sudo[95664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cf62c1f7-12f0-4de7-8754-0bec7e2095d5 Nov 02 12:29:50 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-237f3dc2-faed-491b-ad58-37d561e8f7c0 tempest-VolumesTransfersV357Test-1567754953 None] Acquiring lock "cinder-41c4d5d8-d904-4fab-85ea-de4e17ace840-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:50 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:50 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-237f3dc2-faed-491b-ad58-37d561e8f7c0 tempest-VolumesTransfersV357Test-1567754953 None] Lock "cinder-41c4d5d8-d904-4fab-85ea-de4e17ace840-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:50 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-237f3dc2-faed-491b-ad58-37d561e8f7c0 tempest-VolumesTransfersV357Test-1567754953 None] Acquiring lock "cinder-quobyte-41c4d5d8-d904-4fab-85ea-de4e17ace840" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:50 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-237f3dc2-faed-491b-ad58-37d561e8f7c0 tempest-VolumesTransfersV357Test-1567754953 None] Lock "cinder-quobyte-41c4d5d8-d904-4fab-85ea-de4e17ace840" acquired by "delete_volume" :: waited 0.032s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:51 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[5395698d-f072-4418-a3f5-8101442bbc44]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:29:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-237f3dc2-faed-491b-ad58-37d561e8f7c0 tempest-VolumesTransfersV357Test-1567754953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-41c4d5d8-d904-4fab-85ea-de4e17ace840 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:51 devstack sudo[95670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-41c4d5d8-d904-4fab-85ea-de4e17ace840 Nov 02 12:29:51 devstack sudo[95670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:51 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-49be725d-4227-4dba-9dbe-262e1b752a61 tempest-VolumeQuotasAdminTestJSON-651660576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cf62c1f7-12f0-4de7-8754-0bec7e2095d5" returned: 0 in 0.526s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:51 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-49be725d-4227-4dba-9dbe-262e1b752a61 tempest-VolumeQuotasAdminTestJSON-651660576 None] Lock "cinder-quobyte-cf62c1f7-12f0-4de7-8754-0bec7e2095d5" released by "delete_volume" :: held 1.159s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:51 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-49be725d-4227-4dba-9dbe-262e1b752a61 tempest-VolumeQuotasAdminTestJSON-651660576 None] Created reservations ['a5a11fb5-9278-49ee-8bec-354c8d04c0c5', '6649dd51-f9b2-407d-8850-9f59fe31011a', '2584d916-a053-4030-b59c-6326f24f32b5', '114c69db-05c3-45e6-b5ec-6a520ba736be'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:29:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-49be725d-4227-4dba-9dbe-262e1b752a61 tempest-VolumeQuotasAdminTestJSON-651660576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-49be725d-4227-4dba-9dbe-262e1b752a61 tempest-VolumeQuotasAdminTestJSON-651660576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:51 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-49be725d-4227-4dba-9dbe-262e1b752a61 tempest-VolumeQuotasAdminTestJSON-651660576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:29:51 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-49be725d-4227-4dba-9dbe-262e1b752a61 tempest-VolumeQuotasAdminTestJSON-651660576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:29:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-49be725d-4227-4dba-9dbe-262e1b752a61 tempest-VolumeQuotasAdminTestJSON-651660576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-49be725d-4227-4dba-9dbe-262e1b752a61 tempest-VolumeQuotasAdminTestJSON-651660576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:51 devstack sudo[95697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:29:51 devstack sudo[95670]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:51 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-237f3dc2-faed-491b-ad58-37d561e8f7c0 tempest-VolumesTransfersV357Test-1567754953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-41c4d5d8-d904-4fab-85ea-de4e17ace840" returned: 0 in 0.731s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-237f3dc2-faed-491b-ad58-37d561e8f7c0 tempest-VolumesTransfersV357Test-1567754953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-41c4d5d8-d904-4fab-85ea-de4e17ace840 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:51 devstack sudo[95699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-41c4d5d8-d904-4fab-85ea-de4e17ace840 Nov 02 12:29:51 devstack sudo[95699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:52 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-49be725d-4227-4dba-9dbe-262e1b752a61 tempest-VolumeQuotasAdminTestJSON-651660576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.357s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:52 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-49be725d-4227-4dba-9dbe-262e1b752a61 tempest-VolumeQuotasAdminTestJSON-651660576 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:29:52 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-49be725d-4227-4dba-9dbe-262e1b752a61 tempest-VolumeQuotasAdminTestJSON-651660576 None] Deleted volume successfully. Nov 02 12:29:52 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-49be725d-4227-4dba-9dbe-262e1b752a61 tempest-VolumeQuotasAdminTestJSON-651660576 None] Lock "cinder-cf62c1f7-12f0-4de7-8754-0bec7e2095d5-delete_volume" released by "delete_volume" :: held 2.013s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:52 devstack sudo[95699]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-237f3dc2-faed-491b-ad58-37d561e8f7c0 tempest-VolumesTransfersV357Test-1567754953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-41c4d5d8-d904-4fab-85ea-de4e17ace840" returned: 0 in 0.436s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:52 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-237f3dc2-faed-491b-ad58-37d561e8f7c0 tempest-VolumesTransfersV357Test-1567754953 None] Lock "cinder-quobyte-41c4d5d8-d904-4fab-85ea-de4e17ace840" released by "delete_volume" :: held 1.229s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:52 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-237f3dc2-faed-491b-ad58-37d561e8f7c0 tempest-VolumesTransfersV357Test-1567754953 None] Created reservations ['64338c3f-932d-453e-aab6-68674e7b72bf', '330de677-7646-4cc3-842d-f7bf33ccabd4', '48d3a33f-fe7d-4f48-acff-9e9be620ae69', '9f5978a9-77ae-43b4-afb2-50fb79dc3dec'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:29:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-237f3dc2-faed-491b-ad58-37d561e8f7c0 tempest-VolumesTransfersV357Test-1567754953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-237f3dc2-faed-491b-ad58-37d561e8f7c0 tempest-VolumesTransfersV357Test-1567754953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:52 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-237f3dc2-faed-491b-ad58-37d561e8f7c0 tempest-VolumesTransfersV357Test-1567754953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:29:52 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-237f3dc2-faed-491b-ad58-37d561e8f7c0 tempest-VolumesTransfersV357Test-1567754953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:29:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-237f3dc2-faed-491b-ad58-37d561e8f7c0 tempest-VolumesTransfersV357Test-1567754953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-237f3dc2-faed-491b-ad58-37d561e8f7c0 tempest-VolumesTransfersV357Test-1567754953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:52 devstack sudo[95703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:29:52 devstack sudo[95703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:52 devstack sudo[95703]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-237f3dc2-faed-491b-ad58-37d561e8f7c0 tempest-VolumesTransfersV357Test-1567754953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.357s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:52 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-237f3dc2-faed-491b-ad58-37d561e8f7c0 tempest-VolumesTransfersV357Test-1567754953 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:29:52 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-237f3dc2-faed-491b-ad58-37d561e8f7c0 tempest-VolumesTransfersV357Test-1567754953 None] Deleted volume successfully. Nov 02 12:29:52 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-237f3dc2-faed-491b-ad58-37d561e8f7c0 tempest-VolumesTransfersV357Test-1567754953 None] Lock "cinder-41c4d5d8-d904-4fab-85ea-de4e17ace840-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:53 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-42838a3e-efaa-4306-acd7-330f853e0890 tempest-VolumeQuotasAdminTestJSON-651660576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:29:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-42838a3e-efaa-4306-acd7-330f853e0890 tempest-VolumeQuotasAdminTestJSON-651660576 None] Flow 'volume_create_manager' (6eb13083-1438-4165-a508-b06f4f3a14c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:29:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-42838a3e-efaa-4306-acd7-330f853e0890 tempest-VolumeQuotasAdminTestJSON-651660576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7d9856d-24f8-4a35-8e2c-096be6a1da55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-42838a3e-efaa-4306-acd7-330f853e0890 tempest-VolumeQuotasAdminTestJSON-651660576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7d9856d-24f8-4a35-8e2c-096be6a1da55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-727957859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2fb6df5-ccb7-463e-9d87-77022df629bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea93ebb879574239ac0f98ed0c8b3e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:29:53Z,use_quota=True,user_id='56aed13603fd47f3944ba6020f36011a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-42838a3e-efaa-4306-acd7-330f853e0890 tempest-VolumeQuotasAdminTestJSON-651660576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82724ffa-7465-4404-82b6-1fa8c1e18794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-42838a3e-efaa-4306-acd7-330f853e0890 tempest-VolumeQuotasAdminTestJSON-651660576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82724ffa-7465-4404-82b6-1fa8c1e18794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-42838a3e-efaa-4306-acd7-330f853e0890 tempest-VolumeQuotasAdminTestJSON-651660576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ae4980-e43c-463c-b862-4a02dd4b6df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-42838a3e-efaa-4306-acd7-330f853e0890 tempest-VolumeQuotasAdminTestJSON-651660576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ae4980-e43c-463c-b862-4a02dd4b6df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2fb6df5-ccb7-463e-9d87-77022df629bd', 'volume_name': 'volume-a2fb6df5-ccb7-463e-9d87-77022df629bd', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-42838a3e-efaa-4306-acd7-330f853e0890 tempest-VolumeQuotasAdminTestJSON-651660576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0062c53-49db-4a98-8a81-fef0e84bbc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-42838a3e-efaa-4306-acd7-330f853e0890 tempest-VolumeQuotasAdminTestJSON-651660576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0062c53-49db-4a98-8a81-fef0e84bbc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-42838a3e-efaa-4306-acd7-330f853e0890 tempest-VolumeQuotasAdminTestJSON-651660576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fa47855-6ebc-4612-b002-2d545ab8718b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:53 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-42838a3e-efaa-4306-acd7-330f853e0890 tempest-VolumeQuotasAdminTestJSON-651660576 None] Volume a2fb6df5-ccb7-463e-9d87-77022df629bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2fb6df5-ccb7-463e-9d87-77022df629bd', 'volume_size': 1} Nov 02 12:29:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-42838a3e-efaa-4306-acd7-330f853e0890 tempest-VolumeQuotasAdminTestJSON-651660576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-42838a3e-efaa-4306-acd7-330f853e0890 tempest-VolumeQuotasAdminTestJSON-651660576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:53 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-42838a3e-efaa-4306-acd7-330f853e0890 tempest-VolumeQuotasAdminTestJSON-651660576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-727957859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2fb6df5-ccb7-463e-9d87-77022df629bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea93ebb879574239ac0f98ed0c8b3e71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:29:53Z,use_quota=True,user_id='56aed13603fd47f3944ba6020f36011a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:29:53 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-42838a3e-efaa-4306-acd7-330f853e0890 tempest-VolumeQuotasAdminTestJSON-651660576 None] Creating volume a2fb6df5-ccb7-463e-9d87-77022df629bd {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:29:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-42838a3e-efaa-4306-acd7-330f853e0890 tempest-VolumeQuotasAdminTestJSON-651660576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-42838a3e-efaa-4306-acd7-330f853e0890 tempest-VolumeQuotasAdminTestJSON-651660576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:53 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-42838a3e-efaa-4306-acd7-330f853e0890 tempest-VolumeQuotasAdminTestJSON-651660576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:29:53 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-42838a3e-efaa-4306-acd7-330f853e0890 tempest-VolumeQuotasAdminTestJSON-651660576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:29:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-42838a3e-efaa-4306-acd7-330f853e0890 tempest-VolumeQuotasAdminTestJSON-651660576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:53 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-42838a3e-efaa-4306-acd7-330f853e0890 tempest-VolumeQuotasAdminTestJSON-651660576 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:29:53 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-42838a3e-efaa-4306-acd7-330f853e0890 tempest-VolumeQuotasAdminTestJSON-651660576 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:29:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-42838a3e-efaa-4306-acd7-330f853e0890 tempest-VolumeQuotasAdminTestJSON-651660576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a2fb6df5-ccb7-463e-9d87-77022df629bd 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:53 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-7c43f3d6-0b15-46de-a3f1-f2b033e10527 req-9dbf3eb4-9814-4d68-86b4-f5ebc1d5c679 tempest-ServerActionsTestOtherA-618205716 None] Terminate volume connection completed successfully. Nov 02 12:29:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-7c43f3d6-0b15-46de-a3f1-f2b033e10527 req-9dbf3eb4-9814-4d68-86b4-f5ebc1d5c679 tempest-ServerActionsTestOtherA-618205716 None] Deleting attachment 25cf2556-d6cd-4e3e-b60f-aaae2dfafce0. {{(pid=86515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:29:53 devstack sudo[95709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a2fb6df5-ccb7-463e-9d87-77022df629bd 1073741824 Nov 02 12:29:53 devstack sudo[95709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:53 devstack cinder-volume[86515]: DEBUG cinder.coordination [req-7c43f3d6-0b15-46de-a3f1-f2b033e10527 req-83ddb684-c217-4ae5-b11a-fa8984454ddf tempest-ServerActionsTestOtherA-618205716 None] Acquiring lock "cinder-dab32c4f-0a42-4330-9a05-0d6ec70f2441-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:53 devstack cinder-volume[86515]: DEBUG cinder.coordination [req-7c43f3d6-0b15-46de-a3f1-f2b033e10527 req-83ddb684-c217-4ae5-b11a-fa8984454ddf tempest-ServerActionsTestOtherA-618205716 None] Lock "cinder-dab32c4f-0a42-4330-9a05-0d6ec70f2441-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:53 devstack cinder-volume[86515]: DEBUG cinder.coordination [req-7c43f3d6-0b15-46de-a3f1-f2b033e10527 req-83ddb684-c217-4ae5-b11a-fa8984454ddf tempest-ServerActionsTestOtherA-618205716 None] Acquiring lock "cinder-quobyte-dab32c4f-0a42-4330-9a05-0d6ec70f2441" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:53 devstack cinder-volume[86515]: DEBUG cinder.coordination [req-7c43f3d6-0b15-46de-a3f1-f2b033e10527 req-83ddb684-c217-4ae5-b11a-fa8984454ddf tempest-ServerActionsTestOtherA-618205716 None] Lock "cinder-quobyte-dab32c4f-0a42-4330-9a05-0d6ec70f2441" acquired by "delete_volume" :: waited 0.028s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:53 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bbae3a-1dc7-46b4-b69a-39d77409c2b2]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:29:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-7c43f3d6-0b15-46de-a3f1-f2b033e10527 req-83ddb684-c217-4ae5-b11a-fa8984454ddf tempest-ServerActionsTestOtherA-618205716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-dab32c4f-0a42-4330-9a05-0d6ec70f2441 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:53 devstack sudo[95714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-dab32c4f-0a42-4330-9a05-0d6ec70f2441 Nov 02 12:29:53 devstack sudo[95714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-42838a3e-efaa-4306-acd7-330f853e0890 tempest-VolumeQuotasAdminTestJSON-651660576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a2fb6df5-ccb7-463e-9d87-77022df629bd 1073741824" returned: 0 in 0.706s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:54 devstack sudo[95709]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-42838a3e-efaa-4306-acd7-330f853e0890 tempest-VolumeQuotasAdminTestJSON-651660576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a2fb6df5-ccb7-463e-9d87-77022df629bd {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:54 devstack sudo[95717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a2fb6df5-ccb7-463e-9d87-77022df629bd Nov 02 12:29:54 devstack sudo[95717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:54 devstack sudo[95714]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-7c43f3d6-0b15-46de-a3f1-f2b033e10527 req-83ddb684-c217-4ae5-b11a-fa8984454ddf tempest-ServerActionsTestOtherA-618205716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-dab32c4f-0a42-4330-9a05-0d6ec70f2441" returned: 0 in 0.675s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-7c43f3d6-0b15-46de-a3f1-f2b033e10527 req-83ddb684-c217-4ae5-b11a-fa8984454ddf tempest-ServerActionsTestOtherA-618205716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-dab32c4f-0a42-4330-9a05-0d6ec70f2441 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:54 devstack sudo[95723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-dab32c4f-0a42-4330-9a05-0d6ec70f2441 Nov 02 12:29:54 devstack sudo[95723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:54 devstack sudo[95717]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-42838a3e-efaa-4306-acd7-330f853e0890 tempest-VolumeQuotasAdminTestJSON-651660576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a2fb6df5-ccb7-463e-9d87-77022df629bd" returned: 0 in 0.386s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-42838a3e-efaa-4306-acd7-330f853e0890 tempest-VolumeQuotasAdminTestJSON-651660576 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:29:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-42838a3e-efaa-4306-acd7-330f853e0890 tempest-VolumeQuotasAdminTestJSON-651660576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-42838a3e-efaa-4306-acd7-330f853e0890 tempest-VolumeQuotasAdminTestJSON-651660576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fa47855-6ebc-4612-b002-2d545ab8718b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2fb6df5-ccb7-463e-9d87-77022df629bd', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-42838a3e-efaa-4306-acd7-330f853e0890 tempest-VolumeQuotasAdminTestJSON-651660576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f852d6-0299-49c2-9ac5-ea013da0e33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:29:54 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-42838a3e-efaa-4306-acd7-330f853e0890 tempest-VolumeQuotasAdminTestJSON-651660576 None] Volume volume-a2fb6df5-ccb7-463e-9d87-77022df629bd (a2fb6df5-ccb7-463e-9d87-77022df629bd): created successfully Nov 02 12:29:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-42838a3e-efaa-4306-acd7-330f853e0890 tempest-VolumeQuotasAdminTestJSON-651660576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f852d6-0299-49c2-9ac5-ea013da0e33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:29:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-42838a3e-efaa-4306-acd7-330f853e0890 tempest-VolumeQuotasAdminTestJSON-651660576 None] Flow 'volume_create_manager' (6eb13083-1438-4165-a508-b06f4f3a14c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:29:54 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-42838a3e-efaa-4306-acd7-330f853e0890 tempest-VolumeQuotasAdminTestJSON-651660576 None] Created volume successfully. Nov 02 12:29:54 devstack sudo[95723]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-7c43f3d6-0b15-46de-a3f1-f2b033e10527 req-83ddb684-c217-4ae5-b11a-fa8984454ddf tempest-ServerActionsTestOtherA-618205716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-dab32c4f-0a42-4330-9a05-0d6ec70f2441" returned: 0 in 0.346s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:54 devstack cinder-volume[86515]: DEBUG cinder.coordination [req-7c43f3d6-0b15-46de-a3f1-f2b033e10527 req-83ddb684-c217-4ae5-b11a-fa8984454ddf tempest-ServerActionsTestOtherA-618205716 None] Lock "cinder-quobyte-dab32c4f-0a42-4330-9a05-0d6ec70f2441" released by "delete_volume" :: held 1.093s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:54 devstack cinder-volume[86515]: DEBUG cinder.quota [req-7c43f3d6-0b15-46de-a3f1-f2b033e10527 req-83ddb684-c217-4ae5-b11a-fa8984454ddf tempest-ServerActionsTestOtherA-618205716 None] Created reservations ['62d58eb4-d671-4815-9819-601cb63d8823', '66851940-553d-48a5-b58e-427c2ba98958', '6325016f-088a-43d0-bc2d-73b0faeaa342', 'dea6a1f6-db8a-4de4-87bd-c024eaebd33f'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:29:54 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-72b98a54-a154-407d-8255-8e9ebe2acea6 tempest-ServerActionsTestOtherA-618205716 None] Acquiring lock "cinder-d8233902-5c8d-4b35-99a8-43664013f760-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:54 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-72b98a54-a154-407d-8255-8e9ebe2acea6 tempest-ServerActionsTestOtherA-618205716 None] Lock "cinder-d8233902-5c8d-4b35-99a8-43664013f760-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-7c43f3d6-0b15-46de-a3f1-f2b033e10527 req-83ddb684-c217-4ae5-b11a-fa8984454ddf tempest-ServerActionsTestOtherA-618205716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-7c43f3d6-0b15-46de-a3f1-f2b033e10527 req-83ddb684-c217-4ae5-b11a-fa8984454ddf tempest-ServerActionsTestOtherA-618205716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [req-7c43f3d6-0b15-46de-a3f1-f2b033e10527 req-83ddb684-c217-4ae5-b11a-fa8984454ddf tempest-ServerActionsTestOtherA-618205716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:29:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [req-7c43f3d6-0b15-46de-a3f1-f2b033e10527 req-83ddb684-c217-4ae5-b11a-fa8984454ddf tempest-ServerActionsTestOtherA-618205716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:29:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-7c43f3d6-0b15-46de-a3f1-f2b033e10527 req-83ddb684-c217-4ae5-b11a-fa8984454ddf tempest-ServerActionsTestOtherA-618205716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-7c43f3d6-0b15-46de-a3f1-f2b033e10527 req-83ddb684-c217-4ae5-b11a-fa8984454ddf tempest-ServerActionsTestOtherA-618205716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:54 devstack sudo[95727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:29:54 devstack sudo[95727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:54 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-72b98a54-a154-407d-8255-8e9ebe2acea6 tempest-ServerActionsTestOtherA-618205716 None] Acquiring lock "cinder-quobyte-d8233902-5c8d-4b35-99a8-43664013f760" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:54 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-72b98a54-a154-407d-8255-8e9ebe2acea6 tempest-ServerActionsTestOtherA-618205716 None] Lock "cinder-quobyte-d8233902-5c8d-4b35-99a8-43664013f760" acquired by "delete_volume" :: waited 0.021s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:55 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[8466ae25-973c-4a1c-9a5a-fde5ee6fa61a]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:29:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-72b98a54-a154-407d-8255-8e9ebe2acea6 tempest-ServerActionsTestOtherA-618205716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d8233902-5c8d-4b35-99a8-43664013f760 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:55 devstack sudo[95729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d8233902-5c8d-4b35-99a8-43664013f760 Nov 02 12:29:55 devstack sudo[95729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:55 devstack sudo[95727]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-7c43f3d6-0b15-46de-a3f1-f2b033e10527 req-83ddb684-c217-4ae5-b11a-fa8984454ddf tempest-ServerActionsTestOtherA-618205716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.362s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:55 devstack cinder-volume[86515]: DEBUG cinder.manager [req-7c43f3d6-0b15-46de-a3f1-f2b033e10527 req-83ddb684-c217-4ae5-b11a-fa8984454ddf tempest-ServerActionsTestOtherA-618205716 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:29:55 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-7c43f3d6-0b15-46de-a3f1-f2b033e10527 req-83ddb684-c217-4ae5-b11a-fa8984454ddf tempest-ServerActionsTestOtherA-618205716 None] Deleted volume successfully. Nov 02 12:29:55 devstack cinder-volume[86515]: DEBUG cinder.coordination [req-7c43f3d6-0b15-46de-a3f1-f2b033e10527 req-83ddb684-c217-4ae5-b11a-fa8984454ddf tempest-ServerActionsTestOtherA-618205716 None] Lock "cinder-dab32c4f-0a42-4330-9a05-0d6ec70f2441-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:55 devstack sudo[95729]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-72b98a54-a154-407d-8255-8e9ebe2acea6 tempest-ServerActionsTestOtherA-618205716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d8233902-5c8d-4b35-99a8-43664013f760" returned: 0 in 0.523s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-72b98a54-a154-407d-8255-8e9ebe2acea6 tempest-ServerActionsTestOtherA-618205716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d8233902-5c8d-4b35-99a8-43664013f760 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:55 devstack sudo[95735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d8233902-5c8d-4b35-99a8-43664013f760 Nov 02 12:29:55 devstack sudo[95735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:55 devstack sudo[95735]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-72b98a54-a154-407d-8255-8e9ebe2acea6 tempest-ServerActionsTestOtherA-618205716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d8233902-5c8d-4b35-99a8-43664013f760" returned: 0 in 0.333s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:55 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-72b98a54-a154-407d-8255-8e9ebe2acea6 tempest-ServerActionsTestOtherA-618205716 None] Lock "cinder-quobyte-d8233902-5c8d-4b35-99a8-43664013f760" released by "delete_volume" :: held 0.916s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:55 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-72b98a54-a154-407d-8255-8e9ebe2acea6 tempest-ServerActionsTestOtherA-618205716 None] Created reservations ['a419e6ff-d04c-4a9b-ac9d-c1fdd36a37fb', '9b11a03b-cc4c-4069-86e1-a34ab00c8b82', '6499300c-5ecc-4939-9f61-fa2576e5741f', '6e0fcb9c-3292-4edd-bcf1-a45ad3201b4c'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:29:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-72b98a54-a154-407d-8255-8e9ebe2acea6 tempest-ServerActionsTestOtherA-618205716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-72b98a54-a154-407d-8255-8e9ebe2acea6 tempest-ServerActionsTestOtherA-618205716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:56 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-72b98a54-a154-407d-8255-8e9ebe2acea6 tempest-ServerActionsTestOtherA-618205716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:29:56 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-72b98a54-a154-407d-8255-8e9ebe2acea6 tempest-ServerActionsTestOtherA-618205716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:29:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-72b98a54-a154-407d-8255-8e9ebe2acea6 tempest-ServerActionsTestOtherA-618205716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-72b98a54-a154-407d-8255-8e9ebe2acea6 tempest-ServerActionsTestOtherA-618205716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:56 devstack sudo[95738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:29:56 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:56 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-237b1c4e-10ad-45eb-a915-e190cdf18492 tempest-VolumeQuotasAdminTestJSON-660263180 None] Transfer volume completed successfully. Nov 02 12:29:56 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-72b98a54-a154-407d-8255-8e9ebe2acea6 tempest-ServerActionsTestOtherA-618205716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.482s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:56 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-72b98a54-a154-407d-8255-8e9ebe2acea6 tempest-ServerActionsTestOtherA-618205716 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:29:56 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-72b98a54-a154-407d-8255-8e9ebe2acea6 tempest-ServerActionsTestOtherA-618205716 None] Deleted volume successfully. Nov 02 12:29:56 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-72b98a54-a154-407d-8255-8e9ebe2acea6 tempest-ServerActionsTestOtherA-618205716 None] Lock "cinder-d8233902-5c8d-4b35-99a8-43664013f760-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:57 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-dc058e7f-958c-48ac-9ae7-1215b6bfe9ae tempest-VolumeQuotasAdminTestJSON-2000502571 None] Acquiring lock "cinder-a2fb6df5-ccb7-463e-9d87-77022df629bd-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:57 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-dc058e7f-958c-48ac-9ae7-1215b6bfe9ae tempest-VolumeQuotasAdminTestJSON-2000502571 None] Lock "cinder-a2fb6df5-ccb7-463e-9d87-77022df629bd-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:57 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-dc058e7f-958c-48ac-9ae7-1215b6bfe9ae tempest-VolumeQuotasAdminTestJSON-2000502571 None] Acquiring lock "cinder-quobyte-a2fb6df5-ccb7-463e-9d87-77022df629bd" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:29:57 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-dc058e7f-958c-48ac-9ae7-1215b6bfe9ae tempest-VolumeQuotasAdminTestJSON-2000502571 None] Lock "cinder-quobyte-a2fb6df5-ccb7-463e-9d87-77022df629bd" acquired by "delete_volume" :: waited 0.020s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:29:57 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c1323e-3037-40d8-9eaa-c17c0910e69e]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:29:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-dc058e7f-958c-48ac-9ae7-1215b6bfe9ae tempest-VolumeQuotasAdminTestJSON-2000502571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a2fb6df5-ccb7-463e-9d87-77022df629bd {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:57 devstack sudo[95764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a2fb6df5-ccb7-463e-9d87-77022df629bd Nov 02 12:29:57 devstack sudo[95764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:57 devstack sudo[95764]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-dc058e7f-958c-48ac-9ae7-1215b6bfe9ae tempest-VolumeQuotasAdminTestJSON-2000502571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a2fb6df5-ccb7-463e-9d87-77022df629bd" returned: 0 in 0.400s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-dc058e7f-958c-48ac-9ae7-1215b6bfe9ae tempest-VolumeQuotasAdminTestJSON-2000502571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a2fb6df5-ccb7-463e-9d87-77022df629bd {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:57 devstack sudo[95769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a2fb6df5-ccb7-463e-9d87-77022df629bd Nov 02 12:29:57 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:58 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-dc058e7f-958c-48ac-9ae7-1215b6bfe9ae tempest-VolumeQuotasAdminTestJSON-2000502571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a2fb6df5-ccb7-463e-9d87-77022df629bd" returned: 0 in 0.318s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:58 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-dc058e7f-958c-48ac-9ae7-1215b6bfe9ae tempest-VolumeQuotasAdminTestJSON-2000502571 None] Lock "cinder-quobyte-a2fb6df5-ccb7-463e-9d87-77022df629bd" released by "delete_volume" :: held 0.773s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:29:58 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-dc058e7f-958c-48ac-9ae7-1215b6bfe9ae tempest-VolumeQuotasAdminTestJSON-2000502571 None] Created reservations ['ee55c179-79b8-4e3a-999c-b01d17a45b4a', '220c92e2-eb50-4ebd-a7a0-684d6585090e', 'b95298a7-9bd2-47be-a23a-889db1dea110', '374ac8dd-7e81-4fc4-959f-27bcc9ded5b1'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:29:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-dc058e7f-958c-48ac-9ae7-1215b6bfe9ae tempest-VolumeQuotasAdminTestJSON-2000502571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:29:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-dc058e7f-958c-48ac-9ae7-1215b6bfe9ae tempest-VolumeQuotasAdminTestJSON-2000502571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:29:58 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-dc058e7f-958c-48ac-9ae7-1215b6bfe9ae tempest-VolumeQuotasAdminTestJSON-2000502571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:29:58 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-dc058e7f-958c-48ac-9ae7-1215b6bfe9ae tempest-VolumeQuotasAdminTestJSON-2000502571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:29:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-dc058e7f-958c-48ac-9ae7-1215b6bfe9ae tempest-VolumeQuotasAdminTestJSON-2000502571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:29:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-dc058e7f-958c-48ac-9ae7-1215b6bfe9ae tempest-VolumeQuotasAdminTestJSON-2000502571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:29:58 devstack sudo[95774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:29:58 devstack sudo[95774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:29:58 devstack sudo[95774]: pam_unix(sudo:session): session closed for user root Nov 02 12:29:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-dc058e7f-958c-48ac-9ae7-1215b6bfe9ae tempest-VolumeQuotasAdminTestJSON-2000502571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.322s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:29:58 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-dc058e7f-958c-48ac-9ae7-1215b6bfe9ae tempest-VolumeQuotasAdminTestJSON-2000502571 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:29:58 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-dc058e7f-958c-48ac-9ae7-1215b6bfe9ae tempest-VolumeQuotasAdminTestJSON-2000502571 None] Deleted volume successfully. Nov 02 12:29:58 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-dc058e7f-958c-48ac-9ae7-1215b6bfe9ae tempest-VolumeQuotasAdminTestJSON-2000502571 None] Lock "cinder-a2fb6df5-ccb7-463e-9d87-77022df629bd-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:30:08 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=152,cinder:UPDATE=176,cinder:INSERT=48,cinder:DELETE=10 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:30:08 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=141,cinder:INSERT=64,cinder:UPDATE=200,cinder:DELETE=17 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:30:11 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ed80cfc-421e-4a29-99dc-7905ef153299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:30:11 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3ed80cfc-421e-4a29-99dc-7905ef153299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Flow 'volume_create_manager' (d653aa98-5e6a-4a97-b8d9-1ed15a9e1a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:30:11 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3ed80cfc-421e-4a29-99dc-7905ef153299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a12926-8c0a-4014-bd58-e75122de2b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:30:11 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3ed80cfc-421e-4a29-99dc-7905ef153299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a12926-8c0a-4014-bd58-e75122de2b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1878499454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=707922b3-2714-4b86-a66b-468cd0eee110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be29d9b636834b0fb554544f72645b7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:30:12Z,use_quota=True,user_id='eee966ac98084931a0f1060729caa21d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:30:11 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3ed80cfc-421e-4a29-99dc-7905ef153299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c5a140-183d-4f73-b279-61da4578056b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:30:11 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3ed80cfc-421e-4a29-99dc-7905ef153299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c5a140-183d-4f73-b279-61da4578056b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:30:11 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3ed80cfc-421e-4a29-99dc-7905ef153299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62fca852-1bd3-4831-a9e6-12cf51f45e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:30:11 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3ed80cfc-421e-4a29-99dc-7905ef153299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62fca852-1bd3-4831-a9e6-12cf51f45e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '707922b3-2714-4b86-a66b-468cd0eee110', 'volume_name': 'volume-707922b3-2714-4b86-a66b-468cd0eee110', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:30:11 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3ed80cfc-421e-4a29-99dc-7905ef153299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09170254-4aeb-4342-9b9e-6e2dc6b05424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:30:11 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3ed80cfc-421e-4a29-99dc-7905ef153299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09170254-4aeb-4342-9b9e-6e2dc6b05424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:30:11 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3ed80cfc-421e-4a29-99dc-7905ef153299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb59f163-e606-47da-a145-85f1be57d037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:30:11 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-3ed80cfc-421e-4a29-99dc-7905ef153299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Volume 707922b3-2714-4b86-a66b-468cd0eee110: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-707922b3-2714-4b86-a66b-468cd0eee110', 'volume_size': 1} Nov 02 12:30:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3ed80cfc-421e-4a29-99dc-7905ef153299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:30:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3ed80cfc-421e-4a29-99dc-7905ef153299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:30:11 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3ed80cfc-421e-4a29-99dc-7905ef153299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1878499454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=707922b3-2714-4b86-a66b-468cd0eee110,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be29d9b636834b0fb554544f72645b7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:30:12Z,use_quota=True,user_id='eee966ac98084931a0f1060729caa21d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:30:11 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-3ed80cfc-421e-4a29-99dc-7905ef153299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Creating volume 707922b3-2714-4b86-a66b-468cd0eee110 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:30:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3ed80cfc-421e-4a29-99dc-7905ef153299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:30:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3ed80cfc-421e-4a29-99dc-7905ef153299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:30:11 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3ed80cfc-421e-4a29-99dc-7905ef153299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:30:11 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3ed80cfc-421e-4a29-99dc-7905ef153299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:30:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3ed80cfc-421e-4a29-99dc-7905ef153299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:30:11 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3ed80cfc-421e-4a29-99dc-7905ef153299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:30:11 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-3ed80cfc-421e-4a29-99dc-7905ef153299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:30:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3ed80cfc-421e-4a29-99dc-7905ef153299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:30:11 devstack sudo[95784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110 1073741824 Nov 02 12:30:11 devstack sudo[95784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:30:12 devstack sudo[95784]: pam_unix(sudo:session): session closed for user root Nov 02 12:30:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3ed80cfc-421e-4a29-99dc-7905ef153299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110 1073741824" returned: 0 in 0.564s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:30:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3ed80cfc-421e-4a29-99dc-7905ef153299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:30:12 devstack sudo[95790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110 Nov 02 12:30:12 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:30:12 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root Nov 02 12:30:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3ed80cfc-421e-4a29-99dc-7905ef153299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110" returned: 0 in 0.309s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:30:12 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3ed80cfc-421e-4a29-99dc-7905ef153299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:30:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3ed80cfc-421e-4a29-99dc-7905ef153299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:30:12 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3ed80cfc-421e-4a29-99dc-7905ef153299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb59f163-e606-47da-a145-85f1be57d037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-707922b3-2714-4b86-a66b-468cd0eee110', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:30:12 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3ed80cfc-421e-4a29-99dc-7905ef153299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efff9f88-ad7a-4e3d-9ac2-f2f64b2a2c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:30:12 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-3ed80cfc-421e-4a29-99dc-7905ef153299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Volume volume-707922b3-2714-4b86-a66b-468cd0eee110 (707922b3-2714-4b86-a66b-468cd0eee110): created successfully Nov 02 12:30:12 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3ed80cfc-421e-4a29-99dc-7905ef153299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efff9f88-ad7a-4e3d-9ac2-f2f64b2a2c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:30:12 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3ed80cfc-421e-4a29-99dc-7905ef153299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Flow 'volume_create_manager' (d653aa98-5e6a-4a97-b8d9-1ed15a9e1a73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:30:12 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-3ed80cfc-421e-4a29-99dc-7905ef153299 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Created volume successfully. Nov 02 12:30:13 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f7a9938-d95b-45e6-8485-68c6a35d04ed tempest-VolumesActionsTest-1898958775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:30:13 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8f7a9938-d95b-45e6-8485-68c6a35d04ed tempest-VolumesActionsTest-1898958775 None] Flow 'volume_create_manager' (3986b02c-5bff-4f60-abab-cf9fba30a9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:30:13 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8f7a9938-d95b-45e6-8485-68c6a35d04ed tempest-VolumesActionsTest-1898958775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (665c4876-450e-4a2c-9491-c4b3c587a6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:30:13 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8f7a9938-d95b-45e6-8485-68c6a35d04ed tempest-VolumesActionsTest-1898958775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (665c4876-450e-4a2c-9491-c4b3c587a6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1132438384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e281e17dd614def910f09c074071a21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:30:13Z,use_quota=True,user_id='76f40c35acb947828b2273246e779273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:30:13 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8f7a9938-d95b-45e6-8485-68c6a35d04ed tempest-VolumesActionsTest-1898958775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86529191-313a-4b19-bfeb-b1ee8c3646e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:30:13 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8f7a9938-d95b-45e6-8485-68c6a35d04ed tempest-VolumesActionsTest-1898958775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86529191-313a-4b19-bfeb-b1ee8c3646e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:30:13 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8f7a9938-d95b-45e6-8485-68c6a35d04ed tempest-VolumesActionsTest-1898958775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f9b7cd4-ffe1-4f14-ae82-9383d8784203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:30:13 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8f7a9938-d95b-45e6-8485-68c6a35d04ed tempest-VolumesActionsTest-1898958775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f9b7cd4-ffe1-4f14-ae82-9383d8784203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9', 'volume_name': 'volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:30:13 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8f7a9938-d95b-45e6-8485-68c6a35d04ed tempest-VolumesActionsTest-1898958775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6a93fbb-8df7-45eb-ab66-9784946b0eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:30:13 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8f7a9938-d95b-45e6-8485-68c6a35d04ed tempest-VolumesActionsTest-1898958775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6a93fbb-8df7-45eb-ab66-9784946b0eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:30:13 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8f7a9938-d95b-45e6-8485-68c6a35d04ed tempest-VolumesActionsTest-1898958775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7a027a6-b2c6-4887-aa46-7165a84a1dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:30:13 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-8f7a9938-d95b-45e6-8485-68c6a35d04ed tempest-VolumesActionsTest-1898958775 None] Volume 06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9', 'volume_size': 1} Nov 02 12:30:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8f7a9938-d95b-45e6-8485-68c6a35d04ed tempest-VolumesActionsTest-1898958775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:30:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8f7a9938-d95b-45e6-8485-68c6a35d04ed tempest-VolumesActionsTest-1898958775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:30:13 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8f7a9938-d95b-45e6-8485-68c6a35d04ed tempest-VolumesActionsTest-1898958775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1132438384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e281e17dd614def910f09c074071a21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:30:13Z,use_quota=True,user_id='76f40c35acb947828b2273246e779273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:30:13 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-8f7a9938-d95b-45e6-8485-68c6a35d04ed tempest-VolumesActionsTest-1898958775 None] Creating volume 06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:30:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8f7a9938-d95b-45e6-8485-68c6a35d04ed tempest-VolumesActionsTest-1898958775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:30:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8f7a9938-d95b-45e6-8485-68c6a35d04ed tempest-VolumesActionsTest-1898958775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:30:13 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8f7a9938-d95b-45e6-8485-68c6a35d04ed tempest-VolumesActionsTest-1898958775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:30:13 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8f7a9938-d95b-45e6-8485-68c6a35d04ed tempest-VolumesActionsTest-1898958775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:30:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8f7a9938-d95b-45e6-8485-68c6a35d04ed tempest-VolumesActionsTest-1898958775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:30:13 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8f7a9938-d95b-45e6-8485-68c6a35d04ed tempest-VolumesActionsTest-1898958775 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:30:13 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-8f7a9938-d95b-45e6-8485-68c6a35d04ed tempest-VolumesActionsTest-1898958775 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:30:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8f7a9938-d95b-45e6-8485-68c6a35d04ed tempest-VolumesActionsTest-1898958775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:30:13 devstack sudo[95793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9 1073741824 Nov 02 12:30:13 devstack sudo[95793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:30:13 devstack sudo[95793]: pam_unix(sudo:session): session closed for user root Nov 02 12:30:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8f7a9938-d95b-45e6-8485-68c6a35d04ed tempest-VolumesActionsTest-1898958775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9 1073741824" returned: 0 in 0.464s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:30:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8f7a9938-d95b-45e6-8485-68c6a35d04ed tempest-VolumesActionsTest-1898958775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:30:14 devstack sudo[95799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9 Nov 02 12:30:14 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:30:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d078dd23-6557-4f85-a756-a3efc8b7e4a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:30:14 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root Nov 02 12:30:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8f7a9938-d95b-45e6-8485-68c6a35d04ed tempest-VolumesActionsTest-1898958775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9" returned: 0 in 0.305s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:30:14 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8f7a9938-d95b-45e6-8485-68c6a35d04ed tempest-VolumesActionsTest-1898958775 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:30:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8f7a9938-d95b-45e6-8485-68c6a35d04ed tempest-VolumesActionsTest-1898958775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:30:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d078dd23-6557-4f85-a756-a3efc8b7e4a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.190s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:30:14 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8f7a9938-d95b-45e6-8485-68c6a35d04ed tempest-VolumesActionsTest-1898958775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7a027a6-b2c6-4887-aa46-7165a84a1dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:30:14 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8f7a9938-d95b-45e6-8485-68c6a35d04ed tempest-VolumesActionsTest-1898958775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3548df1-129c-441f-8a8b-8df5884a740d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:30:14 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-d078dd23-6557-4f85-a756-a3efc8b7e4a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Creating offline snapshot f6d68ce4-008a-4c4b-bbbe-37d66c832793 of volume 707922b3-2714-4b86-a66b-468cd0eee110 {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:30:14 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-8f7a9938-d95b-45e6-8485-68c6a35d04ed tempest-VolumesActionsTest-1898958775 None] Volume volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9 (06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9): created successfully Nov 02 12:30:14 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8f7a9938-d95b-45e6-8485-68c6a35d04ed tempest-VolumesActionsTest-1898958775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3548df1-129c-441f-8a8b-8df5884a740d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:30:14 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8f7a9938-d95b-45e6-8485-68c6a35d04ed tempest-VolumesActionsTest-1898958775 None] Flow 'volume_create_manager' (3986b02c-5bff-4f60-abab-cf9fba30a9ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:30:14 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[9860a645-32bf-4572-a251-6312660ea5a9]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:30:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d078dd23-6557-4f85-a756-a3efc8b7e4a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:30:14 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-8f7a9938-d95b-45e6-8485-68c6a35d04ed tempest-VolumesActionsTest-1898958775 None] Created volume successfully. Nov 02 12:30:14 devstack sudo[95802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110 Nov 02 12:30:14 devstack sudo[95802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:30:14 devstack sudo[95802]: pam_unix(sudo:session): session closed for user root Nov 02 12:30:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d078dd23-6557-4f85-a756-a3efc8b7e4a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110" returned: 0 in 0.358s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:30:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d078dd23-6557-4f85-a756-a3efc8b7e4a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110.f6d68ce4-008a-4c4b-bbbe-37d66c832793 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:30:14 devstack sudo[95807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110.f6d68ce4-008a-4c4b-bbbe-37d66c832793 1G Nov 02 12:30:14 devstack sudo[95807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:30:15 devstack sudo[95807]: pam_unix(sudo:session): session closed for user root Nov 02 12:30:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d078dd23-6557-4f85-a756-a3efc8b7e4a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110.f6d68ce4-008a-4c4b-bbbe-37d66c832793 1G" returned: 0 in 0.410s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:30:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d078dd23-6557-4f85-a756-a3efc8b7e4a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-707922b3-2714-4b86-a66b-468cd0eee110 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110.f6d68ce4-008a-4c4b-bbbe-37d66c832793 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:30:15 devstack sudo[95813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-707922b3-2714-4b86-a66b-468cd0eee110 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110.f6d68ce4-008a-4c4b-bbbe-37d66c832793 Nov 02 12:30:15 devstack sudo[95813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:30:15 devstack sudo[95813]: pam_unix(sudo:session): session closed for user root Nov 02 12:30:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d078dd23-6557-4f85-a756-a3efc8b7e4a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-707922b3-2714-4b86-a66b-468cd0eee110 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110.f6d68ce4-008a-4c4b-bbbe-37d66c832793" returned: 0 in 0.344s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:30:15 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-d078dd23-6557-4f85-a756-a3efc8b7e4a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110.f6d68ce4-008a-4c4b-bbbe-37d66c832793 is being set with open permissions: ugo+rw Nov 02 12:30:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d078dd23-6557-4f85-a756-a3efc8b7e4a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110.f6d68ce4-008a-4c4b-bbbe-37d66c832793 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:30:15 devstack sudo[95819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110.f6d68ce4-008a-4c4b-bbbe-37d66c832793 Nov 02 12:30:15 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:30:15 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root Nov 02 12:30:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d078dd23-6557-4f85-a756-a3efc8b7e4a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110.f6d68ce4-008a-4c4b-bbbe-37d66c832793" returned: 0 in 0.263s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:30:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d078dd23-6557-4f85-a756-a3efc8b7e4a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:30:15 devstack sudo[95822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110.info Nov 02 12:30:15 devstack sudo[95822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:30:16 devstack sudo[95822]: pam_unix(sudo:session): session closed for user root Nov 02 12:30:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d078dd23-6557-4f85-a756-a3efc8b7e4a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110.info" returned: 0 in 0.271s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:30:16 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-d078dd23-6557-4f85-a756-a3efc8b7e4a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110.info is being set with open permissions: ugo+rw Nov 02 12:30:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d078dd23-6557-4f85-a756-a3efc8b7e4a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:30:16 devstack sudo[95825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110.info Nov 02 12:30:16 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:30:16 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root Nov 02 12:30:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d078dd23-6557-4f85-a756-a3efc8b7e4a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110.info" returned: 0 in 0.306s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:30:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d078dd23-6557-4f85-a756-a3efc8b7e4a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.107s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:30:16 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-d078dd23-6557-4f85-a756-a3efc8b7e4a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Create snapshot completed successfully Nov 02 12:30:17 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d31d695d-9038-45cc-910a-7a2874eef00c tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Acquiring lock "cinder-f6d68ce4-008a-4c4b-bbbe-37d66c832793-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:30:17 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d31d695d-9038-45cc-910a-7a2874eef00c tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Lock "cinder-f6d68ce4-008a-4c4b-bbbe-37d66c832793-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:30:17 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d31d695d-9038-45cc-910a-7a2874eef00c tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Acquiring lock "cinder-quobyte-707922b3-2714-4b86-a66b-468cd0eee110" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:30:17 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d31d695d-9038-45cc-910a-7a2874eef00c tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Lock "cinder-quobyte-707922b3-2714-4b86-a66b-468cd0eee110" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:30:17 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d31d695d-9038-45cc-910a-7a2874eef00c tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Acquiring lock "cinder-quobyte-f6d68ce4-008a-4c4b-bbbe-37d66c832793" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:30:17 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d31d695d-9038-45cc-910a-7a2874eef00c tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Lock "cinder-quobyte-f6d68ce4-008a-4c4b-bbbe-37d66c832793" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:30:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-d31d695d-9038-45cc-910a-7a2874eef00c tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Deleting offline snapshot f6d68ce4-008a-4c4b-bbbe-37d66c832793 of volume 707922b3-2714-4b86-a66b-468cd0eee110 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:30:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-d31d695d-9038-45cc-910a-7a2874eef00c tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] snapshot_file for this snap is: volume-707922b3-2714-4b86-a66b-468cd0eee110.f6d68ce4-008a-4c4b-bbbe-37d66c832793 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:30:17 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4076a4c-c3ed-443f-b6fb-c18fe490cff0]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:30:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d31d695d-9038-45cc-910a-7a2874eef00c tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110.f6d68ce4-008a-4c4b-bbbe-37d66c832793 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:30:18 devstack sudo[95832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110.f6d68ce4-008a-4c4b-bbbe-37d66c832793 Nov 02 12:30:18 devstack sudo[95832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:30:18 devstack sudo[95832]: pam_unix(sudo:session): session closed for user root Nov 02 12:30:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d31d695d-9038-45cc-910a-7a2874eef00c tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110.f6d68ce4-008a-4c4b-bbbe-37d66c832793" returned: 0 in 0.490s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:30:18 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-d31d695d-9038-45cc-910a-7a2874eef00c tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-707922b3-2714-4b86-a66b-468cd0eee110(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:30:18 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[82163589-24ab-47c0-a5ce-7e1f8031afaf]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:30:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d31d695d-9038-45cc-910a-7a2874eef00c tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:30:18 devstack sudo[95842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110 Nov 02 12:30:18 devstack sudo[95842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:30:19 devstack sudo[95842]: pam_unix(sudo:session): session closed for user root Nov 02 12:30:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d31d695d-9038-45cc-910a-7a2874eef00c tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110" returned: 0 in 0.603s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:30:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d31d695d-9038-45cc-910a-7a2874eef00c tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110.f6d68ce4-008a-4c4b-bbbe-37d66c832793 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:30:19 devstack sudo[95858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110.f6d68ce4-008a-4c4b-bbbe-37d66c832793 Nov 02 12:30:19 devstack sudo[95858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:30:19 devstack sudo[95858]: pam_unix(sudo:session): session closed for user root Nov 02 12:30:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d31d695d-9038-45cc-910a-7a2874eef00c tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110.f6d68ce4-008a-4c4b-bbbe-37d66c832793" returned: 0 in 0.427s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:30:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d31d695d-9038-45cc-910a-7a2874eef00c tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110.f6d68ce4-008a-4c4b-bbbe-37d66c832793 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:30:19 devstack sudo[95863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110.f6d68ce4-008a-4c4b-bbbe-37d66c832793 Nov 02 12:30:19 devstack sudo[95863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:30:19 devstack sudo[95863]: pam_unix(sudo:session): session closed for user root Nov 02 12:30:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d31d695d-9038-45cc-910a-7a2874eef00c tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110.f6d68ce4-008a-4c4b-bbbe-37d66c832793" returned: 0 in 0.298s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:30:19 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d31d695d-9038-45cc-910a-7a2874eef00c tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Lock "cinder-quobyte-f6d68ce4-008a-4c4b-bbbe-37d66c832793" released by "_delete_snapshot" :: held 1.999s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:30:19 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d31d695d-9038-45cc-910a-7a2874eef00c tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Lock "cinder-quobyte-707922b3-2714-4b86-a66b-468cd0eee110" released by "delete_snapshot" :: held 2.050s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:30:20 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-d31d695d-9038-45cc-910a-7a2874eef00c tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Created reservations ['ec974eef-b696-41fa-b745-29549e6adb66', '19dee51a-3c42-4b42-8911-f75e4480f46d', '605a44ae-adc5-426d-a588-0e069c639984', '0cfe1b4f-1a49-42a5-bf7f-ddfd56ba8824'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:30:20 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-d31d695d-9038-45cc-910a-7a2874eef00c tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Delete snapshot completed successfully. Nov 02 12:30:20 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d31d695d-9038-45cc-910a-7a2874eef00c tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Lock "cinder-f6d68ce4-008a-4c4b-bbbe-37d66c832793-delete_snapshot" released by "delete_snapshot" :: held 2.288s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:30:21 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4a6711a2-0fc8-4ab5-bb31-f97466c9d2bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Acquiring lock "cinder-707922b3-2714-4b86-a66b-468cd0eee110-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:30:21 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4a6711a2-0fc8-4ab5-bb31-f97466c9d2bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Lock "cinder-707922b3-2714-4b86-a66b-468cd0eee110-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:30:21 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4a6711a2-0fc8-4ab5-bb31-f97466c9d2bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Acquiring lock "cinder-quobyte-707922b3-2714-4b86-a66b-468cd0eee110" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:30:21 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4a6711a2-0fc8-4ab5-bb31-f97466c9d2bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Lock "cinder-quobyte-707922b3-2714-4b86-a66b-468cd0eee110" acquired by "delete_volume" :: waited 0.085s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:30:21 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[c318f636-a1f0-4b2d-b19b-c61da1aa6c58]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:30:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4a6711a2-0fc8-4ab5-bb31-f97466c9d2bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:30:21 devstack sudo[95887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110 Nov 02 12:30:21 devstack sudo[95887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:30:22 devstack sudo[95887]: pam_unix(sudo:session): session closed for user root Nov 02 12:30:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4a6711a2-0fc8-4ab5-bb31-f97466c9d2bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110" returned: 0 in 0.736s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:30:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4a6711a2-0fc8-4ab5-bb31-f97466c9d2bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:30:22 devstack sudo[95940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110 Nov 02 12:30:22 devstack sudo[95940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:30:22 devstack sudo[95940]: pam_unix(sudo:session): session closed for user root Nov 02 12:30:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4a6711a2-0fc8-4ab5-bb31-f97466c9d2bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-707922b3-2714-4b86-a66b-468cd0eee110" returned: 0 in 0.360s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:30:22 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4a6711a2-0fc8-4ab5-bb31-f97466c9d2bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Lock "cinder-quobyte-707922b3-2714-4b86-a66b-468cd0eee110" released by "delete_volume" :: held 1.235s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:30:22 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-4a6711a2-0fc8-4ab5-bb31-f97466c9d2bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Created reservations ['cfcca83b-2619-42da-b203-d70740db9ec1', '5d3beb2d-0333-42fe-84d2-e39ab0ae8128', '0e0a90cb-9c17-4109-986c-7ec265258a79', '28e1d49f-d38d-4966-aa03-bded9313b26b'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:30:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4a6711a2-0fc8-4ab5-bb31-f97466c9d2bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:30:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4a6711a2-0fc8-4ab5-bb31-f97466c9d2bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:30:22 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-4a6711a2-0fc8-4ab5-bb31-f97466c9d2bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:30:22 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-4a6711a2-0fc8-4ab5-bb31-f97466c9d2bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:30:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4a6711a2-0fc8-4ab5-bb31-f97466c9d2bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:30:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4a6711a2-0fc8-4ab5-bb31-f97466c9d2bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:30:22 devstack sudo[95947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:30:22 devstack sudo[95947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:30:23 devstack sudo[95947]: pam_unix(sudo:session): session closed for user root Nov 02 12:30:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4a6711a2-0fc8-4ab5-bb31-f97466c9d2bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.386s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:30:23 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-4a6711a2-0fc8-4ab5-bb31-f97466c9d2bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:30:23 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-4a6711a2-0fc8-4ab5-bb31-f97466c9d2bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Deleted volume successfully. Nov 02 12:30:23 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4a6711a2-0fc8-4ab5-bb31-f97466c9d2bf tempest-VolumeSnapshotQuotasNegativeTestJSON-1907613459 None] Lock "cinder-707922b3-2714-4b86-a66b-468cd0eee110-delete_volume" released by "delete_volume" :: held 2.066s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:30:26 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c6750d89-df2e-40f8-bb73-a8b71fbf84a1 tempest-VolumesActionsTest-1898958775 None] Acquiring lock "cinder-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9" by "attach_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:30:26 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c6750d89-df2e-40f8-bb73-a8b71fbf84a1 tempest-VolumesActionsTest-1898958775 None] Lock "cinder-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9" acquired by "attach_volume" :: waited 0.036s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:30:26 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-c6750d89-df2e-40f8-bb73-a8b71fbf84a1 tempest-VolumesActionsTest-1898958775 None] Attaching volume 06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9 to instance f38ca6ca-1cad-47a9-b171-5b5c87af7a3d at mountpoint /dev/vdb on host None. Nov 02 12:30:26 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-c6750d89-df2e-40f8-bb73-a8b71fbf84a1 tempest-VolumesActionsTest-1898958775 None] Attach volume completed successfully. Nov 02 12:30:26 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c6750d89-df2e-40f8-bb73-a8b71fbf84a1 tempest-VolumesActionsTest-1898958775 None] Lock "cinder-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9" released by "attach_volume" :: held 0.237s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:30:27 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-40a03df1-a363-407e-a0a8-c302d2c7e026 tempest-VolumesActionsTest-1898958775 None] Acquiring lock "cinder-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9-detach_volume" by "detach_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:30:27 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-40a03df1-a363-407e-a0a8-c302d2c7e026 tempest-VolumesActionsTest-1898958775 None] Lock "cinder-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:30:27 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-40a03df1-a363-407e-a0a8-c302d2c7e026 tempest-VolumesActionsTest-1898958775 None] Detaching volume 06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9 from instance f38ca6ca-1cad-47a9-b171-5b5c87af7a3d. Nov 02 12:30:27 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-40a03df1-a363-407e-a0a8-c302d2c7e026 tempest-VolumesActionsTest-1898958775 None] Detach volume completed successfully. Nov 02 12:30:27 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-40a03df1-a363-407e-a0a8-c302d2c7e026 tempest-VolumesActionsTest-1898958775 None] Lock "cinder-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9-detach_volume" released by "detach_volume" :: held 0.092s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:30:37 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=21,cinder:UPDATE=33,cinder:INSERT=8,cinder:DELETE=1 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:30:37 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=28,cinder:UPDATE=15,cinder:INSERT=5,cinder:DELETE=3 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:30:41 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-623b38f4-2aa7-4d3b-95ca-be57e10439dc tempest-VolumesActionsTest-1898958775 None] Acquiring lock "cinder-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9" by "attach_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:30:41 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-623b38f4-2aa7-4d3b-95ca-be57e10439dc tempest-VolumesActionsTest-1898958775 None] Lock "cinder-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9" acquired by "attach_volume" :: waited 0.036s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:30:41 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-623b38f4-2aa7-4d3b-95ca-be57e10439dc tempest-VolumesActionsTest-1898958775 None] Attaching volume 06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9 to instance c93cb2c7-c4cd-44bb-b35f-7fe7e3b940ea at mountpoint /dev/vdb on host None. Nov 02 12:30:41 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-623b38f4-2aa7-4d3b-95ca-be57e10439dc tempest-VolumesActionsTest-1898958775 None] Attach volume completed successfully. Nov 02 12:30:41 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-623b38f4-2aa7-4d3b-95ca-be57e10439dc tempest-VolumesActionsTest-1898958775 None] Lock "cinder-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9" released by "attach_volume" :: held 0.183s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:30:42 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f0c52b9a-1610-4bcd-8f39-ec6fd5e999c2 tempest-VolumesActionsTest-1898958775 None] Acquiring lock "cinder-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9-detach_volume" by "detach_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:30:42 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f0c52b9a-1610-4bcd-8f39-ec6fd5e999c2 tempest-VolumesActionsTest-1898958775 None] Lock "cinder-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:30:42 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-f0c52b9a-1610-4bcd-8f39-ec6fd5e999c2 tempest-VolumesActionsTest-1898958775 None] Detaching volume 06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9 from instance c93cb2c7-c4cd-44bb-b35f-7fe7e3b940ea. Nov 02 12:30:42 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-f0c52b9a-1610-4bcd-8f39-ec6fd5e999c2 tempest-VolumesActionsTest-1898958775 None] Detach volume completed successfully. Nov 02 12:30:42 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f0c52b9a-1610-4bcd-8f39-ec6fd5e999c2 tempest-VolumesActionsTest-1898958775 None] Lock "cinder-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9-detach_volume" released by "detach_volume" :: held 0.109s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:30:43 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:30:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:30:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:30:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:30:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:30:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:30:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:30:43 devstack sudo[96200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:30:43 devstack sudo[96200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:30:44 devstack sudo[96200]: pam_unix(sudo:session): session closed for user root Nov 02 12:30:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.792s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:30:44 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:30:44 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager._thread_info {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:30:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread count: 28 {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:30:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread info: [<_MainThread(MainThread, started 129944084402304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:30:49 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:30:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Flow 'volume_create_manager' (5107ae63-7858-4901-bf34-eacaf9f43db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:30:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ee1700-67eb-407d-841a-c633570f7842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:30:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ee1700-67eb-407d-841a-c633570f7842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-652077752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c7861a5-6118-47f3-97d8-9b10fd0251ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23e8c854ad0644fd83f0ec528e7d6d60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:30:49Z,use_quota=True,user_id='8538893cd23e467d998c2bcdb02bbdf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:30:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ca491c-27e5-452f-a61e-f62973c2a9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:30:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ca491c-27e5-452f-a61e-f62973c2a9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:30:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d63d5df7-e8af-4e0a-a103-9c0c2231d41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:30:49 devstack cinder-volume[86515]: DEBUG cinder.image.glance [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Creating Keystone auth plugin from conf {{(pid=86515) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 12:30:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d63d5df7-e8af-4e0a-a103-9c0c2231d41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0c7861a5-6118-47f3-97d8-9b10fd0251ae', 'volume_name': 'volume-0c7861a5-6118-47f3-97d8-9b10fd0251ae', 'volume_size': 1, 'image_id': '4d531188-e398-41fe-8056-e52aa8e7c4ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d531188-e398-41fe-8056-e52aa8e7c4ab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ea64174531846a688f10d8f38a757ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d531188-e398-41fe-8056-e52aa8e7c4ab', 'created_at': datetime.datetime(2026, 11, 2, 11, 16, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 16, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d531188-e398-41fe-8056-e52aa8e7c4ab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:30:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0867c97c-760d-45ad-a14d-1d543100864f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:30:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0867c97c-760d-45ad-a14d-1d543100864f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:30:50 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be993cec-43ea-46c9-a7dd-7402b2bf0e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:30:50 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Volume 0c7861a5-6118-47f3-97d8-9b10fd0251ae: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0c7861a5-6118-47f3-97d8-9b10fd0251ae', 'volume_size': 1, 'image_id': '4d531188-e398-41fe-8056-e52aa8e7c4ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d531188-e398-41fe-8056-e52aa8e7c4ab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ea64174531846a688f10d8f38a757ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d531188-e398-41fe-8056-e52aa8e7c4ab', 'created_at': datetime.datetime(2026, 11, 2, 11, 16, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 16, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d531188-e398-41fe-8056-e52aa8e7c4ab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 12:30:50 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Trying to clone 0c7861a5-6118-47f3-97d8-9b10fd0251ae from image 4d531188-e398-41fe-8056-e52aa8e7c4ab at location (None, [{'url': 'file:///opt/stack/data/glance/images/4d531188-e398-41fe-8056-e52aa8e7c4ab', 'metadata': {}}]). {{(pid=86515) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1127}} Nov 02 12:30:50 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_y8ttlazkdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86515) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 12:30:50 devstack cinder-volume[86515]: INFO cinder.image.image_utils [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Image download 20.69 MB at 20.69 MB/s Nov 02 12:30:50 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fba5102-d698-4887-9d4b-034f743b1340]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:30:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_y8ttlazkdevstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:30:51 devstack sudo[96297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_y8ttlazkdevstack@QuobyteHD Nov 02 12:30:51 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:30:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-57e5d4b3-e531-4935-a2c4-c50a666893ce tempest-VolumesActionsTest-1898958775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:30:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-57e5d4b3-e531-4935-a2c4-c50a666893ce tempest-VolumesActionsTest-1898958775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:30:51 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9f4f17-cbc2-45dd-bc59-12357c7c4f38]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:30:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-57e5d4b3-e531-4935-a2c4-c50a666893ce tempest-VolumesActionsTest-1898958775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:30:51 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root Nov 02 12:30:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_y8ttlazkdevstack@QuobyteHD" returned: 0 in 0.859s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:30:51 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Temporary image 4d531188-e398-41fe-8056-e52aa8e7c4ab is fetched for user 8538893cd23e467d998c2bcdb02bbdf5. {{(pid=86515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 12:30:51 devstack sudo[96347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9 Nov 02 12:30:51 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:30:51 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb94928d-1338-4e04-a0bc-59720c1dbc79]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:30:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_y8ttlazkdevstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:30:52 devstack sudo[96357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_y8ttlazkdevstack@QuobyteHD Nov 02 12:30:52 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:30:52 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root Nov 02 12:30:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-57e5d4b3-e531-4935-a2c4-c50a666893ce tempest-VolumesActionsTest-1898958775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9" returned: 0 in 0.813s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:30:52 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[891900ef-d9ee-41c4-8a90-9f1cbd029731]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:30:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-57e5d4b3-e531-4935-a2c4-c50a666893ce tempest-VolumesActionsTest-1898958775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:30:52 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root Nov 02 12:30:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_y8ttlazkdevstack@QuobyteHD" returned: 0 in 0.581s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:30:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:30:52 devstack sudo[96363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9 Nov 02 12:30:52 devstack sudo[96363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:30:52 devstack sudo[96363]: pam_unix(sudo:session): session closed for user root Nov 02 12:30:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-57e5d4b3-e531-4935-a2c4-c50a666893ce tempest-VolumesActionsTest-1898958775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9" returned: 0 in 0.496s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:30:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-57e5d4b3-e531-4935-a2c4-c50a666893ce tempest-VolumesActionsTest-1898958775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9 /opt/stack/data/cinder/conversion/06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9.temp_image.b2bb02c7-6a6b-42a7-ab1c-ed509e5afde4svk790w4.img {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:30:52 devstack sudo[96371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9 /opt/stack/data/cinder/conversion/06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9.temp_image.b2bb02c7-6a6b-42a7-ab1c-ed509e5afde4svk790w4.img Nov 02 12:30:52 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:30:57 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-d56300cd-4971-47f5-a6e5-d9fefc588c27 tempest-ServersNegativeTestJSON-2121823119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:30:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d56300cd-4971-47f5-a6e5-d9fefc588c27 tempest-ServersNegativeTestJSON-2121823119 None] Flow 'volume_create_manager' (c5bdafed-852d-4d36-9334-864584bc429f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:30:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d56300cd-4971-47f5-a6e5-d9fefc588c27 tempest-ServersNegativeTestJSON-2121823119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f895594-f88b-4b4b-b33b-83ca681e2713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:30:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d56300cd-4971-47f5-a6e5-d9fefc588c27 tempest-ServersNegativeTestJSON-2121823119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f895594-f88b-4b4b-b33b-83ca681e2713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-493404929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92803f4c-be2e-41c2-959d-43d0f59386d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0440015a714a9eb17f395818434407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:30:58Z,use_quota=True,user_id='ef8d910a797342d9a680c7ff87e3986e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:30:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d56300cd-4971-47f5-a6e5-d9fefc588c27 tempest-ServersNegativeTestJSON-2121823119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec47f68-34a8-4047-8a53-139c3b5e4331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:30:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d56300cd-4971-47f5-a6e5-d9fefc588c27 tempest-ServersNegativeTestJSON-2121823119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dec47f68-34a8-4047-8a53-139c3b5e4331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:30:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d56300cd-4971-47f5-a6e5-d9fefc588c27 tempest-ServersNegativeTestJSON-2121823119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166698e6-9f29-4a2c-827d-86f8a60f98b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:30:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d56300cd-4971-47f5-a6e5-d9fefc588c27 tempest-ServersNegativeTestJSON-2121823119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166698e6-9f29-4a2c-827d-86f8a60f98b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92803f4c-be2e-41c2-959d-43d0f59386d3', 'volume_name': 'volume-92803f4c-be2e-41c2-959d-43d0f59386d3', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:30:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d56300cd-4971-47f5-a6e5-d9fefc588c27 tempest-ServersNegativeTestJSON-2121823119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fa94561-d553-4c18-aef0-1a504748e767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:30:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d56300cd-4971-47f5-a6e5-d9fefc588c27 tempest-ServersNegativeTestJSON-2121823119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fa94561-d553-4c18-aef0-1a504748e767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:30:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d56300cd-4971-47f5-a6e5-d9fefc588c27 tempest-ServersNegativeTestJSON-2121823119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f8f265d-ae07-4717-bed1-ef531618048e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:30:57 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-d56300cd-4971-47f5-a6e5-d9fefc588c27 tempest-ServersNegativeTestJSON-2121823119 None] Volume 92803f4c-be2e-41c2-959d-43d0f59386d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92803f4c-be2e-41c2-959d-43d0f59386d3', 'volume_size': 1} Nov 02 12:30:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d56300cd-4971-47f5-a6e5-d9fefc588c27 tempest-ServersNegativeTestJSON-2121823119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:31:00 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-57e5d4b3-e531-4935-a2c4-c50a666893ce tempest-VolumesActionsTest-1898958775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9 /opt/stack/data/cinder/conversion/06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9.temp_image.b2bb02c7-6a6b-42a7-ab1c-ed509e5afde4svk790w4.img" returned: 0 in 7.532s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:00 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d23f5a-8a07-4786-89bf-696beed47097]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:31:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-57e5d4b3-e531-4935-a2c4-c50a666893ce tempest-VolumesActionsTest-1898958775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:00 devstack sudo[96411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9 Nov 02 12:31:00 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:00 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-57e5d4b3-e531-4935-a2c4-c50a666893ce tempest-VolumesActionsTest-1898958775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9" returned: 0 in 0.500s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:00 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-57e5d4b3-e531-4935-a2c4-c50a666893ce tempest-VolumesActionsTest-1898958775 None] Image conversion details: src /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9, size 1024.00 MB, duration 7.53 sec, destination /opt/stack/data/cinder/conversion/06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9.temp_image.b2bb02c7-6a6b-42a7-ab1c-ed509e5afde4svk790w4.img {{(pid=86515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 12:31:00 devstack cinder-volume[86515]: INFO cinder.image.image_utils [None req-57e5d4b3-e531-4935-a2c4-c50a666893ce tempest-VolumesActionsTest-1898958775 None] Converted 1024.00 MB image at 135.93 MB/s Nov 02 12:31:00 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-57e5d4b3-e531-4935-a2c4-c50a666893ce tempest-VolumesActionsTest-1898958775 None] b2bb02c7-6a6b-42a7-ab1c-ed509e5afde4 was raw, no need to convert to raw {{(pid=86515) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 02 12:31:10 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:INSERT=1,cinder:SELECT=8,cinder:UPDATE=7 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:31:10 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=15,cinder:INSERT=2,cinder:UPDATE=2 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:31:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-57e5d4b3-e531-4935-a2c4-c50a666893ce tempest-VolumesActionsTest-1898958775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.030s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:31:19 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-57e5d4b3-e531-4935-a2c4-c50a666893ce tempest-VolumesActionsTest-1898958775 None] Uploaded volume to glance image-id: b2bb02c7-6a6b-42a7-ab1c-ed509e5afde4. {{(pid=86515) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 12:31:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.992s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:31:19 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-652077752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c7861a5-6118-47f3-97d8-9b10fd0251ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23e8c854ad0644fd83f0ec528e7d6d60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:30:49Z,use_quota=True,user_id='8538893cd23e467d998c2bcdb02bbdf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:31:19 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Creating volume 0c7861a5-6118-47f3-97d8-9b10fd0251ae {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:31:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:31:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:31:19 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:31:19 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:31:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:31:19 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:31:19 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:31:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c7861a5-6118-47f3-97d8-9b10fd0251ae 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:19 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c7861a5-6118-47f3-97d8-9b10fd0251ae 1073741824 Nov 02 12:31:19 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:19 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-57e5d4b3-e531-4935-a2c4-c50a666893ce tempest-VolumesActionsTest-1898958775 None] Copy volume to image completed successfully. Nov 02 12:31:20 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c7861a5-6118-47f3-97d8-9b10fd0251ae 1073741824" returned: 0 in 0.470s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c7861a5-6118-47f3-97d8-9b10fd0251ae {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:20 devstack sudo[96425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c7861a5-6118-47f3-97d8-9b10fd0251ae Nov 02 12:31:20 devstack sudo[96425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:20 devstack sudo[96425]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c7861a5-6118-47f3-97d8-9b10fd0251ae" returned: 0 in 0.290s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:31:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:31:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d56300cd-4971-47f5-a6e5-d9fefc588c27 tempest-ServersNegativeTestJSON-2121823119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.462s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:31:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d56300cd-4971-47f5-a6e5-d9fefc588c27 tempest-ServersNegativeTestJSON-2121823119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-493404929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92803f4c-be2e-41c2-959d-43d0f59386d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0440015a714a9eb17f395818434407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:30:58Z,use_quota=True,user_id='ef8d910a797342d9a680c7ff87e3986e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:31:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-d56300cd-4971-47f5-a6e5-d9fefc588c27 tempest-ServersNegativeTestJSON-2121823119 None] Creating volume 92803f4c-be2e-41c2-959d-43d0f59386d3 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:31:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d56300cd-4971-47f5-a6e5-d9fefc588c27 tempest-ServersNegativeTestJSON-2121823119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:31:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d56300cd-4971-47f5-a6e5-d9fefc588c27 tempest-ServersNegativeTestJSON-2121823119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:31:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d56300cd-4971-47f5-a6e5-d9fefc588c27 tempest-ServersNegativeTestJSON-2121823119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:31:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d56300cd-4971-47f5-a6e5-d9fefc588c27 tempest-ServersNegativeTestJSON-2121823119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:31:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d56300cd-4971-47f5-a6e5-d9fefc588c27 tempest-ServersNegativeTestJSON-2121823119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:31:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d56300cd-4971-47f5-a6e5-d9fefc588c27 tempest-ServersNegativeTestJSON-2121823119 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:31:20 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-d56300cd-4971-47f5-a6e5-d9fefc588c27 tempest-ServersNegativeTestJSON-2121823119 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:31:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d56300cd-4971-47f5-a6e5-d9fefc588c27 tempest-ServersNegativeTestJSON-2121823119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-92803f4c-be2e-41c2-959d-43d0f59386d3 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:20 devstack sudo[96428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-92803f4c-be2e-41c2-959d-43d0f59386d3 1073741824 Nov 02 12:31:20 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:20 devstack cinder-volume[86515]: DEBUG cinder.volume.volume_utils [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Attempting download of 4d531188-e398-41fe-8056-e52aa8e7c4ab ((None, [{'url': 'file:///opt/stack/data/glance/images/4d531188-e398-41fe-8056-e52aa8e7c4ab', 'metadata': {}}])) to volume 0c7861a5-6118-47f3-97d8-9b10fd0251ae. {{(pid=86515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 12:31:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-eee04d40-14e9-48f3-9fdf-f7c7a62dab41 tempest-VolumesActionsTest-1898958775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:31:20 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[574d4d1f-08a1-4c6c-a0e6-b7f290bad456]: (4, 'raw') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:31:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d531188-e398-41fe-8056-e52aa8e7c4ab_pn5ot0oi {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:20 devstack sudo[96430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d531188-e398-41fe-8056-e52aa8e7c4ab_pn5ot0oi Nov 02 12:31:20 devstack sudo[96430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:20 devstack sudo[96430]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d531188-e398-41fe-8056-e52aa8e7c4ab_pn5ot0oi" returned: 0 in 0.356s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d531188-e398-41fe-8056-e52aa8e7c4ab_pn5ot0oi {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:20 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d56300cd-4971-47f5-a6e5-d9fefc588c27 tempest-ServersNegativeTestJSON-2121823119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-92803f4c-be2e-41c2-959d-43d0f59386d3 1073741824" returned: 0 in 0.475s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d56300cd-4971-47f5-a6e5-d9fefc588c27 tempest-ServersNegativeTestJSON-2121823119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-92803f4c-be2e-41c2-959d-43d0f59386d3 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:20 devstack sudo[96438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-92803f4c-be2e-41c2-959d-43d0f59386d3 Nov 02 12:31:20 devstack sudo[96438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:20 devstack sudo[96437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d531188-e398-41fe-8056-e52aa8e7c4ab_pn5ot0oi Nov 02 12:31:20 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:21 devstack sudo[96438]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d56300cd-4971-47f5-a6e5-d9fefc588c27 tempest-ServersNegativeTestJSON-2121823119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-92803f4c-be2e-41c2-959d-43d0f59386d3" returned: 0 in 0.268s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:21 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d56300cd-4971-47f5-a6e5-d9fefc588c27 tempest-ServersNegativeTestJSON-2121823119 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:31:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d56300cd-4971-47f5-a6e5-d9fefc588c27 tempest-ServersNegativeTestJSON-2121823119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:31:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-eee04d40-14e9-48f3-9fdf-f7c7a62dab41 tempest-VolumesActionsTest-1898958775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.687s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:31:21 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d56300cd-4971-47f5-a6e5-d9fefc588c27 tempest-ServersNegativeTestJSON-2121823119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f8f265d-ae07-4717-bed1-ef531618048e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92803f4c-be2e-41c2-959d-43d0f59386d3', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:31:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d56300cd-4971-47f5-a6e5-d9fefc588c27 tempest-ServersNegativeTestJSON-2121823119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b74cfc9f-a45b-48dd-85a0-1fc685694956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:31:21 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5c2272-0732-4cb9-998d-05984da351e2]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:31:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eee04d40-14e9-48f3-9fdf-f7c7a62dab41 tempest-VolumesActionsTest-1898958775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d531188-e398-41fe-8056-e52aa8e7c4ab_pn5ot0oi" returned: 1 in 0.362s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d531188-e398-41fe-8056-e52aa8e7c4ab_pn5ot0oi' failed. Not Retrying. {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:31:21 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1b3798-7b47-42e6-b9d4-a0b5481dadd4]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:31:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_y8ttlazkdevstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:21 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-d56300cd-4971-47f5-a6e5-d9fefc588c27 tempest-ServersNegativeTestJSON-2121823119 None] Volume volume-92803f4c-be2e-41c2-959d-43d0f59386d3 (92803f4c-be2e-41c2-959d-43d0f59386d3): created successfully Nov 02 12:31:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d56300cd-4971-47f5-a6e5-d9fefc588c27 tempest-ServersNegativeTestJSON-2121823119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b74cfc9f-a45b-48dd-85a0-1fc685694956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:31:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d56300cd-4971-47f5-a6e5-d9fefc588c27 tempest-ServersNegativeTestJSON-2121823119 None] Flow 'volume_create_manager' (c5bdafed-852d-4d36-9334-864584bc429f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:31:21 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-d56300cd-4971-47f5-a6e5-d9fefc588c27 tempest-ServersNegativeTestJSON-2121823119 None] Created volume successfully. Nov 02 12:31:21 devstack sudo[96445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9 Nov 02 12:31:21 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:21 devstack sudo[96446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_y8ttlazkdevstack@QuobyteHD Nov 02 12:31:21 devstack sudo[96446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:21 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eee04d40-14e9-48f3-9fdf-f7c7a62dab41 tempest-VolumesActionsTest-1898958775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9" returned: 0 in 0.401s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:21 devstack sudo[96446]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_y8ttlazkdevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:21 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] 4d531188-e398-41fe-8056-e52aa8e7c4ab was qcow2, converting to qcow2 {{(pid=86515) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 12:31:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_y8ttlazkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c7861a5-6118-47f3-97d8-9b10fd0251ae {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:21 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[09211cd1-718f-48ac-a32b-d74138bb44a8]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:31:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eee04d40-14e9-48f3-9fdf-f7c7a62dab41 tempest-VolumesActionsTest-1898958775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:21 devstack sudo[96456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_y8ttlazkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c7861a5-6118-47f3-97d8-9b10fd0251ae Nov 02 12:31:21 devstack sudo[96456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:21 devstack sudo[96457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9 Nov 02 12:31:21 devstack sudo[96457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:21 devstack sudo[96457]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eee04d40-14e9-48f3-9fdf-f7c7a62dab41 tempest-VolumesActionsTest-1898958775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9" returned: 0 in 0.353s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eee04d40-14e9-48f3-9fdf-f7c7a62dab41 tempest-VolumesActionsTest-1898958775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9 /opt/stack/data/cinder/conversion/06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9.temp_image.5a32b9f4-3d4e-4035-a300-635779d6888a5znn54av.img {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:22 devstack sudo[96466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9 /opt/stack/data/cinder/conversion/06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9.temp_image.5a32b9f4-3d4e-4035-a300-635779d6888a5znn54av.img Nov 02 12:31:22 devstack sudo[96466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:24 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-504f330a-803b-4834-bf06-a615053455f4 tempest-ServersNegativeTestJSON-2121823119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:31:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-504f330a-803b-4834-bf06-a615053455f4 tempest-ServersNegativeTestJSON-2121823119 None] Flow 'volume_create_manager' (6c77009a-567b-4bb0-bde6-1100e95d4ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:31:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-504f330a-803b-4834-bf06-a615053455f4 tempest-ServersNegativeTestJSON-2121823119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb1a9040-35ff-496d-848b-ce01f885569c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:31:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-504f330a-803b-4834-bf06-a615053455f4 tempest-ServersNegativeTestJSON-2121823119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb1a9040-35ff-496d-848b-ce01f885569c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-503390620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87255345-bbf7-463c-bc02-5e38522c3082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0440015a714a9eb17f395818434407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:31:25Z,use_quota=True,user_id='ef8d910a797342d9a680c7ff87e3986e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:31:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-504f330a-803b-4834-bf06-a615053455f4 tempest-ServersNegativeTestJSON-2121823119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (606563a8-73aa-4b44-8b14-a09f9c042b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:31:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-504f330a-803b-4834-bf06-a615053455f4 tempest-ServersNegativeTestJSON-2121823119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (606563a8-73aa-4b44-8b14-a09f9c042b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:31:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-504f330a-803b-4834-bf06-a615053455f4 tempest-ServersNegativeTestJSON-2121823119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a0a821-817d-468d-8866-d00f9bbfb755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:31:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-504f330a-803b-4834-bf06-a615053455f4 tempest-ServersNegativeTestJSON-2121823119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a0a821-817d-468d-8866-d00f9bbfb755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87255345-bbf7-463c-bc02-5e38522c3082', 'volume_name': 'volume-87255345-bbf7-463c-bc02-5e38522c3082', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:31:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-504f330a-803b-4834-bf06-a615053455f4 tempest-ServersNegativeTestJSON-2121823119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11c200a1-d000-4970-8a55-f4ec6b267730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:31:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-504f330a-803b-4834-bf06-a615053455f4 tempest-ServersNegativeTestJSON-2121823119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11c200a1-d000-4970-8a55-f4ec6b267730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:31:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-504f330a-803b-4834-bf06-a615053455f4 tempest-ServersNegativeTestJSON-2121823119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5dc1d09-7bc1-4b9b-bcc1-c777917479a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:31:24 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-504f330a-803b-4834-bf06-a615053455f4 tempest-ServersNegativeTestJSON-2121823119 None] Volume 87255345-bbf7-463c-bc02-5e38522c3082: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87255345-bbf7-463c-bc02-5e38522c3082', 'volume_size': 1} Nov 02 12:31:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-504f330a-803b-4834-bf06-a615053455f4 tempest-ServersNegativeTestJSON-2121823119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:31:25 devstack sudo[96456]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_y8ttlazkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c7861a5-6118-47f3-97d8-9b10fd0251ae" returned: 0 in 3.996s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:25 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_y8ttlazkdevstack@QuobyteHD, size 112.00 MB, duration 4.00 sec, destination /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c7861a5-6118-47f3-97d8-9b10fd0251ae {{(pid=86515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 12:31:25 devstack cinder-volume[86515]: INFO cinder.image.image_utils [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Converted 112.00 MB image at 28.02 MB/s Nov 02 12:31:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c7861a5-6118-47f3-97d8-9b10fd0251ae 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:25 devstack sudo[96481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c7861a5-6118-47f3-97d8-9b10fd0251ae 1G Nov 02 12:31:25 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:26 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c7861a5-6118-47f3-97d8-9b10fd0251ae 1G" returned: 0 in 0.692s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:26 devstack cinder-volume[86515]: DEBUG cinder.volume.volume_utils [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Downloaded image 4d531188-e398-41fe-8056-e52aa8e7c4ab ((None, [{'url': 'file:///opt/stack/data/glance/images/4d531188-e398-41fe-8056-e52aa8e7c4ab', 'metadata': {}}])) to volume 0c7861a5-6118-47f3-97d8-9b10fd0251ae successfully. {{(pid=86515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 12:31:26 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Temporary image 4d531188-e398-41fe-8056-e52aa8e7c4ab for user 8538893cd23e467d998c2bcdb02bbdf5 is deleted. {{(pid=86515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 12:31:26 devstack cinder-volume[86515]: DEBUG cinder.volume.volume_utils [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Marking volume 0c7861a5-6118-47f3-97d8-9b10fd0251ae as bootable. {{(pid=86515) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 12:31:26 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Copying metadata from image 4d531188-e398-41fe-8056-e52aa8e7c4ab to 0c7861a5-6118-47f3-97d8-9b10fd0251ae. {{(pid=86515) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 12:31:26 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Creating volume glance metadata for volume 0c7861a5-6118-47f3-97d8-9b10fd0251ae backed by image 4d531188-e398-41fe-8056-e52aa8e7c4ab with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4d531188-e398-41fe-8056-e52aa8e7c4ab', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86515) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 12:31:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be993cec-43ea-46c9-a7dd-7402b2bf0e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c7861a5-6118-47f3-97d8-9b10fd0251ae', 'volume_size': 1, 'image_id': '4d531188-e398-41fe-8056-e52aa8e7c4ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d531188-e398-41fe-8056-e52aa8e7c4ab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ea64174531846a688f10d8f38a757ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d531188-e398-41fe-8056-e52aa8e7c4ab', 'created_at': datetime.datetime(2026, 11, 2, 11, 16, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 16, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d531188-e398-41fe-8056-e52aa8e7c4ab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:31:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d83a73f0-ca5e-4afd-9300-99dd3a3e9bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:31:26 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Volume volume-0c7861a5-6118-47f3-97d8-9b10fd0251ae (0c7861a5-6118-47f3-97d8-9b10fd0251ae): created successfully Nov 02 12:31:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d83a73f0-ca5e-4afd-9300-99dd3a3e9bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:31:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Flow 'volume_create_manager' (5107ae63-7858-4901-bf34-eacaf9f43db1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:31:26 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-d41f51f5-8630-4859-b7ee-9dae52a07e18 tempest-VolumesImageMetadata-1013776236 None] Created volume successfully. Nov 02 12:31:27 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c6c9b959-3e8c-4bdd-8e25-1d435ee43fdb tempest-VolumesImageMetadata-1013776236 None] Acquiring lock "cinder-0c7861a5-6118-47f3-97d8-9b10fd0251ae-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:31:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c6c9b959-3e8c-4bdd-8e25-1d435ee43fdb tempest-VolumesImageMetadata-1013776236 None] Lock "cinder-0c7861a5-6118-47f3-97d8-9b10fd0251ae-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:31:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c6c9b959-3e8c-4bdd-8e25-1d435ee43fdb tempest-VolumesImageMetadata-1013776236 None] Acquiring lock "cinder-quobyte-0c7861a5-6118-47f3-97d8-9b10fd0251ae" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:31:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c6c9b959-3e8c-4bdd-8e25-1d435ee43fdb tempest-VolumesImageMetadata-1013776236 None] Lock "cinder-quobyte-0c7861a5-6118-47f3-97d8-9b10fd0251ae" acquired by "delete_volume" :: waited 0.030s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:31:28 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fe7689-b41d-4f7a-be64-e7e6d5e130de]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:31:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c6c9b959-3e8c-4bdd-8e25-1d435ee43fdb tempest-VolumesImageMetadata-1013776236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c7861a5-6118-47f3-97d8-9b10fd0251ae {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:28 devstack sudo[96488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c7861a5-6118-47f3-97d8-9b10fd0251ae Nov 02 12:31:28 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:28 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c6c9b959-3e8c-4bdd-8e25-1d435ee43fdb tempest-VolumesImageMetadata-1013776236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c7861a5-6118-47f3-97d8-9b10fd0251ae" returned: 0 in 0.510s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c6c9b959-3e8c-4bdd-8e25-1d435ee43fdb tempest-VolumesImageMetadata-1013776236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c7861a5-6118-47f3-97d8-9b10fd0251ae {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:28 devstack sudo[96494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c7861a5-6118-47f3-97d8-9b10fd0251ae Nov 02 12:31:28 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eee04d40-14e9-48f3-9fdf-f7c7a62dab41 tempest-VolumesActionsTest-1898958775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9 /opt/stack/data/cinder/conversion/06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9.temp_image.5a32b9f4-3d4e-4035-a300-635779d6888a5znn54av.img" returned: 0 in 6.934s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:28 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1527b00-dc62-426c-9f4d-546d5baacb48]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:31:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eee04d40-14e9-48f3-9fdf-f7c7a62dab41 tempest-VolumesActionsTest-1898958775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:28 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c6c9b959-3e8c-4bdd-8e25-1d435ee43fdb tempest-VolumesImageMetadata-1013776236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c7861a5-6118-47f3-97d8-9b10fd0251ae" returned: 0 in 0.324s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c6c9b959-3e8c-4bdd-8e25-1d435ee43fdb tempest-VolumesImageMetadata-1013776236 None] Lock "cinder-quobyte-0c7861a5-6118-47f3-97d8-9b10fd0251ae" released by "delete_volume" :: held 0.912s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:31:29 devstack sudo[96496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9 Nov 02 12:31:29 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:29 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-c6c9b959-3e8c-4bdd-8e25-1d435ee43fdb tempest-VolumesImageMetadata-1013776236 None] Created reservations ['4db0f3b8-a800-4f65-8a7c-a847fe0472d7', '0b593c10-fcc5-4846-8f32-d1052d6bac4a', 'ed714eba-5e25-4e2b-b31c-d9eb88a47b94', '88c19c21-46e2-49a5-a9bd-fdbf5545cab8'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:31:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c6c9b959-3e8c-4bdd-8e25-1d435ee43fdb tempest-VolumesImageMetadata-1013776236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:31:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c6c9b959-3e8c-4bdd-8e25-1d435ee43fdb tempest-VolumesImageMetadata-1013776236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:31:29 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-c6c9b959-3e8c-4bdd-8e25-1d435ee43fdb tempest-VolumesImageMetadata-1013776236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:31:29 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-c6c9b959-3e8c-4bdd-8e25-1d435ee43fdb tempest-VolumesImageMetadata-1013776236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:31:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c6c9b959-3e8c-4bdd-8e25-1d435ee43fdb tempest-VolumesImageMetadata-1013776236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:31:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c6c9b959-3e8c-4bdd-8e25-1d435ee43fdb tempest-VolumesImageMetadata-1013776236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:29 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:31:29 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:29 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c6c9b959-3e8c-4bdd-8e25-1d435ee43fdb tempest-VolumesImageMetadata-1013776236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.292s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:29 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-c6c9b959-3e8c-4bdd-8e25-1d435ee43fdb tempest-VolumesImageMetadata-1013776236 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:31:29 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-c6c9b959-3e8c-4bdd-8e25-1d435ee43fdb tempest-VolumesImageMetadata-1013776236 None] Deleted volume successfully. Nov 02 12:31:29 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c6c9b959-3e8c-4bdd-8e25-1d435ee43fdb tempest-VolumesImageMetadata-1013776236 None] Lock "cinder-0c7861a5-6118-47f3-97d8-9b10fd0251ae-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:31:29 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eee04d40-14e9-48f3-9fdf-f7c7a62dab41 tempest-VolumesActionsTest-1898958775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9" returned: 0 in 0.597s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:29 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-eee04d40-14e9-48f3-9fdf-f7c7a62dab41 tempest-VolumesActionsTest-1898958775 None] Image conversion details: src /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9, size 1024.00 MB, duration 6.94 sec, destination /opt/stack/data/cinder/conversion/06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9.temp_image.5a32b9f4-3d4e-4035-a300-635779d6888a5znn54av.img {{(pid=86515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 12:31:29 devstack cinder-volume[86515]: INFO cinder.image.image_utils [None req-eee04d40-14e9-48f3-9fdf-f7c7a62dab41 tempest-VolumesActionsTest-1898958775 None] Converted 1024.00 MB image at 147.65 MB/s Nov 02 12:31:29 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-eee04d40-14e9-48f3-9fdf-f7c7a62dab41 tempest-VolumesActionsTest-1898958775 None] 5a32b9f4-3d4e-4035-a300-635779d6888a was raw, converting to qcow2 {{(pid=86515) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 02 12:31:29 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[a502e24c-063f-4681-a618-41439705c061]: (4, 'raw') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:31:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eee04d40-14e9-48f3-9fdf-f7c7a62dab41 tempest-VolumesActionsTest-1898958775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9.temp_image.5a32b9f4-3d4e-4035-a300-635779d6888a5znn54av.img {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:29 devstack sudo[96505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9.temp_image.5a32b9f4-3d4e-4035-a300-635779d6888a5znn54av.img Nov 02 12:31:29 devstack sudo[96505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:29 devstack sudo[96505]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eee04d40-14e9-48f3-9fdf-f7c7a62dab41 tempest-VolumesActionsTest-1898958775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9.temp_image.5a32b9f4-3d4e-4035-a300-635779d6888a5znn54av.img" returned: 0 in 0.332s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eee04d40-14e9-48f3-9fdf-f7c7a62dab41 tempest-VolumesActionsTest-1898958775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9.temp_image.5a32b9f4-3d4e-4035-a300-635779d6888a5znn54av.img {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:30 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9.temp_image.5a32b9f4-3d4e-4035-a300-635779d6888a5znn54av.img Nov 02 12:31:30 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:30 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eee04d40-14e9-48f3-9fdf-f7c7a62dab41 tempest-VolumesActionsTest-1898958775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9.temp_image.5a32b9f4-3d4e-4035-a300-635779d6888a5znn54av.img" returned: 1 in 0.355s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eee04d40-14e9-48f3-9fdf-f7c7a62dab41 tempest-VolumesActionsTest-1898958775 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9.temp_image.5a32b9f4-3d4e-4035-a300-635779d6888a5znn54av.img' failed. Not Retrying. {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:31:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eee04d40-14e9-48f3-9fdf-f7c7a62dab41 tempest-VolumesActionsTest-1898958775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9.temp_image.5a32b9f4-3d4e-4035-a300-635779d6888a5znn54av.img /opt/stack/data/cinder/conversion/vol_upload_av9ehteg {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:30 devstack sudo[96514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9.temp_image.5a32b9f4-3d4e-4035-a300-635779d6888a5znn54av.img /opt/stack/data/cinder/conversion/vol_upload_av9ehteg Nov 02 12:31:30 devstack sudo[96514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:30 devstack sudo[96514]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eee04d40-14e9-48f3-9fdf-f7c7a62dab41 tempest-VolumesActionsTest-1898958775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9.temp_image.5a32b9f4-3d4e-4035-a300-635779d6888a5znn54av.img /opt/stack/data/cinder/conversion/vol_upload_av9ehteg" returned: 0 in 0.269s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:30 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-eee04d40-14e9-48f3-9fdf-f7c7a62dab41 tempest-VolumesActionsTest-1898958775 None] Image conversion details: src /opt/stack/data/cinder/conversion/06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9.temp_image.5a32b9f4-3d4e-4035-a300-635779d6888a5znn54av.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_av9ehteg {{(pid=86515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 12:31:30 devstack cinder-volume[86515]: INFO cinder.image.image_utils [None req-eee04d40-14e9-48f3-9fdf-f7c7a62dab41 tempest-VolumesActionsTest-1898958775 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 02 12:31:30 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbdc503-df04-4266-b152-6aef6b3f9733]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:31:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eee04d40-14e9-48f3-9fdf-f7c7a62dab41 tempest-VolumesActionsTest-1898958775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_av9ehteg {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:30 devstack sudo[96521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_av9ehteg Nov 02 12:31:30 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:30 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eee04d40-14e9-48f3-9fdf-f7c7a62dab41 tempest-VolumesActionsTest-1898958775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_av9ehteg" returned: 0 in 0.342s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-eee04d40-14e9-48f3-9fdf-f7c7a62dab41 tempest-VolumesActionsTest-1898958775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.164s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:31:32 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-eee04d40-14e9-48f3-9fdf-f7c7a62dab41 tempest-VolumesActionsTest-1898958775 None] Uploaded volume to glance image-id: 5a32b9f4-3d4e-4035-a300-635779d6888a. {{(pid=86515) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 12:31:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-504f330a-803b-4834-bf06-a615053455f4 tempest-ServersNegativeTestJSON-2121823119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.541s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:31:32 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-504f330a-803b-4834-bf06-a615053455f4 tempest-ServersNegativeTestJSON-2121823119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-503390620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87255345-bbf7-463c-bc02-5e38522c3082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d0440015a714a9eb17f395818434407',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:31:25Z,use_quota=True,user_id='ef8d910a797342d9a680c7ff87e3986e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:31:32 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-504f330a-803b-4834-bf06-a615053455f4 tempest-ServersNegativeTestJSON-2121823119 None] Creating volume 87255345-bbf7-463c-bc02-5e38522c3082 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:31:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-504f330a-803b-4834-bf06-a615053455f4 tempest-ServersNegativeTestJSON-2121823119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:31:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-504f330a-803b-4834-bf06-a615053455f4 tempest-ServersNegativeTestJSON-2121823119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:31:32 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-504f330a-803b-4834-bf06-a615053455f4 tempest-ServersNegativeTestJSON-2121823119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:31:32 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-504f330a-803b-4834-bf06-a615053455f4 tempest-ServersNegativeTestJSON-2121823119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:31:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-504f330a-803b-4834-bf06-a615053455f4 tempest-ServersNegativeTestJSON-2121823119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:31:32 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-504f330a-803b-4834-bf06-a615053455f4 tempest-ServersNegativeTestJSON-2121823119 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:31:32 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-504f330a-803b-4834-bf06-a615053455f4 tempest-ServersNegativeTestJSON-2121823119 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:31:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-504f330a-803b-4834-bf06-a615053455f4 tempest-ServersNegativeTestJSON-2121823119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-87255345-bbf7-463c-bc02-5e38522c3082 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:32 devstack sudo[96527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-87255345-bbf7-463c-bc02-5e38522c3082 1073741824 Nov 02 12:31:32 devstack sudo[96527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:32 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-eee04d40-14e9-48f3-9fdf-f7c7a62dab41 tempest-VolumesActionsTest-1898958775 None] Copy volume to image completed successfully. Nov 02 12:31:32 devstack sudo[96527]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-504f330a-803b-4834-bf06-a615053455f4 tempest-ServersNegativeTestJSON-2121823119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-87255345-bbf7-463c-bc02-5e38522c3082 1073741824" returned: 0 in 0.440s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-504f330a-803b-4834-bf06-a615053455f4 tempest-ServersNegativeTestJSON-2121823119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-87255345-bbf7-463c-bc02-5e38522c3082 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:32 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-87255345-bbf7-463c-bc02-5e38522c3082 Nov 02 12:31:32 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:32 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-58ba0a67-ed56-471a-a67f-f4854e6581a5 tempest-SnapshotMetadataTestJSON-459806342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-58ba0a67-ed56-471a-a67f-f4854e6581a5 tempest-SnapshotMetadataTestJSON-459806342 None] Flow 'volume_create_manager' (6b46530d-f599-4fdc-94dd-4515da818041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-58ba0a67-ed56-471a-a67f-f4854e6581a5 tempest-SnapshotMetadataTestJSON-459806342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (159d002a-6325-4ab8-838f-8d1d9063f276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-58ba0a67-ed56-471a-a67f-f4854e6581a5 tempest-SnapshotMetadataTestJSON-459806342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (159d002a-6325-4ab8-838f-8d1d9063f276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-981498100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed7d57e-9390-419c-95b4-0cf15fe98d20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac130d7b02cc44fea30c05288ffbee90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:31:33Z,use_quota=True,user_id='83c3e4af787b43cbbc99d34657556700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-58ba0a67-ed56-471a-a67f-f4854e6581a5 tempest-SnapshotMetadataTestJSON-459806342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a8e880-6b75-4d15-91b5-643be9580ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-58ba0a67-ed56-471a-a67f-f4854e6581a5 tempest-SnapshotMetadataTestJSON-459806342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a8e880-6b75-4d15-91b5-643be9580ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-58ba0a67-ed56-471a-a67f-f4854e6581a5 tempest-SnapshotMetadataTestJSON-459806342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0e7ac4e-f207-420f-bc44-334cd5efbe64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-58ba0a67-ed56-471a-a67f-f4854e6581a5 tempest-SnapshotMetadataTestJSON-459806342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0e7ac4e-f207-420f-bc44-334cd5efbe64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ed7d57e-9390-419c-95b4-0cf15fe98d20', 'volume_name': 'volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-58ba0a67-ed56-471a-a67f-f4854e6581a5 tempest-SnapshotMetadataTestJSON-459806342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (312a43d7-efa7-4464-8833-e3e16529c6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:31:33 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-58ba0a67-ed56-471a-a67f-f4854e6581a5 tempest-SnapshotMetadataTestJSON-459806342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (312a43d7-efa7-4464-8833-e3e16529c6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-58ba0a67-ed56-471a-a67f-f4854e6581a5 tempest-SnapshotMetadataTestJSON-459806342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (664e7170-5095-41fe-9140-13726d1fc7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:31:33 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-58ba0a67-ed56-471a-a67f-f4854e6581a5 tempest-SnapshotMetadataTestJSON-459806342 None] Volume 0ed7d57e-9390-419c-95b4-0cf15fe98d20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20', 'volume_size': 1} Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-58ba0a67-ed56-471a-a67f-f4854e6581a5 tempest-SnapshotMetadataTestJSON-459806342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-504f330a-803b-4834-bf06-a615053455f4 tempest-ServersNegativeTestJSON-2121823119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-87255345-bbf7-463c-bc02-5e38522c3082" returned: 0 in 0.268s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-504f330a-803b-4834-bf06-a615053455f4 tempest-ServersNegativeTestJSON-2121823119 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-504f330a-803b-4834-bf06-a615053455f4 tempest-ServersNegativeTestJSON-2121823119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-58ba0a67-ed56-471a-a67f-f4854e6581a5 tempest-SnapshotMetadataTestJSON-459806342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-58ba0a67-ed56-471a-a67f-f4854e6581a5 tempest-SnapshotMetadataTestJSON-459806342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-981498100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed7d57e-9390-419c-95b4-0cf15fe98d20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac130d7b02cc44fea30c05288ffbee90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:31:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:31:33Z,use_quota=True,user_id='83c3e4af787b43cbbc99d34657556700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-58ba0a67-ed56-471a-a67f-f4854e6581a5 tempest-SnapshotMetadataTestJSON-459806342 None] Creating volume 0ed7d57e-9390-419c-95b4-0cf15fe98d20 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-58ba0a67-ed56-471a-a67f-f4854e6581a5 tempest-SnapshotMetadataTestJSON-459806342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-58ba0a67-ed56-471a-a67f-f4854e6581a5 tempest-SnapshotMetadataTestJSON-459806342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-58ba0a67-ed56-471a-a67f-f4854e6581a5 tempest-SnapshotMetadataTestJSON-459806342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-58ba0a67-ed56-471a-a67f-f4854e6581a5 tempest-SnapshotMetadataTestJSON-459806342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-58ba0a67-ed56-471a-a67f-f4854e6581a5 tempest-SnapshotMetadataTestJSON-459806342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-58ba0a67-ed56-471a-a67f-f4854e6581a5 tempest-SnapshotMetadataTestJSON-459806342 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:31:33 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-58ba0a67-ed56-471a-a67f-f4854e6581a5 tempest-SnapshotMetadataTestJSON-459806342 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-58ba0a67-ed56-471a-a67f-f4854e6581a5 tempest-SnapshotMetadataTestJSON-459806342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:33 devstack sudo[96536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20 1073741824 Nov 02 12:31:33 devstack sudo[96536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-504f330a-803b-4834-bf06-a615053455f4 tempest-ServersNegativeTestJSON-2121823119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5dc1d09-7bc1-4b9b-bcc1-c777917479a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87255345-bbf7-463c-bc02-5e38522c3082', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-504f330a-803b-4834-bf06-a615053455f4 tempest-ServersNegativeTestJSON-2121823119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd4e7d7-6d6b-4b3a-a50a-c51602c5a894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:31:33 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-504f330a-803b-4834-bf06-a615053455f4 tempest-ServersNegativeTestJSON-2121823119 None] Volume volume-87255345-bbf7-463c-bc02-5e38522c3082 (87255345-bbf7-463c-bc02-5e38522c3082): created successfully Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-504f330a-803b-4834-bf06-a615053455f4 tempest-ServersNegativeTestJSON-2121823119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bd4e7d7-6d6b-4b3a-a50a-c51602c5a894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-504f330a-803b-4834-bf06-a615053455f4 tempest-ServersNegativeTestJSON-2121823119 None] Flow 'volume_create_manager' (6c77009a-567b-4bb0-bde6-1100e95d4ab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:31:33 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-504f330a-803b-4834-bf06-a615053455f4 tempest-ServersNegativeTestJSON-2121823119 None] Created volume successfully. Nov 02 12:31:33 devstack sudo[96536]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-58ba0a67-ed56-471a-a67f-f4854e6581a5 tempest-SnapshotMetadataTestJSON-459806342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20 1073741824" returned: 0 in 0.461s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-58ba0a67-ed56-471a-a67f-f4854e6581a5 tempest-SnapshotMetadataTestJSON-459806342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:33 devstack sudo[96541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20 Nov 02 12:31:33 devstack sudo[96541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-1516eeaf-2a1a-4047-8ce3-b321e622a4fb tempest-VolumesActionsTest-1898958775 None] Acquiring lock "cinder-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-1516eeaf-2a1a-4047-8ce3-b321e622a4fb tempest-VolumesActionsTest-1898958775 None] Lock "cinder-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:31:33 devstack sudo[96541]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-58ba0a67-ed56-471a-a67f-f4854e6581a5 tempest-SnapshotMetadataTestJSON-459806342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20" returned: 0 in 0.289s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-58ba0a67-ed56-471a-a67f-f4854e6581a5 tempest-SnapshotMetadataTestJSON-459806342 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-58ba0a67-ed56-471a-a67f-f4854e6581a5 tempest-SnapshotMetadataTestJSON-459806342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-58ba0a67-ed56-471a-a67f-f4854e6581a5 tempest-SnapshotMetadataTestJSON-459806342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (664e7170-5095-41fe-9140-13726d1fc7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-58ba0a67-ed56-471a-a67f-f4854e6581a5 tempest-SnapshotMetadataTestJSON-459806342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c9ce341-13bb-4363-a0bc-2f817f50078d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-1516eeaf-2a1a-4047-8ce3-b321e622a4fb tempest-VolumesActionsTest-1898958775 None] Acquiring lock "cinder-quobyte-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:31:33 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-58ba0a67-ed56-471a-a67f-f4854e6581a5 tempest-SnapshotMetadataTestJSON-459806342 None] Volume volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20 (0ed7d57e-9390-419c-95b4-0cf15fe98d20): created successfully Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-58ba0a67-ed56-471a-a67f-f4854e6581a5 tempest-SnapshotMetadataTestJSON-459806342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c9ce341-13bb-4363-a0bc-2f817f50078d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-58ba0a67-ed56-471a-a67f-f4854e6581a5 tempest-SnapshotMetadataTestJSON-459806342 None] Flow 'volume_create_manager' (6b46530d-f599-4fdc-94dd-4515da818041) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-1516eeaf-2a1a-4047-8ce3-b321e622a4fb tempest-VolumesActionsTest-1898958775 None] Lock "cinder-quobyte-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9" acquired by "delete_volume" :: waited 0.034s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:31:33 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-58ba0a67-ed56-471a-a67f-f4854e6581a5 tempest-SnapshotMetadataTestJSON-459806342 None] Created volume successfully. Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d05c61f-ee7f-4b7a-bce2-9eef176aab70]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:31:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1516eeaf-2a1a-4047-8ce3-b321e622a4fb tempest-VolumesActionsTest-1898958775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:34 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9 Nov 02 12:31:34 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:34 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1516eeaf-2a1a-4047-8ce3-b321e622a4fb tempest-VolumesActionsTest-1898958775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9" returned: 0 in 0.394s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1516eeaf-2a1a-4047-8ce3-b321e622a4fb tempest-VolumesActionsTest-1898958775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:34 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9 Nov 02 12:31:34 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:34 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1516eeaf-2a1a-4047-8ce3-b321e622a4fb tempest-VolumesActionsTest-1898958775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9" returned: 0 in 0.266s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:34 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-1516eeaf-2a1a-4047-8ce3-b321e622a4fb tempest-VolumesActionsTest-1898958775 None] Lock "cinder-quobyte-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9" released by "delete_volume" :: held 0.704s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:31:34 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-1516eeaf-2a1a-4047-8ce3-b321e622a4fb tempest-VolumesActionsTest-1898958775 None] Created reservations ['b1273349-bb55-41b9-998f-9b5fdfcb4519', '1804992e-3f44-487c-8485-fea33a3648a3', '9aeb7b65-417e-43d7-a618-7fd4636ee66c', '58edce37-0376-417c-9a18-5a6f8605a66f'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:31:34 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3e97153a-f848-46a4-9d33-042db4258310 tempest-ServersNegativeTestJSON-2121823119 None] Acquiring lock "cinder-87255345-bbf7-463c-bc02-5e38522c3082-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:31:34 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3e97153a-f848-46a4-9d33-042db4258310 tempest-ServersNegativeTestJSON-2121823119 None] Lock "cinder-87255345-bbf7-463c-bc02-5e38522c3082-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:31:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1516eeaf-2a1a-4047-8ce3-b321e622a4fb tempest-VolumesActionsTest-1898958775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:31:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1516eeaf-2a1a-4047-8ce3-b321e622a4fb tempest-VolumesActionsTest-1898958775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:31:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-1516eeaf-2a1a-4047-8ce3-b321e622a4fb tempest-VolumesActionsTest-1898958775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:31:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-1516eeaf-2a1a-4047-8ce3-b321e622a4fb tempest-VolumesActionsTest-1898958775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:31:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1516eeaf-2a1a-4047-8ce3-b321e622a4fb tempest-VolumesActionsTest-1898958775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:31:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1516eeaf-2a1a-4047-8ce3-b321e622a4fb tempest-VolumesActionsTest-1898958775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:34 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:31:34 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:34 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3e97153a-f848-46a4-9d33-042db4258310 tempest-ServersNegativeTestJSON-2121823119 None] Acquiring lock "cinder-quobyte-87255345-bbf7-463c-bc02-5e38522c3082" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:31:34 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3e97153a-f848-46a4-9d33-042db4258310 tempest-ServersNegativeTestJSON-2121823119 None] Lock "cinder-quobyte-87255345-bbf7-463c-bc02-5e38522c3082" acquired by "delete_volume" :: waited 0.017s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:31:34 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[9285030c-c800-43fa-85c2-e963736ac89f]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:31:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3e97153a-f848-46a4-9d33-042db4258310 tempest-ServersNegativeTestJSON-2121823119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-87255345-bbf7-463c-bc02-5e38522c3082 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:35 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-87255345-bbf7-463c-bc02-5e38522c3082 Nov 02 12:31:35 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:35 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1516eeaf-2a1a-4047-8ce3-b321e622a4fb tempest-VolumesActionsTest-1898958775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.349s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:35 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-1516eeaf-2a1a-4047-8ce3-b321e622a4fb tempest-VolumesActionsTest-1898958775 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:31:35 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-1516eeaf-2a1a-4047-8ce3-b321e622a4fb tempest-VolumesActionsTest-1898958775 None] Deleted volume successfully. Nov 02 12:31:35 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-1516eeaf-2a1a-4047-8ce3-b321e622a4fb tempest-VolumesActionsTest-1898958775 None] Lock "cinder-06cbcaf4-5e6e-430c-8a92-5ed7d1b2e3b9-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:31:35 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-6b909e51-489d-4b35-b263-52e2f4e8756d tempest-SnapshotMetadataTestJSON-459806342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:31:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-6b909e51-489d-4b35-b263-52e2f4e8756d tempest-SnapshotMetadataTestJSON-459806342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:31:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3e97153a-f848-46a4-9d33-042db4258310 tempest-ServersNegativeTestJSON-2121823119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-87255345-bbf7-463c-bc02-5e38522c3082" returned: 0 in 0.474s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3e97153a-f848-46a4-9d33-042db4258310 tempest-ServersNegativeTestJSON-2121823119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-87255345-bbf7-463c-bc02-5e38522c3082 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:35 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-6b909e51-489d-4b35-b263-52e2f4e8756d tempest-SnapshotMetadataTestJSON-459806342 None] Creating offline snapshot 35a0146b-4dfd-4c0e-802e-518a35254d45 of volume 0ed7d57e-9390-419c-95b4-0cf15fe98d20 {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:31:35 devstack sudo[96562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-87255345-bbf7-463c-bc02-5e38522c3082 Nov 02 12:31:35 devstack sudo[96562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:35 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[190db57a-64ec-494e-9b68-e6c5d1689ece]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:31:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6b909e51-489d-4b35-b263-52e2f4e8756d tempest-SnapshotMetadataTestJSON-459806342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:35 devstack sudo[96564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20 Nov 02 12:31:35 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:35 devstack sudo[96562]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3e97153a-f848-46a4-9d33-042db4258310 tempest-ServersNegativeTestJSON-2121823119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-87255345-bbf7-463c-bc02-5e38522c3082" returned: 0 in 0.300s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:35 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3e97153a-f848-46a4-9d33-042db4258310 tempest-ServersNegativeTestJSON-2121823119 None] Lock "cinder-quobyte-87255345-bbf7-463c-bc02-5e38522c3082" released by "delete_volume" :: held 0.840s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:31:35 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-3e97153a-f848-46a4-9d33-042db4258310 tempest-ServersNegativeTestJSON-2121823119 None] Created reservations ['20e179a6-e677-458a-8aba-105c60fbf985', '6fe47582-f77c-4a70-bf05-c4b7f8e8fbe7', '8d022745-4790-4485-bda9-b34fb2b40127', 'b987047d-1ec1-4757-9685-b7595de2d217'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:31:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3e97153a-f848-46a4-9d33-042db4258310 tempest-ServersNegativeTestJSON-2121823119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:31:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3e97153a-f848-46a4-9d33-042db4258310 tempest-ServersNegativeTestJSON-2121823119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:31:35 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3e97153a-f848-46a4-9d33-042db4258310 tempest-ServersNegativeTestJSON-2121823119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:31:35 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3e97153a-f848-46a4-9d33-042db4258310 tempest-ServersNegativeTestJSON-2121823119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:31:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3e97153a-f848-46a4-9d33-042db4258310 tempest-ServersNegativeTestJSON-2121823119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:31:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3e97153a-f848-46a4-9d33-042db4258310 tempest-ServersNegativeTestJSON-2121823119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:35 devstack sudo[96570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:31:35 devstack sudo[96570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:35 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6b909e51-489d-4b35-b263-52e2f4e8756d tempest-SnapshotMetadataTestJSON-459806342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20" returned: 0 in 0.516s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6b909e51-489d-4b35-b263-52e2f4e8756d tempest-SnapshotMetadataTestJSON-459806342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20.35a0146b-4dfd-4c0e-802e-518a35254d45 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:36 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-cb3ba705-76c1-4089-9ecd-1e63ed27d7c5 tempest-ServersNegativeTestJSON-2121823119 None] Acquiring lock "cinder-92803f4c-be2e-41c2-959d-43d0f59386d3-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:31:36 devstack sudo[96572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20.35a0146b-4dfd-4c0e-802e-518a35254d45 1G Nov 02 12:31:36 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:36 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-cb3ba705-76c1-4089-9ecd-1e63ed27d7c5 tempest-ServersNegativeTestJSON-2121823119 None] Lock "cinder-92803f4c-be2e-41c2-959d-43d0f59386d3-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:31:36 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-cb3ba705-76c1-4089-9ecd-1e63ed27d7c5 tempest-ServersNegativeTestJSON-2121823119 None] Acquiring lock "cinder-quobyte-92803f4c-be2e-41c2-959d-43d0f59386d3" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:31:36 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-cb3ba705-76c1-4089-9ecd-1e63ed27d7c5 tempest-ServersNegativeTestJSON-2121823119 None] Lock "cinder-quobyte-92803f4c-be2e-41c2-959d-43d0f59386d3" acquired by "delete_volume" :: waited 0.026s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:31:36 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[757a0013-4fa4-4ec4-8898-e95f33ebc1c4]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:31:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cb3ba705-76c1-4089-9ecd-1e63ed27d7c5 tempest-ServersNegativeTestJSON-2121823119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-92803f4c-be2e-41c2-959d-43d0f59386d3 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:36 devstack sudo[96570]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3e97153a-f848-46a4-9d33-042db4258310 tempest-ServersNegativeTestJSON-2121823119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.316s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:36 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-3e97153a-f848-46a4-9d33-042db4258310 tempest-ServersNegativeTestJSON-2121823119 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:31:36 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-3e97153a-f848-46a4-9d33-042db4258310 tempest-ServersNegativeTestJSON-2121823119 None] Deleted volume successfully. Nov 02 12:31:36 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3e97153a-f848-46a4-9d33-042db4258310 tempest-ServersNegativeTestJSON-2121823119 None] Lock "cinder-87255345-bbf7-463c-bc02-5e38522c3082-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:31:36 devstack sudo[96575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-92803f4c-be2e-41c2-959d-43d0f59386d3 Nov 02 12:31:36 devstack sudo[96575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:36 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6b909e51-489d-4b35-b263-52e2f4e8756d tempest-SnapshotMetadataTestJSON-459806342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20.35a0146b-4dfd-4c0e-802e-518a35254d45 1G" returned: 0 in 0.530s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6b909e51-489d-4b35-b263-52e2f4e8756d tempest-SnapshotMetadataTestJSON-459806342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20.35a0146b-4dfd-4c0e-802e-518a35254d45 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:36 devstack sudo[96581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20.35a0146b-4dfd-4c0e-802e-518a35254d45 Nov 02 12:31:36 devstack sudo[96581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:36 devstack sudo[96575]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cb3ba705-76c1-4089-9ecd-1e63ed27d7c5 tempest-ServersNegativeTestJSON-2121823119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-92803f4c-be2e-41c2-959d-43d0f59386d3" returned: 0 in 0.445s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cb3ba705-76c1-4089-9ecd-1e63ed27d7c5 tempest-ServersNegativeTestJSON-2121823119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-92803f4c-be2e-41c2-959d-43d0f59386d3 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:36 devstack sudo[96586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-92803f4c-be2e-41c2-959d-43d0f59386d3 Nov 02 12:31:36 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:36 devstack sudo[96581]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6b909e51-489d-4b35-b263-52e2f4e8756d tempest-SnapshotMetadataTestJSON-459806342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20.35a0146b-4dfd-4c0e-802e-518a35254d45" returned: 0 in 0.366s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:36 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-6b909e51-489d-4b35-b263-52e2f4e8756d tempest-SnapshotMetadataTestJSON-459806342 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20.35a0146b-4dfd-4c0e-802e-518a35254d45 is being set with open permissions: ugo+rw Nov 02 12:31:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6b909e51-489d-4b35-b263-52e2f4e8756d tempest-SnapshotMetadataTestJSON-459806342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20.35a0146b-4dfd-4c0e-802e-518a35254d45 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:36 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20.35a0146b-4dfd-4c0e-802e-518a35254d45 Nov 02 12:31:36 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:36 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cb3ba705-76c1-4089-9ecd-1e63ed27d7c5 tempest-ServersNegativeTestJSON-2121823119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-92803f4c-be2e-41c2-959d-43d0f59386d3" returned: 0 in 0.301s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:36 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-cb3ba705-76c1-4089-9ecd-1e63ed27d7c5 tempest-ServersNegativeTestJSON-2121823119 None] Lock "cinder-quobyte-92803f4c-be2e-41c2-959d-43d0f59386d3" released by "delete_volume" :: held 0.810s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:31:37 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-cb3ba705-76c1-4089-9ecd-1e63ed27d7c5 tempest-ServersNegativeTestJSON-2121823119 None] Created reservations ['624ce31a-badc-4cf5-8861-c5b9a302533d', '08fec8ce-fd3b-4868-8bf0-bd1d1fad1494', '48dd7494-78c1-43bc-bfb1-6c5ccee00c58', 'ce73812f-2284-4188-8fa2-cca44e3fa1a6'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:31:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-cb3ba705-76c1-4089-9ecd-1e63ed27d7c5 tempest-ServersNegativeTestJSON-2121823119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:31:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-cb3ba705-76c1-4089-9ecd-1e63ed27d7c5 tempest-ServersNegativeTestJSON-2121823119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:31:37 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-cb3ba705-76c1-4089-9ecd-1e63ed27d7c5 tempest-ServersNegativeTestJSON-2121823119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:31:37 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-cb3ba705-76c1-4089-9ecd-1e63ed27d7c5 tempest-ServersNegativeTestJSON-2121823119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:31:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-cb3ba705-76c1-4089-9ecd-1e63ed27d7c5 tempest-ServersNegativeTestJSON-2121823119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:31:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cb3ba705-76c1-4089-9ecd-1e63ed27d7c5 tempest-ServersNegativeTestJSON-2121823119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:37 devstack sudo[96605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:31:37 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:37 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6b909e51-489d-4b35-b263-52e2f4e8756d tempest-SnapshotMetadataTestJSON-459806342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20.35a0146b-4dfd-4c0e-802e-518a35254d45" returned: 0 in 0.281s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6b909e51-489d-4b35-b263-52e2f4e8756d tempest-SnapshotMetadataTestJSON-459806342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:37 devstack sudo[96633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20.info Nov 02 12:31:37 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:37 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cb3ba705-76c1-4089-9ecd-1e63ed27d7c5 tempest-ServersNegativeTestJSON-2121823119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.397s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:37 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-cb3ba705-76c1-4089-9ecd-1e63ed27d7c5 tempest-ServersNegativeTestJSON-2121823119 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:31:37 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-cb3ba705-76c1-4089-9ecd-1e63ed27d7c5 tempest-ServersNegativeTestJSON-2121823119 None] Deleted volume successfully. Nov 02 12:31:37 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-cb3ba705-76c1-4089-9ecd-1e63ed27d7c5 tempest-ServersNegativeTestJSON-2121823119 None] Lock "cinder-92803f4c-be2e-41c2-959d-43d0f59386d3-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:31:37 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6b909e51-489d-4b35-b263-52e2f4e8756d tempest-SnapshotMetadataTestJSON-459806342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20.info" returned: 0 in 0.327s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:37 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-6b909e51-489d-4b35-b263-52e2f4e8756d tempest-SnapshotMetadataTestJSON-459806342 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20.info is being set with open permissions: ugo+rw Nov 02 12:31:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6b909e51-489d-4b35-b263-52e2f4e8756d tempest-SnapshotMetadataTestJSON-459806342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:37 devstack sudo[96637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20.info Nov 02 12:31:37 devstack sudo[96637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:37 devstack sudo[96637]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6b909e51-489d-4b35-b263-52e2f4e8756d tempest-SnapshotMetadataTestJSON-459806342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20.info" returned: 0 in 0.369s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-6b909e51-489d-4b35-b263-52e2f4e8756d tempest-SnapshotMetadataTestJSON-459806342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.533s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:31:37 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-6b909e51-489d-4b35-b263-52e2f4e8756d tempest-SnapshotMetadataTestJSON-459806342 None] Create snapshot completed successfully Nov 02 12:31:39 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ef93b2a1-ee01-4de4-b061-323edd32997e tempest-SnapshotMetadataTestJSON-459806342 None] Acquiring lock "cinder-35a0146b-4dfd-4c0e-802e-518a35254d45-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:31:39 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ef93b2a1-ee01-4de4-b061-323edd32997e tempest-SnapshotMetadataTestJSON-459806342 None] Lock "cinder-35a0146b-4dfd-4c0e-802e-518a35254d45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:31:39 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ef93b2a1-ee01-4de4-b061-323edd32997e tempest-SnapshotMetadataTestJSON-459806342 None] Acquiring lock "cinder-quobyte-0ed7d57e-9390-419c-95b4-0cf15fe98d20" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:31:39 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ef93b2a1-ee01-4de4-b061-323edd32997e tempest-SnapshotMetadataTestJSON-459806342 None] Lock "cinder-quobyte-0ed7d57e-9390-419c-95b4-0cf15fe98d20" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:31:39 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ef93b2a1-ee01-4de4-b061-323edd32997e tempest-SnapshotMetadataTestJSON-459806342 None] Acquiring lock "cinder-quobyte-35a0146b-4dfd-4c0e-802e-518a35254d45" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:31:39 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ef93b2a1-ee01-4de4-b061-323edd32997e tempest-SnapshotMetadataTestJSON-459806342 None] Lock "cinder-quobyte-35a0146b-4dfd-4c0e-802e-518a35254d45" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:31:39 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-ef93b2a1-ee01-4de4-b061-323edd32997e tempest-SnapshotMetadataTestJSON-459806342 None] Deleting offline snapshot 35a0146b-4dfd-4c0e-802e-518a35254d45 of volume 0ed7d57e-9390-419c-95b4-0cf15fe98d20 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:31:39 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-ef93b2a1-ee01-4de4-b061-323edd32997e tempest-SnapshotMetadataTestJSON-459806342 None] snapshot_file for this snap is: volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20.35a0146b-4dfd-4c0e-802e-518a35254d45 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:31:39 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e4e18e-e46a-4e2e-92d1-840f186233af]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:31:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ef93b2a1-ee01-4de4-b061-323edd32997e tempest-SnapshotMetadataTestJSON-459806342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20.35a0146b-4dfd-4c0e-802e-518a35254d45 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:39 devstack sudo[96667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20.35a0146b-4dfd-4c0e-802e-518a35254d45 Nov 02 12:31:39 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:40 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ef93b2a1-ee01-4de4-b061-323edd32997e tempest-SnapshotMetadataTestJSON-459806342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20.35a0146b-4dfd-4c0e-802e-518a35254d45" returned: 0 in 0.432s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:40 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-ef93b2a1-ee01-4de4-b061-323edd32997e tempest-SnapshotMetadataTestJSON-459806342 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:31:40 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ffe58e-3231-4733-af81-5957cd36312e]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:31:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ef93b2a1-ee01-4de4-b061-323edd32997e tempest-SnapshotMetadataTestJSON-459806342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:40 devstack sudo[96672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20 Nov 02 12:31:40 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:40 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ef93b2a1-ee01-4de4-b061-323edd32997e tempest-SnapshotMetadataTestJSON-459806342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20" returned: 0 in 0.452s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ef93b2a1-ee01-4de4-b061-323edd32997e tempest-SnapshotMetadataTestJSON-459806342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20.35a0146b-4dfd-4c0e-802e-518a35254d45 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:40 devstack sudo[96678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20.35a0146b-4dfd-4c0e-802e-518a35254d45 Nov 02 12:31:40 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:40 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ef93b2a1-ee01-4de4-b061-323edd32997e tempest-SnapshotMetadataTestJSON-459806342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20.35a0146b-4dfd-4c0e-802e-518a35254d45" returned: 0 in 0.422s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ef93b2a1-ee01-4de4-b061-323edd32997e tempest-SnapshotMetadataTestJSON-459806342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20.35a0146b-4dfd-4c0e-802e-518a35254d45 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:41 devstack sudo[96684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20.35a0146b-4dfd-4c0e-802e-518a35254d45 Nov 02 12:31:41 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:41 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ef93b2a1-ee01-4de4-b061-323edd32997e tempest-SnapshotMetadataTestJSON-459806342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20.35a0146b-4dfd-4c0e-802e-518a35254d45" returned: 0 in 0.311s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:41 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ef93b2a1-ee01-4de4-b061-323edd32997e tempest-SnapshotMetadataTestJSON-459806342 None] Lock "cinder-quobyte-35a0146b-4dfd-4c0e-802e-518a35254d45" released by "_delete_snapshot" :: held 1.766s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:31:41 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ef93b2a1-ee01-4de4-b061-323edd32997e tempest-SnapshotMetadataTestJSON-459806342 None] Lock "cinder-quobyte-0ed7d57e-9390-419c-95b4-0cf15fe98d20" released by "delete_snapshot" :: held 1.795s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:31:41 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-ef93b2a1-ee01-4de4-b061-323edd32997e tempest-SnapshotMetadataTestJSON-459806342 None] Created reservations ['cc49e623-d94a-423c-b911-f82e72f39d99', '740e7788-44a7-4807-8ec0-0879424b927e', '304f7ff0-bfd7-4486-9bfd-bcbe6ab9e57b', '0146014b-21bc-4eb7-84dc-7e8b2c39f746'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:31:41 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-ef93b2a1-ee01-4de4-b061-323edd32997e tempest-SnapshotMetadataTestJSON-459806342 None] Delete snapshot completed successfully. Nov 02 12:31:41 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ef93b2a1-ee01-4de4-b061-323edd32997e tempest-SnapshotMetadataTestJSON-459806342 None] Lock "cinder-35a0146b-4dfd-4c0e-802e-518a35254d45-delete_snapshot" released by "delete_snapshot" :: held 2.031s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:31:41 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-2390ddc9-fc61-4a7e-8e36-50388e4cfd7f tempest-SnapshotMetadataTestJSON-459806342 None] Acquiring lock "cinder-0ed7d57e-9390-419c-95b4-0cf15fe98d20-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:31:41 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-2390ddc9-fc61-4a7e-8e36-50388e4cfd7f tempest-SnapshotMetadataTestJSON-459806342 None] Lock "cinder-0ed7d57e-9390-419c-95b4-0cf15fe98d20-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:31:41 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-2390ddc9-fc61-4a7e-8e36-50388e4cfd7f tempest-SnapshotMetadataTestJSON-459806342 None] Acquiring lock "cinder-quobyte-0ed7d57e-9390-419c-95b4-0cf15fe98d20" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:31:41 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-2390ddc9-fc61-4a7e-8e36-50388e4cfd7f tempest-SnapshotMetadataTestJSON-459806342 None] Lock "cinder-quobyte-0ed7d57e-9390-419c-95b4-0cf15fe98d20" acquired by "delete_volume" :: waited 0.021s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:31:41 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a098745-d90b-41e6-9543-b4d83680110c]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:31:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2390ddc9-fc61-4a7e-8e36-50388e4cfd7f tempest-SnapshotMetadataTestJSON-459806342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:42 devstack sudo[96687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20 Nov 02 12:31:42 devstack sudo[96687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:42 devstack sudo[96687]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2390ddc9-fc61-4a7e-8e36-50388e4cfd7f tempest-SnapshotMetadataTestJSON-459806342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20" returned: 0 in 0.469s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2390ddc9-fc61-4a7e-8e36-50388e4cfd7f tempest-SnapshotMetadataTestJSON-459806342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:42 devstack sudo[96694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20 Nov 02 12:31:42 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:42 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2390ddc9-fc61-4a7e-8e36-50388e4cfd7f tempest-SnapshotMetadataTestJSON-459806342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ed7d57e-9390-419c-95b4-0cf15fe98d20" returned: 0 in 0.270s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:42 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-2390ddc9-fc61-4a7e-8e36-50388e4cfd7f tempest-SnapshotMetadataTestJSON-459806342 None] Lock "cinder-quobyte-0ed7d57e-9390-419c-95b4-0cf15fe98d20" released by "delete_volume" :: held 0.826s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:31:42 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-2390ddc9-fc61-4a7e-8e36-50388e4cfd7f tempest-SnapshotMetadataTestJSON-459806342 None] Created reservations ['93e8ad95-8a37-446d-9118-947dd989a1c7', 'ab528aae-e4d5-48a5-b354-4efa8d08ef54', 'c1f8e25c-5852-4ecc-8ca7-0e6226a0f06c', '5a8bd4d5-ae7f-4a61-af4a-99bab8de41d1'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:31:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2390ddc9-fc61-4a7e-8e36-50388e4cfd7f tempest-SnapshotMetadataTestJSON-459806342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:31:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2390ddc9-fc61-4a7e-8e36-50388e4cfd7f tempest-SnapshotMetadataTestJSON-459806342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:31:42 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-2390ddc9-fc61-4a7e-8e36-50388e4cfd7f tempest-SnapshotMetadataTestJSON-459806342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:31:42 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-2390ddc9-fc61-4a7e-8e36-50388e4cfd7f tempest-SnapshotMetadataTestJSON-459806342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:31:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2390ddc9-fc61-4a7e-8e36-50388e4cfd7f tempest-SnapshotMetadataTestJSON-459806342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:31:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2390ddc9-fc61-4a7e-8e36-50388e4cfd7f tempest-SnapshotMetadataTestJSON-459806342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:42 devstack sudo[96698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:31:42 devstack sudo[96698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:43 devstack sudo[96698]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2390ddc9-fc61-4a7e-8e36-50388e4cfd7f tempest-SnapshotMetadataTestJSON-459806342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.356s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:43 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-2390ddc9-fc61-4a7e-8e36-50388e4cfd7f tempest-SnapshotMetadataTestJSON-459806342 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:31:43 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-2390ddc9-fc61-4a7e-8e36-50388e4cfd7f tempest-SnapshotMetadataTestJSON-459806342 None] Deleted volume successfully. Nov 02 12:31:43 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-2390ddc9-fc61-4a7e-8e36-50388e4cfd7f tempest-SnapshotMetadataTestJSON-459806342 None] Lock "cinder-0ed7d57e-9390-419c-95b4-0cf15fe98d20-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:31:43 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:31:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:31:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:31:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:31:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:31:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:31:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:43 devstack sudo[96701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:31:43 devstack sudo[96701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:44 devstack sudo[96701]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.369s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:44 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:31:44 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager._thread_info {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:31:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread count: 28 {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:31:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread info: [<_MainThread(MainThread, started 129944084402304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:31:44 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0fdab38-8107-4b7d-8038-8ad7e07b3df1 tempest-VolumesCloneTest-1295698415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:31:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f0fdab38-8107-4b7d-8038-8ad7e07b3df1 tempest-VolumesCloneTest-1295698415 None] Flow 'volume_create_manager' (8e3f5923-3150-4bcd-9ad6-ddc2750cd2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:31:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f0fdab38-8107-4b7d-8038-8ad7e07b3df1 tempest-VolumesCloneTest-1295698415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (645fcb89-ba12-48c4-b5a3-a2cab502c343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:31:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f0fdab38-8107-4b7d-8038-8ad7e07b3df1 tempest-VolumesCloneTest-1295698415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (645fcb89-ba12-48c4-b5a3-a2cab502c343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-736223301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7d1c7d2-5970-4801-af78-539911766a6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='926e1c65d4214d06ae6872870e39808a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:31:44Z,use_quota=True,user_id='075a65fbac6443ffa359aa47ccaae280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:31:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f0fdab38-8107-4b7d-8038-8ad7e07b3df1 tempest-VolumesCloneTest-1295698415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f236a24b-49a6-4dab-aa9b-c256967d2ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:31:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f0fdab38-8107-4b7d-8038-8ad7e07b3df1 tempest-VolumesCloneTest-1295698415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f236a24b-49a6-4dab-aa9b-c256967d2ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:31:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f0fdab38-8107-4b7d-8038-8ad7e07b3df1 tempest-VolumesCloneTest-1295698415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (238ccc13-d61e-4bac-b3a1-058f8a19525c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:31:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f0fdab38-8107-4b7d-8038-8ad7e07b3df1 tempest-VolumesCloneTest-1295698415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (238ccc13-d61e-4bac-b3a1-058f8a19525c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7d1c7d2-5970-4801-af78-539911766a6c', 'volume_name': 'volume-d7d1c7d2-5970-4801-af78-539911766a6c', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:31:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f0fdab38-8107-4b7d-8038-8ad7e07b3df1 tempest-VolumesCloneTest-1295698415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e714ca88-f9e0-4c92-b554-8e58a027a544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:31:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f0fdab38-8107-4b7d-8038-8ad7e07b3df1 tempest-VolumesCloneTest-1295698415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e714ca88-f9e0-4c92-b554-8e58a027a544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:31:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f0fdab38-8107-4b7d-8038-8ad7e07b3df1 tempest-VolumesCloneTest-1295698415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d63a97da-f138-4ec9-96d8-6c5faf996714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:31:44 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-f0fdab38-8107-4b7d-8038-8ad7e07b3df1 tempest-VolumesCloneTest-1295698415 None] Volume d7d1c7d2-5970-4801-af78-539911766a6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7d1c7d2-5970-4801-af78-539911766a6c', 'volume_size': 1} Nov 02 12:31:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f0fdab38-8107-4b7d-8038-8ad7e07b3df1 tempest-VolumesCloneTest-1295698415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:31:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f0fdab38-8107-4b7d-8038-8ad7e07b3df1 tempest-VolumesCloneTest-1295698415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:31:44 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f0fdab38-8107-4b7d-8038-8ad7e07b3df1 tempest-VolumesCloneTest-1295698415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-736223301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7d1c7d2-5970-4801-af78-539911766a6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='926e1c65d4214d06ae6872870e39808a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:31:44Z,use_quota=True,user_id='075a65fbac6443ffa359aa47ccaae280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:31:44 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-f0fdab38-8107-4b7d-8038-8ad7e07b3df1 tempest-VolumesCloneTest-1295698415 None] Creating volume d7d1c7d2-5970-4801-af78-539911766a6c {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:31:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f0fdab38-8107-4b7d-8038-8ad7e07b3df1 tempest-VolumesCloneTest-1295698415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:31:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f0fdab38-8107-4b7d-8038-8ad7e07b3df1 tempest-VolumesCloneTest-1295698415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:31:44 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f0fdab38-8107-4b7d-8038-8ad7e07b3df1 tempest-VolumesCloneTest-1295698415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:31:44 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f0fdab38-8107-4b7d-8038-8ad7e07b3df1 tempest-VolumesCloneTest-1295698415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:31:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f0fdab38-8107-4b7d-8038-8ad7e07b3df1 tempest-VolumesCloneTest-1295698415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:31:44 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f0fdab38-8107-4b7d-8038-8ad7e07b3df1 tempest-VolumesCloneTest-1295698415 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:31:44 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-f0fdab38-8107-4b7d-8038-8ad7e07b3df1 tempest-VolumesCloneTest-1295698415 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:31:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f0fdab38-8107-4b7d-8038-8ad7e07b3df1 tempest-VolumesCloneTest-1295698415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:44 devstack sudo[96705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c 1073741824 Nov 02 12:31:44 devstack sudo[96705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:45 devstack sudo[96705]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f0fdab38-8107-4b7d-8038-8ad7e07b3df1 tempest-VolumesCloneTest-1295698415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c 1073741824" returned: 0 in 0.510s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f0fdab38-8107-4b7d-8038-8ad7e07b3df1 tempest-VolumesCloneTest-1295698415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:45 devstack sudo[96713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c Nov 02 12:31:45 devstack sudo[96713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:45 devstack sudo[96713]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f0fdab38-8107-4b7d-8038-8ad7e07b3df1 tempest-VolumesCloneTest-1295698415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c" returned: 0 in 0.359s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:45 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f0fdab38-8107-4b7d-8038-8ad7e07b3df1 tempest-VolumesCloneTest-1295698415 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:31:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f0fdab38-8107-4b7d-8038-8ad7e07b3df1 tempest-VolumesCloneTest-1295698415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:31:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f0fdab38-8107-4b7d-8038-8ad7e07b3df1 tempest-VolumesCloneTest-1295698415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d63a97da-f138-4ec9-96d8-6c5faf996714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7d1c7d2-5970-4801-af78-539911766a6c', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:31:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f0fdab38-8107-4b7d-8038-8ad7e07b3df1 tempest-VolumesCloneTest-1295698415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14f5f4d6-008f-4fb5-90f6-6f95e0950af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:31:45 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-f0fdab38-8107-4b7d-8038-8ad7e07b3df1 tempest-VolumesCloneTest-1295698415 None] Volume volume-d7d1c7d2-5970-4801-af78-539911766a6c (d7d1c7d2-5970-4801-af78-539911766a6c): created successfully Nov 02 12:31:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f0fdab38-8107-4b7d-8038-8ad7e07b3df1 tempest-VolumesCloneTest-1295698415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14f5f4d6-008f-4fb5-90f6-6f95e0950af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:31:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f0fdab38-8107-4b7d-8038-8ad7e07b3df1 tempest-VolumesCloneTest-1295698415 None] Flow 'volume_create_manager' (8e3f5923-3150-4bcd-9ad6-ddc2750cd2b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:31:45 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-f0fdab38-8107-4b7d-8038-8ad7e07b3df1 tempest-VolumesCloneTest-1295698415 None] Created volume successfully. Nov 02 12:31:47 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:31:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Flow 'volume_create_manager' (3aef12c8-5061-435b-84a5-b8fc563d09ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:31:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05c9aafc-191a-4582-a30c-5b226d0208e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:31:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05c9aafc-191a-4582-a30c-5b226d0208e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:31:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1401953318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=646e813c-667b-42c8-a7f9-797aacb2af57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='926e1c65d4214d06ae6872870e39808a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:31:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=d7d1c7d2-5970-4801-af78-539911766a6c,status='creating',terminated_at=None,updated_at=2026-11-02T11:31:47Z,use_quota=True,user_id='075a65fbac6443ffa359aa47ccaae280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:31:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75bd2877-d469-4b80-baf9-6741380e679a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:31:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75bd2877-d469-4b80-baf9-6741380e679a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:31:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (197dae7d-2a97-446e-9cba-2d97ca03aa71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:31:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (197dae7d-2a97-446e-9cba-2d97ca03aa71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '646e813c-667b-42c8-a7f9-797aacb2af57', 'volume_name': 'volume-646e813c-667b-42c8-a7f9-797aacb2af57', 'volume_size': 2, 'source_volid': 'd7d1c7d2-5970-4801-af78-539911766a6c', 'source_volstatus': 'available'}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:31:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (247d299e-2055-4eda-b445-4cb240182b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:31:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (247d299e-2055-4eda-b445-4cb240182b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:31:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51e78237-f10b-4a59-b4cc-d175d7c75080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:31:47 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Volume 646e813c-667b-42c8-a7f9-797aacb2af57: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-646e813c-667b-42c8-a7f9-797aacb2af57', 'volume_size': 2, 'source_volid': 'd7d1c7d2-5970-4801-af78-539911766a6c', 'source_volstatus': 'available'} Nov 02 12:31:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:31:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:31:47 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Cloning volume d7d1c7d2-5970-4801-af78-539911766a6c to volume 646e813c-667b-42c8-a7f9-797aacb2af57 Nov 02 12:31:47 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Creating offline snapshot 276203f1-e2cb-421a-9e34-4004f2d758dd of volume d7d1c7d2-5970-4801-af78-539911766a6c {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:31:47 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[72289e88-3dd5-4ac0-965e-799208f5762d]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:31:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:47 devstack sudo[96725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c Nov 02 12:31:47 devstack sudo[96725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:47 devstack sudo[96725]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c" returned: 0 in 0.421s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c.276203f1-e2cb-421a-9e34-4004f2d758dd 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:47 devstack sudo[96730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c.276203f1-e2cb-421a-9e34-4004f2d758dd 1G Nov 02 12:31:47 devstack sudo[96730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:48 devstack sudo[96730]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c.276203f1-e2cb-421a-9e34-4004f2d758dd 1G" returned: 0 in 0.572s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7d1c7d2-5970-4801-af78-539911766a6c -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c.276203f1-e2cb-421a-9e34-4004f2d758dd {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:48 devstack sudo[96735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7d1c7d2-5970-4801-af78-539911766a6c -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c.276203f1-e2cb-421a-9e34-4004f2d758dd Nov 02 12:31:48 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:48 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7d1c7d2-5970-4801-af78-539911766a6c -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c.276203f1-e2cb-421a-9e34-4004f2d758dd" returned: 0 in 0.398s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:48 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c.276203f1-e2cb-421a-9e34-4004f2d758dd is being set with open permissions: ugo+rw Nov 02 12:31:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c.276203f1-e2cb-421a-9e34-4004f2d758dd {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:48 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c.276203f1-e2cb-421a-9e34-4004f2d758dd Nov 02 12:31:48 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:49 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c.276203f1-e2cb-421a-9e34-4004f2d758dd" returned: 0 in 0.287s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:49 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c.info Nov 02 12:31:49 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:49 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c.info" returned: 0 in 0.357s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:49 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c.info is being set with open permissions: ugo+rw Nov 02 12:31:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:49 devstack sudo[96747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c.info Nov 02 12:31:49 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:49 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c.info" returned: 0 in 0.269s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:49 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Acquiring lock "cinder-quobyte-646e813c-667b-42c8-a7f9-797aacb2af57" by "_copy_volume_from_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:31:49 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Lock "cinder-quobyte-646e813c-667b-42c8-a7f9-797aacb2af57" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:31:49 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] snapshot: 276203f1-e2cb-421a-9e34-4004f2d758dd, volume: 646e813c-667b-42c8-a7f9-797aacb2af57, {{(pid=86515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 12:31:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:31:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:31:49 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:31:49 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:31:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:31:49 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-18c5f385-918b-4a55-9909-d7a575fcf41c tempest-VolumesTransfersTest-1939202769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:31:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-18c5f385-918b-4a55-9909-d7a575fcf41c tempest-VolumesTransfersTest-1939202769 None] Flow 'volume_create_manager' (aed0f2f0-cdef-418e-ae6e-2ee70fd706d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:31:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-18c5f385-918b-4a55-9909-d7a575fcf41c tempest-VolumesTransfersTest-1939202769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91d92d09-4faa-478a-9775-3353cec6616b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:31:49 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1eccec0-75d0-428e-aabf-644e5144279f]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:31:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c.276203f1-e2cb-421a-9e34-4004f2d758dd {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-18c5f385-918b-4a55-9909-d7a575fcf41c tempest-VolumesTransfersTest-1939202769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91d92d09-4faa-478a-9775-3353cec6616b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1969871714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5840bf0-44cb-41c7-a189-4e88be0a1c94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7619124435234b0ead89faaac5020661',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:31:50Z,use_quota=True,user_id='389f1007eb534f198117582e79b6a1a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:31:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-18c5f385-918b-4a55-9909-d7a575fcf41c tempest-VolumesTransfersTest-1939202769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42f198cd-2f44-47bb-92b5-9a8f7787e72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:31:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-18c5f385-918b-4a55-9909-d7a575fcf41c tempest-VolumesTransfersTest-1939202769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42f198cd-2f44-47bb-92b5-9a8f7787e72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:31:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-18c5f385-918b-4a55-9909-d7a575fcf41c tempest-VolumesTransfersTest-1939202769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a399e2-e5c9-4651-b99c-308a17a9a22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:31:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-18c5f385-918b-4a55-9909-d7a575fcf41c tempest-VolumesTransfersTest-1939202769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a399e2-e5c9-4651-b99c-308a17a9a22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5840bf0-44cb-41c7-a189-4e88be0a1c94', 'volume_name': 'volume-b5840bf0-44cb-41c7-a189-4e88be0a1c94', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:31:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-18c5f385-918b-4a55-9909-d7a575fcf41c tempest-VolumesTransfersTest-1939202769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b3e3b6c-f791-4e9f-8b39-900f2e9b3c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:31:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-18c5f385-918b-4a55-9909-d7a575fcf41c tempest-VolumesTransfersTest-1939202769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b3e3b6c-f791-4e9f-8b39-900f2e9b3c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:31:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-18c5f385-918b-4a55-9909-d7a575fcf41c tempest-VolumesTransfersTest-1939202769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab3a1238-7500-4d89-9d49-46ff1c6bdb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:31:49 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-18c5f385-918b-4a55-9909-d7a575fcf41c tempest-VolumesTransfersTest-1939202769 None] Volume b5840bf0-44cb-41c7-a189-4e88be0a1c94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5840bf0-44cb-41c7-a189-4e88be0a1c94', 'volume_size': 1} Nov 02 12:31:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-18c5f385-918b-4a55-9909-d7a575fcf41c tempest-VolumesTransfersTest-1939202769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:31:49 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c.276203f1-e2cb-421a-9e34-4004f2d758dd Nov 02 12:31:49 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:50 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c.276203f1-e2cb-421a-9e34-4004f2d758dd" returned: 0 in 0.449s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:50 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7d1c7d2-5970-4801-af78-539911766a6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:31:50 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b98f993-899a-41be-83da-eb1da20891c0]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:31:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:50 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c Nov 02 12:31:50 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:50 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c" returned: 0 in 0.421s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:50 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] will copy from snapshot at /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c {{(pid=86515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 12:31:50 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Creating direct copy from snapshot {{(pid=86515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 12:31:50 devstack cinder-volume[86515]: DEBUG cinder.utils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Path /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-646e813c-667b-42c8-a7f9-797aacb2af57 not found in is_blk_device check {{(pid=86515) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 12:31:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-646e813c-667b-42c8-a7f9-797aacb2af57 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:50 devstack sudo[96767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-646e813c-667b-42c8-a7f9-797aacb2af57 Nov 02 12:31:50 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:57 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-646e813c-667b-42c8-a7f9-797aacb2af57" returned: 0 in 7.127s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:57 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Image conversion details: src /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c, size 1024.00 MB, duration 7.13 sec, destination /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-646e813c-667b-42c8-a7f9-797aacb2af57 {{(pid=86515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 12:31:57 devstack cinder-volume[86515]: INFO cinder.image.image_utils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Converted 1024.00 MB image at 143.66 MB/s Nov 02 12:31:57 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-646e813c-667b-42c8-a7f9-797aacb2af57 is being set with open permissions: ugo+rw Nov 02 12:31:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-646e813c-667b-42c8-a7f9-797aacb2af57 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:57 devstack sudo[96780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-646e813c-667b-42c8-a7f9-797aacb2af57 Nov 02 12:31:57 devstack sudo[96780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:58 devstack sudo[96780]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-646e813c-667b-42c8-a7f9-797aacb2af57" returned: 0 in 0.272s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:58 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Lock "cinder-quobyte-646e813c-667b-42c8-a7f9-797aacb2af57" released by "_copy_volume_from_snapshot" :: held 8.389s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:31:58 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Acquiring lock "cinder-quobyte-276203f1-e2cb-421a-9e34-4004f2d758dd" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:31:58 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Lock "cinder-quobyte-276203f1-e2cb-421a-9e34-4004f2d758dd" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:31:58 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Deleting offline snapshot 276203f1-e2cb-421a-9e34-4004f2d758dd of volume d7d1c7d2-5970-4801-af78-539911766a6c {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:31:58 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] snapshot_file for this snap is: volume-d7d1c7d2-5970-4801-af78-539911766a6c.276203f1-e2cb-421a-9e34-4004f2d758dd {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:31:58 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fe123a-7736-4c9d-8ddf-d3a72339eefa]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:31:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c.276203f1-e2cb-421a-9e34-4004f2d758dd {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:58 devstack sudo[96783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c.276203f1-e2cb-421a-9e34-4004f2d758dd Nov 02 12:31:58 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:58 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c.276203f1-e2cb-421a-9e34-4004f2d758dd" returned: 0 in 0.466s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:58 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7d1c7d2-5970-4801-af78-539911766a6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:31:58 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[1813fb58-21e3-4180-96de-7e5c641db2eb]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:31:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:58 devstack sudo[96788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c Nov 02 12:31:58 devstack sudo[96788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:59 devstack sudo[96788]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c" returned: 0 in 0.580s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c.276203f1-e2cb-421a-9e34-4004f2d758dd {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:59 devstack sudo[96793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c.276203f1-e2cb-421a-9e34-4004f2d758dd Nov 02 12:31:59 devstack sudo[96793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:59 devstack sudo[96793]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c.276203f1-e2cb-421a-9e34-4004f2d758dd" returned: 0 in 0.362s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c.276203f1-e2cb-421a-9e34-4004f2d758dd {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:31:59 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c.276203f1-e2cb-421a-9e34-4004f2d758dd Nov 02 12:31:59 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:31:59 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=56,cinder:UPDATE=73,cinder:INSERT=23,cinder:DELETE=6 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:31:59 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Nov 02 12:31:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c.276203f1-e2cb-421a-9e34-4004f2d758dd" returned: 0 in 0.260s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:31:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Lock "cinder-quobyte-276203f1-e2cb-421a-9e34-4004f2d758dd" released by "_delete_snapshot" :: held 1.803s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:32:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.727s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-18c5f385-918b-4a55-9909-d7a575fcf41c tempest-VolumesTransfersTest-1939202769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.100s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:00 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-18c5f385-918b-4a55-9909-d7a575fcf41c tempest-VolumesTransfersTest-1939202769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1969871714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5840bf0-44cb-41c7-a189-4e88be0a1c94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7619124435234b0ead89faaac5020661',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:31:50Z,use_quota=True,user_id='389f1007eb534f198117582e79b6a1a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:32:00 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-18c5f385-918b-4a55-9909-d7a575fcf41c tempest-VolumesTransfersTest-1939202769 None] Creating volume b5840bf0-44cb-41c7-a189-4e88be0a1c94 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:32:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-18c5f385-918b-4a55-9909-d7a575fcf41c tempest-VolumesTransfersTest-1939202769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-18c5f385-918b-4a55-9909-d7a575fcf41c tempest-VolumesTransfersTest-1939202769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:00 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-18c5f385-918b-4a55-9909-d7a575fcf41c tempest-VolumesTransfersTest-1939202769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:32:00 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-18c5f385-918b-4a55-9909-d7a575fcf41c tempest-VolumesTransfersTest-1939202769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:32:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-18c5f385-918b-4a55-9909-d7a575fcf41c tempest-VolumesTransfersTest-1939202769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:00 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-18c5f385-918b-4a55-9909-d7a575fcf41c tempest-VolumesTransfersTest-1939202769 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:32:00 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-18c5f385-918b-4a55-9909-d7a575fcf41c tempest-VolumesTransfersTest-1939202769 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:32:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-18c5f385-918b-4a55-9909-d7a575fcf41c tempest-VolumesTransfersTest-1939202769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-b5840bf0-44cb-41c7-a189-4e88be0a1c94 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:00 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51e78237-f10b-4a59-b4cc-d175d7c75080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-646e813c-667b-42c8-a7f9-797aacb2af57', 'volume_size': 2, 'source_volid': 'd7d1c7d2-5970-4801-af78-539911766a6c', 'source_volstatus': 'available'}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:00 devstack sudo[96801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-b5840bf0-44cb-41c7-a189-4e88be0a1c94 1073741824 Nov 02 12:32:00 devstack sudo[96801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:00 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (595f088f-cba1-4e0a-ad9e-c11173b1e897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:00 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Volume volume-646e813c-667b-42c8-a7f9-797aacb2af57 (646e813c-667b-42c8-a7f9-797aacb2af57): created successfully Nov 02 12:32:00 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (595f088f-cba1-4e0a-ad9e-c11173b1e897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:00 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Flow 'volume_create_manager' (3aef12c8-5061-435b-84a5-b8fc563d09ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:32:00 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-78a47a9b-1c35-4e0d-9dc9-e07f12da29aa tempest-VolumesCloneTest-1295698415 None] Created volume successfully. Nov 02 12:32:00 devstack sudo[96801]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-18c5f385-918b-4a55-9909-d7a575fcf41c tempest-VolumesTransfersTest-1939202769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-b5840bf0-44cb-41c7-a189-4e88be0a1c94 1073741824" returned: 0 in 0.501s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-18c5f385-918b-4a55-9909-d7a575fcf41c tempest-VolumesTransfersTest-1939202769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-b5840bf0-44cb-41c7-a189-4e88be0a1c94 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:00 devstack sudo[96807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-b5840bf0-44cb-41c7-a189-4e88be0a1c94 Nov 02 12:32:00 devstack sudo[96807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:00 devstack sudo[96807]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-18c5f385-918b-4a55-9909-d7a575fcf41c tempest-VolumesTransfersTest-1939202769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-b5840bf0-44cb-41c7-a189-4e88be0a1c94" returned: 0 in 0.270s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:00 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-18c5f385-918b-4a55-9909-d7a575fcf41c tempest-VolumesTransfersTest-1939202769 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:32:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-18c5f385-918b-4a55-9909-d7a575fcf41c tempest-VolumesTransfersTest-1939202769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:00 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-18c5f385-918b-4a55-9909-d7a575fcf41c tempest-VolumesTransfersTest-1939202769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab3a1238-7500-4d89-9d49-46ff1c6bdb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5840bf0-44cb-41c7-a189-4e88be0a1c94', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:00 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-18c5f385-918b-4a55-9909-d7a575fcf41c tempest-VolumesTransfersTest-1939202769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85437e82-f93c-46b4-b130-6f739dfc59a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:00 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-18c5f385-918b-4a55-9909-d7a575fcf41c tempest-VolumesTransfersTest-1939202769 None] Volume volume-b5840bf0-44cb-41c7-a189-4e88be0a1c94 (b5840bf0-44cb-41c7-a189-4e88be0a1c94): created successfully Nov 02 12:32:00 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-18c5f385-918b-4a55-9909-d7a575fcf41c tempest-VolumesTransfersTest-1939202769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85437e82-f93c-46b4-b130-6f739dfc59a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:00 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-18c5f385-918b-4a55-9909-d7a575fcf41c tempest-VolumesTransfersTest-1939202769 None] Flow 'volume_create_manager' (aed0f2f0-cdef-418e-ae6e-2ee70fd706d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:32:00 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-18c5f385-918b-4a55-9909-d7a575fcf41c tempest-VolumesTransfersTest-1939202769 None] Created volume successfully. Nov 02 12:32:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-6aa0018e-efc2-4ad7-9ce0-24a1fa0ac2bd tempest-VolumesCloneTest-1295698415 None] Acquiring lock "cinder-646e813c-667b-42c8-a7f9-797aacb2af57-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:32:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-6aa0018e-efc2-4ad7-9ce0-24a1fa0ac2bd tempest-VolumesCloneTest-1295698415 None] Lock "cinder-646e813c-667b-42c8-a7f9-797aacb2af57-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:32:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-6aa0018e-efc2-4ad7-9ce0-24a1fa0ac2bd tempest-VolumesCloneTest-1295698415 None] Acquiring lock "cinder-quobyte-646e813c-667b-42c8-a7f9-797aacb2af57" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:32:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-6aa0018e-efc2-4ad7-9ce0-24a1fa0ac2bd tempest-VolumesCloneTest-1295698415 None] Lock "cinder-quobyte-646e813c-667b-42c8-a7f9-797aacb2af57" acquired by "delete_volume" :: waited 0.026s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:32:01 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[da25e3d6-f455-4064-86fe-2d1395275800]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:32:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6aa0018e-efc2-4ad7-9ce0-24a1fa0ac2bd tempest-VolumesCloneTest-1295698415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-646e813c-667b-42c8-a7f9-797aacb2af57 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:01 devstack sudo[96811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-646e813c-667b-42c8-a7f9-797aacb2af57 Nov 02 12:32:01 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:02 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6aa0018e-efc2-4ad7-9ce0-24a1fa0ac2bd tempest-VolumesCloneTest-1295698415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-646e813c-667b-42c8-a7f9-797aacb2af57" returned: 0 in 0.455s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6aa0018e-efc2-4ad7-9ce0-24a1fa0ac2bd tempest-VolumesCloneTest-1295698415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-646e813c-667b-42c8-a7f9-797aacb2af57 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:02 devstack sudo[96817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-646e813c-667b-42c8-a7f9-797aacb2af57 Nov 02 12:32:02 devstack sudo[96817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:02 devstack sudo[96817]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6aa0018e-efc2-4ad7-9ce0-24a1fa0ac2bd tempest-VolumesCloneTest-1295698415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-646e813c-667b-42c8-a7f9-797aacb2af57" returned: 0 in 0.294s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:02 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-6aa0018e-efc2-4ad7-9ce0-24a1fa0ac2bd tempest-VolumesCloneTest-1295698415 None] Lock "cinder-quobyte-646e813c-667b-42c8-a7f9-797aacb2af57" released by "delete_volume" :: held 0.809s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:32:02 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-6aa0018e-efc2-4ad7-9ce0-24a1fa0ac2bd tempest-VolumesCloneTest-1295698415 None] Created reservations ['a2830cde-acea-4537-86a8-b054468baf3f', 'acade1ab-5d13-45bd-9d7f-29ba0d1c53ea', '96970fc2-88a0-48c1-8b31-7efca364cd0e', '97b17146-91e4-4288-b60f-83297ef5a7d1'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:32:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-6aa0018e-efc2-4ad7-9ce0-24a1fa0ac2bd tempest-VolumesCloneTest-1295698415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-6aa0018e-efc2-4ad7-9ce0-24a1fa0ac2bd tempest-VolumesCloneTest-1295698415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-6aa0018e-efc2-4ad7-9ce0-24a1fa0ac2bd tempest-VolumesCloneTest-1295698415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:32:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-6aa0018e-efc2-4ad7-9ce0-24a1fa0ac2bd tempest-VolumesCloneTest-1295698415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:32:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-6aa0018e-efc2-4ad7-9ce0-24a1fa0ac2bd tempest-VolumesCloneTest-1295698415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6aa0018e-efc2-4ad7-9ce0-24a1fa0ac2bd tempest-VolumesCloneTest-1295698415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:02 devstack sudo[96820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:32:02 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:02 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-e23181b7-ecb5-449c-8cf4-b67e5f6bff53 tempest-VolumesTransfersTest-1398185514 None] Transfer volume completed successfully. Nov 02 12:32:02 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-95f611d4-101c-4565-91e4-7f16c8b8cb25 tempest-VolumesCloneTest-1295698415 None] Acquiring lock "cinder-d7d1c7d2-5970-4801-af78-539911766a6c-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:32:02 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-95f611d4-101c-4565-91e4-7f16c8b8cb25 tempest-VolumesCloneTest-1295698415 None] Lock "cinder-d7d1c7d2-5970-4801-af78-539911766a6c-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:32:03 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-95f611d4-101c-4565-91e4-7f16c8b8cb25 tempest-VolumesCloneTest-1295698415 None] Acquiring lock "cinder-quobyte-d7d1c7d2-5970-4801-af78-539911766a6c" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:32:03 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-95f611d4-101c-4565-91e4-7f16c8b8cb25 tempest-VolumesCloneTest-1295698415 None] Lock "cinder-quobyte-d7d1c7d2-5970-4801-af78-539911766a6c" acquired by "delete_volume" :: waited 0.015s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:32:03 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6aa0018e-efc2-4ad7-9ce0-24a1fa0ac2bd tempest-VolumesCloneTest-1295698415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.389s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:03 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-6aa0018e-efc2-4ad7-9ce0-24a1fa0ac2bd tempest-VolumesCloneTest-1295698415 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:32:03 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-6aa0018e-efc2-4ad7-9ce0-24a1fa0ac2bd tempest-VolumesCloneTest-1295698415 None] Deleted volume successfully. Nov 02 12:32:03 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d413a8-74c3-4b77-bc2e-4a73525f529f]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:32:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-95f611d4-101c-4565-91e4-7f16c8b8cb25 tempest-VolumesCloneTest-1295698415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:03 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-6aa0018e-efc2-4ad7-9ce0-24a1fa0ac2bd tempest-VolumesCloneTest-1295698415 None] Lock "cinder-646e813c-667b-42c8-a7f9-797aacb2af57-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:32:03 devstack sudo[96823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c Nov 02 12:32:03 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:03 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ec99356e-ff91-4cf4-9cfd-8fb8bd534a06 tempest-VolumesTransfersTest-1906981476 None] Acquiring lock "cinder-b5840bf0-44cb-41c7-a189-4e88be0a1c94-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:32:03 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ec99356e-ff91-4cf4-9cfd-8fb8bd534a06 tempest-VolumesTransfersTest-1906981476 None] Lock "cinder-b5840bf0-44cb-41c7-a189-4e88be0a1c94-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:32:03 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ec99356e-ff91-4cf4-9cfd-8fb8bd534a06 tempest-VolumesTransfersTest-1906981476 None] Acquiring lock "cinder-quobyte-b5840bf0-44cb-41c7-a189-4e88be0a1c94" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:32:03 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ec99356e-ff91-4cf4-9cfd-8fb8bd534a06 tempest-VolumesTransfersTest-1906981476 None] Lock "cinder-quobyte-b5840bf0-44cb-41c7-a189-4e88be0a1c94" acquired by "delete_volume" :: waited 0.018s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:32:03 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1f1895-4c83-48b0-9182-8fc0145b682c]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:32:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ec99356e-ff91-4cf4-9cfd-8fb8bd534a06 tempest-VolumesTransfersTest-1906981476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-b5840bf0-44cb-41c7-a189-4e88be0a1c94 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:03 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-95f611d4-101c-4565-91e4-7f16c8b8cb25 tempest-VolumesCloneTest-1295698415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c" returned: 0 in 0.464s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-95f611d4-101c-4565-91e4-7f16c8b8cb25 tempest-VolumesCloneTest-1295698415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:03 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c Nov 02 12:32:03 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:03 devstack sudo[96828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-b5840bf0-44cb-41c7-a189-4e88be0a1c94 Nov 02 12:32:03 devstack sudo[96828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:03 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-95f611d4-101c-4565-91e4-7f16c8b8cb25 tempest-VolumesCloneTest-1295698415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d7d1c7d2-5970-4801-af78-539911766a6c" returned: 0 in 0.254s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:03 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-95f611d4-101c-4565-91e4-7f16c8b8cb25 tempest-VolumesCloneTest-1295698415 None] Lock "cinder-quobyte-d7d1c7d2-5970-4801-af78-539911766a6c" released by "delete_volume" :: held 0.806s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:32:03 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-95f611d4-101c-4565-91e4-7f16c8b8cb25 tempest-VolumesCloneTest-1295698415 None] Created reservations ['19305011-bb96-4816-80bf-4dfd9aeafbc5', '263a305d-a752-4e8c-b891-d746ff1fe275', '26e3f0a8-4237-4c13-9386-28384a8a4ab7', '0fb5e8df-16cd-45d5-b43e-af6d08ee8ca8'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:32:03 devstack sudo[96828]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ec99356e-ff91-4cf4-9cfd-8fb8bd534a06 tempest-VolumesTransfersTest-1906981476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-b5840bf0-44cb-41c7-a189-4e88be0a1c94" returned: 0 in 0.386s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ec99356e-ff91-4cf4-9cfd-8fb8bd534a06 tempest-VolumesTransfersTest-1906981476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-b5840bf0-44cb-41c7-a189-4e88be0a1c94 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:03 devstack sudo[96836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-b5840bf0-44cb-41c7-a189-4e88be0a1c94 Nov 02 12:32:03 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-95f611d4-101c-4565-91e4-7f16c8b8cb25 tempest-VolumesCloneTest-1295698415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-95f611d4-101c-4565-91e4-7f16c8b8cb25 tempest-VolumesCloneTest-1295698415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:03 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-95f611d4-101c-4565-91e4-7f16c8b8cb25 tempest-VolumesCloneTest-1295698415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:32:04 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-95f611d4-101c-4565-91e4-7f16c8b8cb25 tempest-VolumesCloneTest-1295698415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:32:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-95f611d4-101c-4565-91e4-7f16c8b8cb25 tempest-VolumesCloneTest-1295698415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-95f611d4-101c-4565-91e4-7f16c8b8cb25 tempest-VolumesCloneTest-1295698415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:04 devstack sudo[96838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:32:04 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:04 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ec99356e-ff91-4cf4-9cfd-8fb8bd534a06 tempest-VolumesTransfersTest-1906981476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-b5840bf0-44cb-41c7-a189-4e88be0a1c94" returned: 0 in 0.316s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:04 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ec99356e-ff91-4cf4-9cfd-8fb8bd534a06 tempest-VolumesTransfersTest-1906981476 None] Lock "cinder-quobyte-b5840bf0-44cb-41c7-a189-4e88be0a1c94" released by "delete_volume" :: held 0.763s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:32:04 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-95f611d4-101c-4565-91e4-7f16c8b8cb25 tempest-VolumesCloneTest-1295698415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.301s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:04 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-95f611d4-101c-4565-91e4-7f16c8b8cb25 tempest-VolumesCloneTest-1295698415 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:32:04 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-95f611d4-101c-4565-91e4-7f16c8b8cb25 tempest-VolumesCloneTest-1295698415 None] Deleted volume successfully. Nov 02 12:32:04 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-ec99356e-ff91-4cf4-9cfd-8fb8bd534a06 tempest-VolumesTransfersTest-1906981476 None] Created reservations ['d275d984-8a48-4b5c-ae32-8891de4ff761', 'f446e5b0-116a-4c8b-9ef9-7e04b912b45f', 'b7ed69d6-f015-47b8-90e6-989a16479641', '851c3501-c44f-4584-b452-1bc1d807c89d'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:32:04 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-95f611d4-101c-4565-91e4-7f16c8b8cb25 tempest-VolumesCloneTest-1295698415 None] Lock "cinder-d7d1c7d2-5970-4801-af78-539911766a6c-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:32:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ec99356e-ff91-4cf4-9cfd-8fb8bd534a06 tempest-VolumesTransfersTest-1906981476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ec99356e-ff91-4cf4-9cfd-8fb8bd534a06 tempest-VolumesTransfersTest-1906981476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:04 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ec99356e-ff91-4cf4-9cfd-8fb8bd534a06 tempest-VolumesTransfersTest-1906981476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:32:04 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ec99356e-ff91-4cf4-9cfd-8fb8bd534a06 tempest-VolumesTransfersTest-1906981476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:32:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ec99356e-ff91-4cf4-9cfd-8fb8bd534a06 tempest-VolumesTransfersTest-1906981476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ec99356e-ff91-4cf4-9cfd-8fb8bd534a06 tempest-VolumesTransfersTest-1906981476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:04 devstack sudo[96842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:32:04 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:04 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ec99356e-ff91-4cf4-9cfd-8fb8bd534a06 tempest-VolumesTransfersTest-1906981476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.296s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:04 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-ec99356e-ff91-4cf4-9cfd-8fb8bd534a06 tempest-VolumesTransfersTest-1906981476 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:32:04 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-ec99356e-ff91-4cf4-9cfd-8fb8bd534a06 tempest-VolumesTransfersTest-1906981476 None] Deleted volume successfully. Nov 02 12:32:04 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ec99356e-ff91-4cf4-9cfd-8fb8bd534a06 tempest-VolumesTransfersTest-1906981476 None] Lock "cinder-b5840bf0-44cb-41c7-a189-4e88be0a1c94-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:32:05 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a09da78-7384-454b-8faa-30692d16503b tempest-VolumesTransfersTest-1939202769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:32:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5a09da78-7384-454b-8faa-30692d16503b tempest-VolumesTransfersTest-1939202769 None] Flow 'volume_create_manager' (7145b5e6-0050-4138-a56e-7d13fd540558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:32:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5a09da78-7384-454b-8faa-30692d16503b tempest-VolumesTransfersTest-1939202769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa751321-82ad-46e5-be9b-b65b45528838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5a09da78-7384-454b-8faa-30692d16503b tempest-VolumesTransfersTest-1939202769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa751321-82ad-46e5-be9b-b65b45528838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-531277376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b4d49ad-1bec-457d-a5e2-4ce269a5ad32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7619124435234b0ead89faaac5020661',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:32:05Z,use_quota=True,user_id='389f1007eb534f198117582e79b6a1a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5a09da78-7384-454b-8faa-30692d16503b tempest-VolumesTransfersTest-1939202769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41fb2b40-9391-4011-beac-8c9e25abbf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5a09da78-7384-454b-8faa-30692d16503b tempest-VolumesTransfersTest-1939202769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41fb2b40-9391-4011-beac-8c9e25abbf65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5a09da78-7384-454b-8faa-30692d16503b tempest-VolumesTransfersTest-1939202769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dde1d4a-d820-4640-b0e4-89ddd9925844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5a09da78-7384-454b-8faa-30692d16503b tempest-VolumesTransfersTest-1939202769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dde1d4a-d820-4640-b0e4-89ddd9925844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b4d49ad-1bec-457d-a5e2-4ce269a5ad32', 'volume_name': 'volume-8b4d49ad-1bec-457d-a5e2-4ce269a5ad32', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5a09da78-7384-454b-8faa-30692d16503b tempest-VolumesTransfersTest-1939202769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e4b6ef6-aa28-44cd-b47e-64852a0c0a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5a09da78-7384-454b-8faa-30692d16503b tempest-VolumesTransfersTest-1939202769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e4b6ef6-aa28-44cd-b47e-64852a0c0a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5a09da78-7384-454b-8faa-30692d16503b tempest-VolumesTransfersTest-1939202769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a9d57bb-4e23-421b-9839-d9284096b9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:05 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-5a09da78-7384-454b-8faa-30692d16503b tempest-VolumesTransfersTest-1939202769 None] Volume 8b4d49ad-1bec-457d-a5e2-4ce269a5ad32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b4d49ad-1bec-457d-a5e2-4ce269a5ad32', 'volume_size': 1} Nov 02 12:32:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5a09da78-7384-454b-8faa-30692d16503b tempest-VolumesTransfersTest-1939202769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5a09da78-7384-454b-8faa-30692d16503b tempest-VolumesTransfersTest-1939202769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:05 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5a09da78-7384-454b-8faa-30692d16503b tempest-VolumesTransfersTest-1939202769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-531277376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b4d49ad-1bec-457d-a5e2-4ce269a5ad32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7619124435234b0ead89faaac5020661',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:32:05Z,use_quota=True,user_id='389f1007eb534f198117582e79b6a1a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:32:05 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-5a09da78-7384-454b-8faa-30692d16503b tempest-VolumesTransfersTest-1939202769 None] Creating volume 8b4d49ad-1bec-457d-a5e2-4ce269a5ad32 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:32:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5a09da78-7384-454b-8faa-30692d16503b tempest-VolumesTransfersTest-1939202769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5a09da78-7384-454b-8faa-30692d16503b tempest-VolumesTransfersTest-1939202769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:05 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5a09da78-7384-454b-8faa-30692d16503b tempest-VolumesTransfersTest-1939202769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:32:05 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5a09da78-7384-454b-8faa-30692d16503b tempest-VolumesTransfersTest-1939202769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:32:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5a09da78-7384-454b-8faa-30692d16503b tempest-VolumesTransfersTest-1939202769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:05 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5a09da78-7384-454b-8faa-30692d16503b tempest-VolumesTransfersTest-1939202769 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:32:05 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-5a09da78-7384-454b-8faa-30692d16503b tempest-VolumesTransfersTest-1939202769 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:32:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5a09da78-7384-454b-8faa-30692d16503b tempest-VolumesTransfersTest-1939202769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8b4d49ad-1bec-457d-a5e2-4ce269a5ad32 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:05 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8b4d49ad-1bec-457d-a5e2-4ce269a5ad32 1073741824 Nov 02 12:32:05 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:05 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5a09da78-7384-454b-8faa-30692d16503b tempest-VolumesTransfersTest-1939202769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8b4d49ad-1bec-457d-a5e2-4ce269a5ad32 1073741824" returned: 0 in 0.524s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5a09da78-7384-454b-8faa-30692d16503b tempest-VolumesTransfersTest-1939202769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8b4d49ad-1bec-457d-a5e2-4ce269a5ad32 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:05 devstack sudo[96855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8b4d49ad-1bec-457d-a5e2-4ce269a5ad32 Nov 02 12:32:05 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:06 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5a09da78-7384-454b-8faa-30692d16503b tempest-VolumesTransfersTest-1939202769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8b4d49ad-1bec-457d-a5e2-4ce269a5ad32" returned: 0 in 0.330s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:06 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5a09da78-7384-454b-8faa-30692d16503b tempest-VolumesTransfersTest-1939202769 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:32:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5a09da78-7384-454b-8faa-30692d16503b tempest-VolumesTransfersTest-1939202769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:06 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5a09da78-7384-454b-8faa-30692d16503b tempest-VolumesTransfersTest-1939202769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a9d57bb-4e23-421b-9839-d9284096b9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b4d49ad-1bec-457d-a5e2-4ce269a5ad32', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:06 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5a09da78-7384-454b-8faa-30692d16503b tempest-VolumesTransfersTest-1939202769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e29aea-cf7f-485b-b01f-16a390843776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:06 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-5a09da78-7384-454b-8faa-30692d16503b tempest-VolumesTransfersTest-1939202769 None] Volume volume-8b4d49ad-1bec-457d-a5e2-4ce269a5ad32 (8b4d49ad-1bec-457d-a5e2-4ce269a5ad32): created successfully Nov 02 12:32:06 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5a09da78-7384-454b-8faa-30692d16503b tempest-VolumesTransfersTest-1939202769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3e29aea-cf7f-485b-b01f-16a390843776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:06 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5a09da78-7384-454b-8faa-30692d16503b tempest-VolumesTransfersTest-1939202769 None] Flow 'volume_create_manager' (7145b5e6-0050-4138-a56e-7d13fd540558) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:32:06 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-5a09da78-7384-454b-8faa-30692d16503b tempest-VolumesTransfersTest-1939202769 None] Created volume successfully. Nov 02 12:32:07 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0b3cfe2b-1032-416e-8f26-f6959eeaa43f tempest-VolumesTransfersTest-1906981476 None] Acquiring lock "cinder-8b4d49ad-1bec-457d-a5e2-4ce269a5ad32-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:32:07 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0b3cfe2b-1032-416e-8f26-f6959eeaa43f tempest-VolumesTransfersTest-1906981476 None] Lock "cinder-8b4d49ad-1bec-457d-a5e2-4ce269a5ad32-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:32:07 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0b3cfe2b-1032-416e-8f26-f6959eeaa43f tempest-VolumesTransfersTest-1906981476 None] Acquiring lock "cinder-quobyte-8b4d49ad-1bec-457d-a5e2-4ce269a5ad32" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:32:07 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0b3cfe2b-1032-416e-8f26-f6959eeaa43f tempest-VolumesTransfersTest-1906981476 None] Lock "cinder-quobyte-8b4d49ad-1bec-457d-a5e2-4ce269a5ad32" acquired by "delete_volume" :: waited 0.016s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:32:07 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b95d865-4df4-45a7-8632-e862e3f4e489]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:32:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0b3cfe2b-1032-416e-8f26-f6959eeaa43f tempest-VolumesTransfersTest-1906981476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8b4d49ad-1bec-457d-a5e2-4ce269a5ad32 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:07 devstack sudo[96874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8b4d49ad-1bec-457d-a5e2-4ce269a5ad32 Nov 02 12:32:07 devstack sudo[96874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:08 devstack sudo[96874]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0b3cfe2b-1032-416e-8f26-f6959eeaa43f tempest-VolumesTransfersTest-1906981476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8b4d49ad-1bec-457d-a5e2-4ce269a5ad32" returned: 0 in 0.417s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0b3cfe2b-1032-416e-8f26-f6959eeaa43f tempest-VolumesTransfersTest-1906981476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8b4d49ad-1bec-457d-a5e2-4ce269a5ad32 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:08 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8b4d49ad-1bec-457d-a5e2-4ce269a5ad32 Nov 02 12:32:08 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:08 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0b3cfe2b-1032-416e-8f26-f6959eeaa43f tempest-VolumesTransfersTest-1906981476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8b4d49ad-1bec-457d-a5e2-4ce269a5ad32" returned: 0 in 0.269s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:08 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0b3cfe2b-1032-416e-8f26-f6959eeaa43f tempest-VolumesTransfersTest-1906981476 None] Lock "cinder-quobyte-8b4d49ad-1bec-457d-a5e2-4ce269a5ad32" released by "delete_volume" :: held 0.746s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:32:08 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-0b3cfe2b-1032-416e-8f26-f6959eeaa43f tempest-VolumesTransfersTest-1906981476 None] Created reservations ['97d75780-c2d3-49fb-9a60-c95eb9c17adc', '37800ea5-2d50-4822-adfe-cd82d038f22b', 'ea1771d2-628a-46bc-a623-27b9c903e23f', '4c003832-28f1-4900-a6a8-2e9a68b376a8'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:32:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0b3cfe2b-1032-416e-8f26-f6959eeaa43f tempest-VolumesTransfersTest-1906981476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0b3cfe2b-1032-416e-8f26-f6959eeaa43f tempest-VolumesTransfersTest-1906981476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:08 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0b3cfe2b-1032-416e-8f26-f6959eeaa43f tempest-VolumesTransfersTest-1906981476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:32:08 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0b3cfe2b-1032-416e-8f26-f6959eeaa43f tempest-VolumesTransfersTest-1906981476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:32:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0b3cfe2b-1032-416e-8f26-f6959eeaa43f tempest-VolumesTransfersTest-1906981476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0b3cfe2b-1032-416e-8f26-f6959eeaa43f tempest-VolumesTransfersTest-1906981476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:08 devstack sudo[96883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:32:08 devstack sudo[96883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:09 devstack sudo[96883]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0b3cfe2b-1032-416e-8f26-f6959eeaa43f tempest-VolumesTransfersTest-1906981476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.320s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:09 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-0b3cfe2b-1032-416e-8f26-f6959eeaa43f tempest-VolumesTransfersTest-1906981476 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:32:09 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-0b3cfe2b-1032-416e-8f26-f6959eeaa43f tempest-VolumesTransfersTest-1906981476 None] Deleted volume successfully. Nov 02 12:32:09 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0b3cfe2b-1032-416e-8f26-f6959eeaa43f tempest-VolumesTransfersTest-1906981476 None] Lock "cinder-8b4d49ad-1bec-457d-a5e2-4ce269a5ad32-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:32:09 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:32:09 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Flow 'volume_create_manager' (0224dd69-1510-492d-8c08-7b4fd902b357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:32:09 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f113fc-f6c4-46c4-a590-e2ef1f3ee063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:09 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f113fc-f6c4-46c4-a590-e2ef1f3ee063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1424120144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd83f778-7dee-46b8-b122-49300e429f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2759e2f7ce2443ecba10aef2574c0cbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:32:09Z,use_quota=True,user_id='7176237b84744a17b382f1ef5df58ed8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:09 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b9ab316-3577-41b4-aa5d-42849ee504bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:09 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b9ab316-3577-41b4-aa5d-42849ee504bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:09 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b79c6b-eb29-4bd5-bf4f-0e9937fa5f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:09 devstack cinder-volume[86515]: DEBUG cinder.image.glance [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Creating Keystone auth plugin from conf {{(pid=86515) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 12:32:10 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b79c6b-eb29-4bd5-bf4f-0e9937fa5f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cd83f778-7dee-46b8-b122-49300e429f3d', 'volume_name': 'volume-cd83f778-7dee-46b8-b122-49300e429f3d', 'volume_size': 1, 'image_id': '4d531188-e398-41fe-8056-e52aa8e7c4ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d531188-e398-41fe-8056-e52aa8e7c4ab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ea64174531846a688f10d8f38a757ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d531188-e398-41fe-8056-e52aa8e7c4ab', 'created_at': datetime.datetime(2026, 11, 2, 11, 16, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 16, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d531188-e398-41fe-8056-e52aa8e7c4ab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:10 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b1f6d7-82e2-4bf8-8b88-8d33ca406bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:10 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18b1f6d7-82e2-4bf8-8b88-8d33ca406bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:10 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fb0c86b-e6b1-4e89-9c19-c3713478561f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:10 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Volume cd83f778-7dee-46b8-b122-49300e429f3d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cd83f778-7dee-46b8-b122-49300e429f3d', 'volume_size': 1, 'image_id': '4d531188-e398-41fe-8056-e52aa8e7c4ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d531188-e398-41fe-8056-e52aa8e7c4ab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ea64174531846a688f10d8f38a757ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d531188-e398-41fe-8056-e52aa8e7c4ab', 'created_at': datetime.datetime(2026, 11, 2, 11, 16, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 16, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d531188-e398-41fe-8056-e52aa8e7c4ab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 12:32:10 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Trying to clone cd83f778-7dee-46b8-b122-49300e429f3d from image 4d531188-e398-41fe-8056-e52aa8e7c4ab at location (None, [{'url': 'file:///opt/stack/data/glance/images/4d531188-e398-41fe-8056-e52aa8e7c4ab', 'metadata': {}}]). {{(pid=86515) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1127}} Nov 02 12:32:11 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_r4o4ti5qdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86515) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 12:32:11 devstack cinder-volume[86515]: INFO cinder.image.image_utils [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Image download 20.69 MB at 20.69 MB/s Nov 02 12:32:11 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[286d0550-a55d-4b19-9f9a-5dbc08589b98]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:32:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_r4o4ti5qdevstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:11 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_r4o4ti5qdevstack@QuobyteHD Nov 02 12:32:11 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:11 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_r4o4ti5qdevstack@QuobyteHD" returned: 0 in 0.555s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:11 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Temporary image 4d531188-e398-41fe-8056-e52aa8e7c4ab is fetched for user 7176237b84744a17b382f1ef5df58ed8. {{(pid=86515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 12:32:11 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:UPDATE=102,cinder:INSERT=28,cinder:SELECT=82,cinder:DELETE=6 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:32:11 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[77033276-b28e-49d3-8d12-1bdaa4ceb463]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:32:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_r4o4ti5qdevstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:11 devstack sudo[96961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_r4o4ti5qdevstack@QuobyteHD Nov 02 12:32:11 devstack sudo[96961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:12 devstack sudo[96961]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_r4o4ti5qdevstack@QuobyteHD" returned: 0 in 0.515s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:12 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1424120144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd83f778-7dee-46b8-b122-49300e429f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2759e2f7ce2443ecba10aef2574c0cbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:32:09Z,use_quota=True,user_id='7176237b84744a17b382f1ef5df58ed8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:32:12 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Creating volume cd83f778-7dee-46b8-b122-49300e429f3d {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:32:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:12 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:32:12 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:32:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:12 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:32:12 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:32:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cd83f778-7dee-46b8-b122-49300e429f3d 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:12 devstack sudo[96966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cd83f778-7dee-46b8-b122-49300e429f3d 1073741824 Nov 02 12:32:12 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:13 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cd83f778-7dee-46b8-b122-49300e429f3d 1073741824" returned: 0 in 0.721s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cd83f778-7dee-46b8-b122-49300e429f3d {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:13 devstack sudo[96972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cd83f778-7dee-46b8-b122-49300e429f3d Nov 02 12:32:13 devstack sudo[96972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:13 devstack sudo[96972]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cd83f778-7dee-46b8-b122-49300e429f3d" returned: 0 in 0.337s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:13 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:32:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:13 devstack cinder-volume[86515]: DEBUG cinder.volume.volume_utils [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Attempting download of 4d531188-e398-41fe-8056-e52aa8e7c4ab ((None, [{'url': 'file:///opt/stack/data/glance/images/4d531188-e398-41fe-8056-e52aa8e7c4ab', 'metadata': {}}])) to volume cd83f778-7dee-46b8-b122-49300e429f3d. {{(pid=86515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 12:32:13 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ffa66a-06df-4d2a-99b3-91e97e7be2eb]: (4, 'raw') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:32:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d531188-e398-41fe-8056-e52aa8e7c4ab_4f5fj071 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:13 devstack sudo[96976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d531188-e398-41fe-8056-e52aa8e7c4ab_4f5fj071 Nov 02 12:32:13 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:14 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d531188-e398-41fe-8056-e52aa8e7c4ab_4f5fj071" returned: 0 in 0.512s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d531188-e398-41fe-8056-e52aa8e7c4ab_4f5fj071 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:14 devstack sudo[96981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d531188-e398-41fe-8056-e52aa8e7c4ab_4f5fj071 Nov 02 12:32:14 devstack sudo[96981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:14 devstack sudo[96981]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d531188-e398-41fe-8056-e52aa8e7c4ab_4f5fj071" returned: 1 in 0.445s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d531188-e398-41fe-8056-e52aa8e7c4ab_4f5fj071' failed. Not Retrying. {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:32:14 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf6fb57-d1c5-4a58-9994-04d4d636f39e]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:32:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_r4o4ti5qdevstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:14 devstack sudo[96985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_r4o4ti5qdevstack@QuobyteHD Nov 02 12:32:14 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:15 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_r4o4ti5qdevstack@QuobyteHD" returned: 0 in 0.427s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:15 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] 4d531188-e398-41fe-8056-e52aa8e7c4ab was qcow2, converting to qcow2 {{(pid=86515) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 12:32:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_r4o4ti5qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cd83f778-7dee-46b8-b122-49300e429f3d {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:15 devstack sudo[96990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_r4o4ti5qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cd83f778-7dee-46b8-b122-49300e429f3d Nov 02 12:32:15 devstack sudo[96990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:17 devstack sudo[96990]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_r4o4ti5qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cd83f778-7dee-46b8-b122-49300e429f3d" returned: 0 in 2.096s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:17 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_r4o4ti5qdevstack@QuobyteHD, size 112.00 MB, duration 2.10 sec, destination /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cd83f778-7dee-46b8-b122-49300e429f3d {{(pid=86515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 12:32:17 devstack cinder-volume[86515]: INFO cinder.image.image_utils [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Converted 112.00 MB image at 53.40 MB/s Nov 02 12:32:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cd83f778-7dee-46b8-b122-49300e429f3d 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:17 devstack sudo[97001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cd83f778-7dee-46b8-b122-49300e429f3d 1G Nov 02 12:32:17 devstack sudo[97001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:17 devstack sudo[97001]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cd83f778-7dee-46b8-b122-49300e429f3d 1G" returned: 0 in 0.359s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:17 devstack cinder-volume[86515]: DEBUG cinder.volume.volume_utils [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Downloaded image 4d531188-e398-41fe-8056-e52aa8e7c4ab ((None, [{'url': 'file:///opt/stack/data/glance/images/4d531188-e398-41fe-8056-e52aa8e7c4ab', 'metadata': {}}])) to volume cd83f778-7dee-46b8-b122-49300e429f3d successfully. {{(pid=86515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 12:32:17 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Temporary image 4d531188-e398-41fe-8056-e52aa8e7c4ab for user 7176237b84744a17b382f1ef5df58ed8 is deleted. {{(pid=86515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 12:32:17 devstack cinder-volume[86515]: DEBUG cinder.volume.volume_utils [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Marking volume cd83f778-7dee-46b8-b122-49300e429f3d as bootable. {{(pid=86515) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 12:32:17 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Copying metadata from image 4d531188-e398-41fe-8056-e52aa8e7c4ab to cd83f778-7dee-46b8-b122-49300e429f3d. {{(pid=86515) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 12:32:17 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Creating volume glance metadata for volume cd83f778-7dee-46b8-b122-49300e429f3d backed by image 4d531188-e398-41fe-8056-e52aa8e7c4ab with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4d531188-e398-41fe-8056-e52aa8e7c4ab', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86515) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 12:32:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fb0c86b-e6b1-4e89-9c19-c3713478561f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd83f778-7dee-46b8-b122-49300e429f3d', 'volume_size': 1, 'image_id': '4d531188-e398-41fe-8056-e52aa8e7c4ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d531188-e398-41fe-8056-e52aa8e7c4ab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ea64174531846a688f10d8f38a757ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d531188-e398-41fe-8056-e52aa8e7c4ab', 'created_at': datetime.datetime(2026, 11, 2, 11, 16, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 16, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d531188-e398-41fe-8056-e52aa8e7c4ab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ac842c-6101-4ae4-b6d2-b1dd6cb49696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:17 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Volume volume-cd83f778-7dee-46b8-b122-49300e429f3d (cd83f778-7dee-46b8-b122-49300e429f3d): created successfully Nov 02 12:32:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ac842c-6101-4ae4-b6d2-b1dd6cb49696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Flow 'volume_create_manager' (0224dd69-1510-492d-8c08-7b4fd902b357) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:32:17 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-97922603-ef73-4cf6-bf1d-bb574efa4c82 tempest-VolumesExtendTest-1754247697 None] Created volume successfully. Nov 02 12:32:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7a317210-0335-449e-815f-c8fc80740506 tempest-VolumesExtendTest-1754247697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7a317210-0335-449e-815f-c8fc80740506 tempest-VolumesExtendTest-1754247697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:18 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac47e9ff-429f-4de3-b3f5-a112efe62c47]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:32:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7a317210-0335-449e-815f-c8fc80740506 tempest-VolumesExtendTest-1754247697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cd83f778-7dee-46b8-b122-49300e429f3d {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:18 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cd83f778-7dee-46b8-b122-49300e429f3d Nov 02 12:32:18 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:18 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7a317210-0335-449e-815f-c8fc80740506 tempest-VolumesExtendTest-1754247697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cd83f778-7dee-46b8-b122-49300e429f3d" returned: 0 in 0.429s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7a317210-0335-449e-815f-c8fc80740506 tempest-VolumesExtendTest-1754247697 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cd83f778-7dee-46b8-b122-49300e429f3d 2G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7a317210-0335-449e-815f-c8fc80740506 tempest-VolumesExtendTest-1754247697 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cd83f778-7dee-46b8-b122-49300e429f3d 2G" returned: 0 in 0.158s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7a317210-0335-449e-815f-c8fc80740506 tempest-VolumesExtendTest-1754247697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.644s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:18 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-7a317210-0335-449e-815f-c8fc80740506 tempest-VolumesExtendTest-1754247697 None] Extend volume completed successfully. Nov 02 12:32:19 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ca6e648f-1bd7-4756-8f4a-3b8936a01081 tempest-VolumesExtendTest-1754247697 None] Acquiring lock "cinder-cd83f778-7dee-46b8-b122-49300e429f3d-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:32:19 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ca6e648f-1bd7-4756-8f4a-3b8936a01081 tempest-VolumesExtendTest-1754247697 None] Lock "cinder-cd83f778-7dee-46b8-b122-49300e429f3d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:32:19 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ca6e648f-1bd7-4756-8f4a-3b8936a01081 tempest-VolumesExtendTest-1754247697 None] Acquiring lock "cinder-quobyte-cd83f778-7dee-46b8-b122-49300e429f3d" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:32:19 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ca6e648f-1bd7-4756-8f4a-3b8936a01081 tempest-VolumesExtendTest-1754247697 None] Lock "cinder-quobyte-cd83f778-7dee-46b8-b122-49300e429f3d" acquired by "delete_volume" :: waited 0.020s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:32:19 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6522b8-841b-4b34-9409-544b1cb86c4d]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:32:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ca6e648f-1bd7-4756-8f4a-3b8936a01081 tempest-VolumesExtendTest-1754247697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cd83f778-7dee-46b8-b122-49300e429f3d {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:20 devstack sudo[97016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cd83f778-7dee-46b8-b122-49300e429f3d Nov 02 12:32:20 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:20 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ca6e648f-1bd7-4756-8f4a-3b8936a01081 tempest-VolumesExtendTest-1754247697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cd83f778-7dee-46b8-b122-49300e429f3d" returned: 0 in 0.386s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ca6e648f-1bd7-4756-8f4a-3b8936a01081 tempest-VolumesExtendTest-1754247697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cd83f778-7dee-46b8-b122-49300e429f3d {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:20 devstack sudo[97021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cd83f778-7dee-46b8-b122-49300e429f3d Nov 02 12:32:20 devstack sudo[97021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:20 devstack sudo[97021]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ca6e648f-1bd7-4756-8f4a-3b8936a01081 tempest-VolumesExtendTest-1754247697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cd83f778-7dee-46b8-b122-49300e429f3d" returned: 0 in 0.272s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:20 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ca6e648f-1bd7-4756-8f4a-3b8936a01081 tempest-VolumesExtendTest-1754247697 None] Lock "cinder-quobyte-cd83f778-7dee-46b8-b122-49300e429f3d" released by "delete_volume" :: held 0.705s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:32:20 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-ca6e648f-1bd7-4756-8f4a-3b8936a01081 tempest-VolumesExtendTest-1754247697 None] Created reservations ['c95fded6-2751-41bf-bb49-ddc9b64882ab', '9c8f34f8-4554-4287-b694-c07c98c07db8', '3767a3a2-c939-46aa-8979-9cb49e610ac9', '23514867-3cb9-4064-87c8-6e7ea458c616'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:32:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ca6e648f-1bd7-4756-8f4a-3b8936a01081 tempest-VolumesExtendTest-1754247697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ca6e648f-1bd7-4756-8f4a-3b8936a01081 tempest-VolumesExtendTest-1754247697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ca6e648f-1bd7-4756-8f4a-3b8936a01081 tempest-VolumesExtendTest-1754247697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:32:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ca6e648f-1bd7-4756-8f4a-3b8936a01081 tempest-VolumesExtendTest-1754247697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:32:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ca6e648f-1bd7-4756-8f4a-3b8936a01081 tempest-VolumesExtendTest-1754247697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ca6e648f-1bd7-4756-8f4a-3b8936a01081 tempest-VolumesExtendTest-1754247697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:20 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:32:20 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:21 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ca6e648f-1bd7-4756-8f4a-3b8936a01081 tempest-VolumesExtendTest-1754247697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.302s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-ca6e648f-1bd7-4756-8f4a-3b8936a01081 tempest-VolumesExtendTest-1754247697 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:32:21 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-ca6e648f-1bd7-4756-8f4a-3b8936a01081 tempest-VolumesExtendTest-1754247697 None] Deleted volume successfully. Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ca6e648f-1bd7-4756-8f4a-3b8936a01081 tempest-VolumesExtendTest-1754247697 None] Lock "cinder-cd83f778-7dee-46b8-b122-49300e429f3d-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7d2cb9d-0aa3-400c-a519-230e82a5afbf tempest-VolumesNegativeTest-1833921564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a7d2cb9d-0aa3-400c-a519-230e82a5afbf tempest-VolumesNegativeTest-1833921564 None] Flow 'volume_create_manager' (8e86ffe5-4b5f-47d4-9eec-ff20d566df71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a7d2cb9d-0aa3-400c-a519-230e82a5afbf tempest-VolumesNegativeTest-1833921564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e804a16-e4e0-4c57-8348-8b1bfd139a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a7d2cb9d-0aa3-400c-a519-230e82a5afbf tempest-VolumesNegativeTest-1833921564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e804a16-e4e0-4c57-8348-8b1bfd139a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1302167781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c164ccef-111e-47ff-a5af-4f2cdeeade18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361b70d8073b4070bef5d80728b92806',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:32:21Z,use_quota=True,user_id='e99eea0ab157434d84cefd4eec33fa5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a7d2cb9d-0aa3-400c-a519-230e82a5afbf tempest-VolumesNegativeTest-1833921564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7849cd12-c50a-482c-a380-9cfba94c50dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a7d2cb9d-0aa3-400c-a519-230e82a5afbf tempest-VolumesNegativeTest-1833921564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7849cd12-c50a-482c-a380-9cfba94c50dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a7d2cb9d-0aa3-400c-a519-230e82a5afbf tempest-VolumesNegativeTest-1833921564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bfb3cf7-f159-49aa-8e37-f66bb2c92554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a7d2cb9d-0aa3-400c-a519-230e82a5afbf tempest-VolumesNegativeTest-1833921564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bfb3cf7-f159-49aa-8e37-f66bb2c92554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c164ccef-111e-47ff-a5af-4f2cdeeade18', 'volume_name': 'volume-c164ccef-111e-47ff-a5af-4f2cdeeade18', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a7d2cb9d-0aa3-400c-a519-230e82a5afbf tempest-VolumesNegativeTest-1833921564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d2a6a4-b2cd-4ecb-ab39-d0c0fd2a09b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a7d2cb9d-0aa3-400c-a519-230e82a5afbf tempest-VolumesNegativeTest-1833921564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d2a6a4-b2cd-4ecb-ab39-d0c0fd2a09b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a7d2cb9d-0aa3-400c-a519-230e82a5afbf tempest-VolumesNegativeTest-1833921564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c03f8fd9-b904-4a70-981f-62624f3b5b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:21 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-a7d2cb9d-0aa3-400c-a519-230e82a5afbf tempest-VolumesNegativeTest-1833921564 None] Volume c164ccef-111e-47ff-a5af-4f2cdeeade18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c164ccef-111e-47ff-a5af-4f2cdeeade18', 'volume_size': 1} Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a7d2cb9d-0aa3-400c-a519-230e82a5afbf tempest-VolumesNegativeTest-1833921564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a7d2cb9d-0aa3-400c-a519-230e82a5afbf tempest-VolumesNegativeTest-1833921564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a7d2cb9d-0aa3-400c-a519-230e82a5afbf tempest-VolumesNegativeTest-1833921564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1302167781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c164ccef-111e-47ff-a5af-4f2cdeeade18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361b70d8073b4070bef5d80728b92806',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:32:21Z,use_quota=True,user_id='e99eea0ab157434d84cefd4eec33fa5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-a7d2cb9d-0aa3-400c-a519-230e82a5afbf tempest-VolumesNegativeTest-1833921564 None] Creating volume c164ccef-111e-47ff-a5af-4f2cdeeade18 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a7d2cb9d-0aa3-400c-a519-230e82a5afbf tempest-VolumesNegativeTest-1833921564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a7d2cb9d-0aa3-400c-a519-230e82a5afbf tempest-VolumesNegativeTest-1833921564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a7d2cb9d-0aa3-400c-a519-230e82a5afbf tempest-VolumesNegativeTest-1833921564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a7d2cb9d-0aa3-400c-a519-230e82a5afbf tempest-VolumesNegativeTest-1833921564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a7d2cb9d-0aa3-400c-a519-230e82a5afbf tempest-VolumesNegativeTest-1833921564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a7d2cb9d-0aa3-400c-a519-230e82a5afbf tempest-VolumesNegativeTest-1833921564 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:32:21 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-a7d2cb9d-0aa3-400c-a519-230e82a5afbf tempest-VolumesNegativeTest-1833921564 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a7d2cb9d-0aa3-400c-a519-230e82a5afbf tempest-VolumesNegativeTest-1833921564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c164ccef-111e-47ff-a5af-4f2cdeeade18 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:21 devstack sudo[97029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c164ccef-111e-47ff-a5af-4f2cdeeade18 1073741824 Nov 02 12:32:21 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-903211d7-9372-4fb8-839e-1916496d0c9e tempest-VolumesExtendTest-1754247697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-903211d7-9372-4fb8-839e-1916496d0c9e tempest-VolumesExtendTest-1754247697 None] Flow 'volume_create_manager' (04664268-4635-4323-baf5-cd0abdca4989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-903211d7-9372-4fb8-839e-1916496d0c9e tempest-VolumesExtendTest-1754247697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb989a0-6ce7-40fa-884b-8bd695a35fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-903211d7-9372-4fb8-839e-1916496d0c9e tempest-VolumesExtendTest-1754247697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb989a0-6ce7-40fa-884b-8bd695a35fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1518991622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=442a9100-aadf-4d75-bfd8-a1e1d4af453f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2759e2f7ce2443ecba10aef2574c0cbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:32:22Z,use_quota=True,user_id='7176237b84744a17b382f1ef5df58ed8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-903211d7-9372-4fb8-839e-1916496d0c9e tempest-VolumesExtendTest-1754247697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe85b7a8-c521-4824-b2a5-9ca15408e66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-903211d7-9372-4fb8-839e-1916496d0c9e tempest-VolumesExtendTest-1754247697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe85b7a8-c521-4824-b2a5-9ca15408e66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-903211d7-9372-4fb8-839e-1916496d0c9e tempest-VolumesExtendTest-1754247697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7b3f780-b547-4f0b-b8bb-a06bacdc3807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-903211d7-9372-4fb8-839e-1916496d0c9e tempest-VolumesExtendTest-1754247697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7b3f780-b547-4f0b-b8bb-a06bacdc3807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '442a9100-aadf-4d75-bfd8-a1e1d4af453f', 'volume_name': 'volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-903211d7-9372-4fb8-839e-1916496d0c9e tempest-VolumesExtendTest-1754247697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb14a041-d00f-4d90-8117-4a5107375712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-903211d7-9372-4fb8-839e-1916496d0c9e tempest-VolumesExtendTest-1754247697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb14a041-d00f-4d90-8117-4a5107375712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-903211d7-9372-4fb8-839e-1916496d0c9e tempest-VolumesExtendTest-1754247697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae044f2f-0f56-4032-93d0-5dc682bfad82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:21 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-903211d7-9372-4fb8-839e-1916496d0c9e tempest-VolumesExtendTest-1754247697 None] Volume 442a9100-aadf-4d75-bfd8-a1e1d4af453f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f', 'volume_size': 1} Nov 02 12:32:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-903211d7-9372-4fb8-839e-1916496d0c9e tempest-VolumesExtendTest-1754247697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:22 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a7d2cb9d-0aa3-400c-a519-230e82a5afbf tempest-VolumesNegativeTest-1833921564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c164ccef-111e-47ff-a5af-4f2cdeeade18 1073741824" returned: 0 in 0.435s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a7d2cb9d-0aa3-400c-a519-230e82a5afbf tempest-VolumesNegativeTest-1833921564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c164ccef-111e-47ff-a5af-4f2cdeeade18 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:22 devstack sudo[97034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c164ccef-111e-47ff-a5af-4f2cdeeade18 Nov 02 12:32:22 devstack sudo[97034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:22 devstack sudo[97034]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a7d2cb9d-0aa3-400c-a519-230e82a5afbf tempest-VolumesNegativeTest-1833921564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c164ccef-111e-47ff-a5af-4f2cdeeade18" returned: 0 in 0.252s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:22 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a7d2cb9d-0aa3-400c-a519-230e82a5afbf tempest-VolumesNegativeTest-1833921564 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:32:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a7d2cb9d-0aa3-400c-a519-230e82a5afbf tempest-VolumesNegativeTest-1833921564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-903211d7-9372-4fb8-839e-1916496d0c9e tempest-VolumesExtendTest-1754247697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.522s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:22 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-903211d7-9372-4fb8-839e-1916496d0c9e tempest-VolumesExtendTest-1754247697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1518991622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=442a9100-aadf-4d75-bfd8-a1e1d4af453f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2759e2f7ce2443ecba10aef2574c0cbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:32:22Z,use_quota=True,user_id='7176237b84744a17b382f1ef5df58ed8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:32:22 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-903211d7-9372-4fb8-839e-1916496d0c9e tempest-VolumesExtendTest-1754247697 None] Creating volume 442a9100-aadf-4d75-bfd8-a1e1d4af453f {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:32:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-903211d7-9372-4fb8-839e-1916496d0c9e tempest-VolumesExtendTest-1754247697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-903211d7-9372-4fb8-839e-1916496d0c9e tempest-VolumesExtendTest-1754247697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:22 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-903211d7-9372-4fb8-839e-1916496d0c9e tempest-VolumesExtendTest-1754247697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:32:22 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-903211d7-9372-4fb8-839e-1916496d0c9e tempest-VolumesExtendTest-1754247697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:32:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-903211d7-9372-4fb8-839e-1916496d0c9e tempest-VolumesExtendTest-1754247697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:22 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-903211d7-9372-4fb8-839e-1916496d0c9e tempest-VolumesExtendTest-1754247697 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:32:22 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-903211d7-9372-4fb8-839e-1916496d0c9e tempest-VolumesExtendTest-1754247697 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:32:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-903211d7-9372-4fb8-839e-1916496d0c9e tempest-VolumesExtendTest-1754247697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:22 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a7d2cb9d-0aa3-400c-a519-230e82a5afbf tempest-VolumesNegativeTest-1833921564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c03f8fd9-b904-4a70-981f-62624f3b5b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c164ccef-111e-47ff-a5af-4f2cdeeade18', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:22 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a7d2cb9d-0aa3-400c-a519-230e82a5afbf tempest-VolumesNegativeTest-1833921564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d74fb09-e8c1-448a-9450-d406f880d22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:22 devstack sudo[97037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f 1073741824 Nov 02 12:32:22 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:22 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-a7d2cb9d-0aa3-400c-a519-230e82a5afbf tempest-VolumesNegativeTest-1833921564 None] Volume volume-c164ccef-111e-47ff-a5af-4f2cdeeade18 (c164ccef-111e-47ff-a5af-4f2cdeeade18): created successfully Nov 02 12:32:22 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a7d2cb9d-0aa3-400c-a519-230e82a5afbf tempest-VolumesNegativeTest-1833921564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d74fb09-e8c1-448a-9450-d406f880d22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:22 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a7d2cb9d-0aa3-400c-a519-230e82a5afbf tempest-VolumesNegativeTest-1833921564 None] Flow 'volume_create_manager' (8e86ffe5-4b5f-47d4-9eec-ff20d566df71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:32:22 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-a7d2cb9d-0aa3-400c-a519-230e82a5afbf tempest-VolumesNegativeTest-1833921564 None] Created volume successfully. Nov 02 12:32:22 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-903211d7-9372-4fb8-839e-1916496d0c9e tempest-VolumesExtendTest-1754247697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f 1073741824" returned: 0 in 0.437s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-903211d7-9372-4fb8-839e-1916496d0c9e tempest-VolumesExtendTest-1754247697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:22 devstack sudo[97042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f Nov 02 12:32:22 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:23 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-903211d7-9372-4fb8-839e-1916496d0c9e tempest-VolumesExtendTest-1754247697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f" returned: 0 in 0.243s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:23 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-903211d7-9372-4fb8-839e-1916496d0c9e tempest-VolumesExtendTest-1754247697 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:32:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-903211d7-9372-4fb8-839e-1916496d0c9e tempest-VolumesExtendTest-1754247697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:23 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-903211d7-9372-4fb8-839e-1916496d0c9e tempest-VolumesExtendTest-1754247697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae044f2f-0f56-4032-93d0-5dc682bfad82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:23 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-903211d7-9372-4fb8-839e-1916496d0c9e tempest-VolumesExtendTest-1754247697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99851e80-bcb2-464e-88df-b81aab9c2bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:23 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-903211d7-9372-4fb8-839e-1916496d0c9e tempest-VolumesExtendTest-1754247697 None] Volume volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f (442a9100-aadf-4d75-bfd8-a1e1d4af453f): created successfully Nov 02 12:32:23 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-903211d7-9372-4fb8-839e-1916496d0c9e tempest-VolumesExtendTest-1754247697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99851e80-bcb2-464e-88df-b81aab9c2bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:23 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-903211d7-9372-4fb8-839e-1916496d0c9e tempest-VolumesExtendTest-1754247697 None] Flow 'volume_create_manager' (04664268-4635-4323-baf5-cd0abdca4989) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:32:23 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-903211d7-9372-4fb8-839e-1916496d0c9e tempest-VolumesExtendTest-1754247697 None] Created volume successfully. Nov 02 12:32:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3e829c63-3c78-454f-8aae-efd590abb971 tempest-VolumesExtendTest-1754247697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3e829c63-3c78-454f-8aae-efd590abb971 tempest-VolumesExtendTest-1754247697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:24 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-3e829c63-3c78-454f-8aae-efd590abb971 tempest-VolumesExtendTest-1754247697 None] Creating offline snapshot 0a4da1dc-a7b2-47a9-939f-122499ade97a of volume 442a9100-aadf-4d75-bfd8-a1e1d4af453f {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:32:24 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[115680de-88ed-4dd5-bded-c27fc6e3f1df]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:32:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3e829c63-3c78-454f-8aae-efd590abb971 tempest-VolumesExtendTest-1754247697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:24 devstack sudo[97066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f Nov 02 12:32:24 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:24 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3e829c63-3c78-454f-8aae-efd590abb971 tempest-VolumesExtendTest-1754247697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f" returned: 0 in 0.427s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3e829c63-3c78-454f-8aae-efd590abb971 tempest-VolumesExtendTest-1754247697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f.0a4da1dc-a7b2-47a9-939f-122499ade97a 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:24 devstack sudo[97074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f.0a4da1dc-a7b2-47a9-939f-122499ade97a 1G Nov 02 12:32:24 devstack sudo[97074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:24 devstack sudo[97074]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3e829c63-3c78-454f-8aae-efd590abb971 tempest-VolumesExtendTest-1754247697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f.0a4da1dc-a7b2-47a9-939f-122499ade97a 1G" returned: 0 in 0.516s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3e829c63-3c78-454f-8aae-efd590abb971 tempest-VolumesExtendTest-1754247697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f.0a4da1dc-a7b2-47a9-939f-122499ade97a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:25 devstack sudo[97081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f.0a4da1dc-a7b2-47a9-939f-122499ade97a Nov 02 12:32:25 devstack sudo[97081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:25 devstack sudo[97081]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3e829c63-3c78-454f-8aae-efd590abb971 tempest-VolumesExtendTest-1754247697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f.0a4da1dc-a7b2-47a9-939f-122499ade97a" returned: 0 in 0.363s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:25 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-3e829c63-3c78-454f-8aae-efd590abb971 tempest-VolumesExtendTest-1754247697 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f.0a4da1dc-a7b2-47a9-939f-122499ade97a is being set with open permissions: ugo+rw Nov 02 12:32:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3e829c63-3c78-454f-8aae-efd590abb971 tempest-VolumesExtendTest-1754247697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f.0a4da1dc-a7b2-47a9-939f-122499ade97a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:25 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f.0a4da1dc-a7b2-47a9-939f-122499ade97a Nov 02 12:32:25 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:25 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3e829c63-3c78-454f-8aae-efd590abb971 tempest-VolumesExtendTest-1754247697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f.0a4da1dc-a7b2-47a9-939f-122499ade97a" returned: 0 in 0.286s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3e829c63-3c78-454f-8aae-efd590abb971 tempest-VolumesExtendTest-1754247697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:25 devstack sudo[97089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f.info Nov 02 12:32:25 devstack sudo[97089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:25 devstack sudo[97089]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3e829c63-3c78-454f-8aae-efd590abb971 tempest-VolumesExtendTest-1754247697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f.info" returned: 0 in 0.288s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:25 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-3e829c63-3c78-454f-8aae-efd590abb971 tempest-VolumesExtendTest-1754247697 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f.info is being set with open permissions: ugo+rw Nov 02 12:32:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3e829c63-3c78-454f-8aae-efd590abb971 tempest-VolumesExtendTest-1754247697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:26 devstack sudo[97096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f.info Nov 02 12:32:26 devstack sudo[97096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:26 devstack sudo[97096]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3e829c63-3c78-454f-8aae-efd590abb971 tempest-VolumesExtendTest-1754247697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f.info" returned: 0 in 0.314s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3e829c63-3c78-454f-8aae-efd590abb971 tempest-VolumesExtendTest-1754247697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.315s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:26 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-3e829c63-3c78-454f-8aae-efd590abb971 tempest-VolumesExtendTest-1754247697 None] Create snapshot completed successfully Nov 02 12:32:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d3a847ad-e426-49ad-86cb-8fbcb228d60b tempest-VolumesExtendTest-1754247697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d3a847ad-e426-49ad-86cb-8fbcb228d60b tempest-VolumesExtendTest-1754247697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:27 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09f8db2-3946-4956-95b5-fe8945f0ed8a]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:32:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d3a847ad-e426-49ad-86cb-8fbcb228d60b tempest-VolumesExtendTest-1754247697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:27 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f Nov 02 12:32:27 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:27 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d3a847ad-e426-49ad-86cb-8fbcb228d60b tempest-VolumesExtendTest-1754247697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f" returned: 0 in 0.446s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d3a847ad-e426-49ad-86cb-8fbcb228d60b tempest-VolumesExtendTest-1754247697 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f.0a4da1dc-a7b2-47a9-939f-122499ade97a 2G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d3a847ad-e426-49ad-86cb-8fbcb228d60b tempest-VolumesExtendTest-1754247697 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f.0a4da1dc-a7b2-47a9-939f-122499ade97a 2G" returned: 0 in 0.158s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d3a847ad-e426-49ad-86cb-8fbcb228d60b tempest-VolumesExtendTest-1754247697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.646s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:27 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-d3a847ad-e426-49ad-86cb-8fbcb228d60b tempest-VolumesExtendTest-1754247697 None] Extend volume completed successfully. Nov 02 12:32:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c00a8962-9a72-446d-9224-853e43d73d92 tempest-VolumesExtendTest-1754247697 None] Acquiring lock "cinder-0a4da1dc-a7b2-47a9-939f-122499ade97a-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:32:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c00a8962-9a72-446d-9224-853e43d73d92 tempest-VolumesExtendTest-1754247697 None] Lock "cinder-0a4da1dc-a7b2-47a9-939f-122499ade97a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:32:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c00a8962-9a72-446d-9224-853e43d73d92 tempest-VolumesExtendTest-1754247697 None] Acquiring lock "cinder-quobyte-442a9100-aadf-4d75-bfd8-a1e1d4af453f" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:32:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c00a8962-9a72-446d-9224-853e43d73d92 tempest-VolumesExtendTest-1754247697 None] Lock "cinder-quobyte-442a9100-aadf-4d75-bfd8-a1e1d4af453f" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:32:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c00a8962-9a72-446d-9224-853e43d73d92 tempest-VolumesExtendTest-1754247697 None] Acquiring lock "cinder-quobyte-0a4da1dc-a7b2-47a9-939f-122499ade97a" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:32:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c00a8962-9a72-446d-9224-853e43d73d92 tempest-VolumesExtendTest-1754247697 None] Lock "cinder-quobyte-0a4da1dc-a7b2-47a9-939f-122499ade97a" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:32:28 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-c00a8962-9a72-446d-9224-853e43d73d92 tempest-VolumesExtendTest-1754247697 None] Deleting offline snapshot 0a4da1dc-a7b2-47a9-939f-122499ade97a of volume 442a9100-aadf-4d75-bfd8-a1e1d4af453f {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:32:28 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-c00a8962-9a72-446d-9224-853e43d73d92 tempest-VolumesExtendTest-1754247697 None] snapshot_file for this snap is: volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f.0a4da1dc-a7b2-47a9-939f-122499ade97a {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:32:28 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[69706856-2b70-48e6-9ccd-fe92c196c006]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:32:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c00a8962-9a72-446d-9224-853e43d73d92 tempest-VolumesExtendTest-1754247697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f.0a4da1dc-a7b2-47a9-939f-122499ade97a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:28 devstack sudo[97152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f.0a4da1dc-a7b2-47a9-939f-122499ade97a Nov 02 12:32:28 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:29 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c00a8962-9a72-446d-9224-853e43d73d92 tempest-VolumesExtendTest-1754247697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f.0a4da1dc-a7b2-47a9-939f-122499ade97a" returned: 0 in 0.594s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:29 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-c00a8962-9a72-446d-9224-853e43d73d92 tempest-VolumesExtendTest-1754247697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:32:29 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03756e9-562c-4f21-a319-119ceb02be11]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:32:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c00a8962-9a72-446d-9224-853e43d73d92 tempest-VolumesExtendTest-1754247697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:29 devstack sudo[97186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f Nov 02 12:32:29 devstack sudo[97186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:29 devstack sudo[97186]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c00a8962-9a72-446d-9224-853e43d73d92 tempest-VolumesExtendTest-1754247697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f" returned: 0 in 0.511s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c00a8962-9a72-446d-9224-853e43d73d92 tempest-VolumesExtendTest-1754247697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f.0a4da1dc-a7b2-47a9-939f-122499ade97a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:29 devstack sudo[97196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f.0a4da1dc-a7b2-47a9-939f-122499ade97a Nov 02 12:32:29 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:30 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c00a8962-9a72-446d-9224-853e43d73d92 tempest-VolumesExtendTest-1754247697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f.0a4da1dc-a7b2-47a9-939f-122499ade97a" returned: 0 in 0.620s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c00a8962-9a72-446d-9224-853e43d73d92 tempest-VolumesExtendTest-1754247697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f.0a4da1dc-a7b2-47a9-939f-122499ade97a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:30 devstack sudo[97204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f.0a4da1dc-a7b2-47a9-939f-122499ade97a Nov 02 12:32:30 devstack sudo[97204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:30 devstack sudo[97204]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c00a8962-9a72-446d-9224-853e43d73d92 tempest-VolumesExtendTest-1754247697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f.0a4da1dc-a7b2-47a9-939f-122499ade97a" returned: 0 in 0.285s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:30 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c00a8962-9a72-446d-9224-853e43d73d92 tempest-VolumesExtendTest-1754247697 None] Lock "cinder-quobyte-0a4da1dc-a7b2-47a9-939f-122499ade97a" released by "_delete_snapshot" :: held 2.226s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:32:30 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c00a8962-9a72-446d-9224-853e43d73d92 tempest-VolumesExtendTest-1754247697 None] Lock "cinder-quobyte-442a9100-aadf-4d75-bfd8-a1e1d4af453f" released by "delete_snapshot" :: held 2.292s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:32:30 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-c00a8962-9a72-446d-9224-853e43d73d92 tempest-VolumesExtendTest-1754247697 None] Created reservations ['df833354-4055-47aa-a707-497db3a025be', 'dd2bd1d6-3c2d-4d62-81b0-948f2b3d834d', 'eb49a8f9-9dda-4458-9fb2-6a53cc7f894f', 'c35cdc79-3415-4afa-b011-36ffa985df1c'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:32:31 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-c00a8962-9a72-446d-9224-853e43d73d92 tempest-VolumesExtendTest-1754247697 None] Delete snapshot completed successfully. Nov 02 12:32:31 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c00a8962-9a72-446d-9224-853e43d73d92 tempest-VolumesExtendTest-1754247697 None] Lock "cinder-0a4da1dc-a7b2-47a9-939f-122499ade97a-delete_snapshot" released by "delete_snapshot" :: held 2.472s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:32:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-28dd417c-99ea-4579-a96d-21b0136c7908 tempest-VolumesExtendTest-1754247697 None] Acquiring lock "cinder-442a9100-aadf-4d75-bfd8-a1e1d4af453f-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:32:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-28dd417c-99ea-4579-a96d-21b0136c7908 tempest-VolumesExtendTest-1754247697 None] Lock "cinder-442a9100-aadf-4d75-bfd8-a1e1d4af453f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:32:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-28dd417c-99ea-4579-a96d-21b0136c7908 tempest-VolumesExtendTest-1754247697 None] Acquiring lock "cinder-quobyte-442a9100-aadf-4d75-bfd8-a1e1d4af453f" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:32:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-28dd417c-99ea-4579-a96d-21b0136c7908 tempest-VolumesExtendTest-1754247697 None] Lock "cinder-quobyte-442a9100-aadf-4d75-bfd8-a1e1d4af453f" acquired by "delete_volume" :: waited 0.019s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:32:32 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[85283538-d4bf-44a1-8bb3-5b775b431176]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:32:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-28dd417c-99ea-4579-a96d-21b0136c7908 tempest-VolumesExtendTest-1754247697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:32 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f Nov 02 12:32:32 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:32 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-28dd417c-99ea-4579-a96d-21b0136c7908 tempest-VolumesExtendTest-1754247697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f" returned: 0 in 0.532s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-28dd417c-99ea-4579-a96d-21b0136c7908 tempest-VolumesExtendTest-1754247697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:32 devstack sudo[97232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f Nov 02 12:32:32 devstack sudo[97232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:33 devstack sudo[97232]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-28dd417c-99ea-4579-a96d-21b0136c7908 tempest-VolumesExtendTest-1754247697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-442a9100-aadf-4d75-bfd8-a1e1d4af453f" returned: 0 in 0.442s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-28dd417c-99ea-4579-a96d-21b0136c7908 tempest-VolumesExtendTest-1754247697 None] Lock "cinder-quobyte-442a9100-aadf-4d75-bfd8-a1e1d4af453f" released by "delete_volume" :: held 1.076s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:32:33 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-28dd417c-99ea-4579-a96d-21b0136c7908 tempest-VolumesExtendTest-1754247697 None] Created reservations ['d6e3a68d-de98-4150-89a5-11cd1f241b1d', '6237cf37-ffc8-4f93-ae80-177c2f4a0fde', '44b5d623-d92f-4e6d-8994-da2ddda3ad76', 'c5477ee3-b39b-4408-9a59-54520c53eec5'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:32:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-28dd417c-99ea-4579-a96d-21b0136c7908 tempest-VolumesExtendTest-1754247697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-28dd417c-99ea-4579-a96d-21b0136c7908 tempest-VolumesExtendTest-1754247697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-28dd417c-99ea-4579-a96d-21b0136c7908 tempest-VolumesExtendTest-1754247697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:32:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-28dd417c-99ea-4579-a96d-21b0136c7908 tempest-VolumesExtendTest-1754247697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:32:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-28dd417c-99ea-4579-a96d-21b0136c7908 tempest-VolumesExtendTest-1754247697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-28dd417c-99ea-4579-a96d-21b0136c7908 tempest-VolumesExtendTest-1754247697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:33 devstack sudo[97238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:32:33 devstack sudo[97238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:33 devstack sudo[97238]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-28dd417c-99ea-4579-a96d-21b0136c7908 tempest-VolumesExtendTest-1754247697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.287s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:33 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-28dd417c-99ea-4579-a96d-21b0136c7908 tempest-VolumesExtendTest-1754247697 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:32:33 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-28dd417c-99ea-4579-a96d-21b0136c7908 tempest-VolumesExtendTest-1754247697 None] Deleted volume successfully. Nov 02 12:32:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-28dd417c-99ea-4579-a96d-21b0136c7908 tempest-VolumesExtendTest-1754247697 None] Lock "cinder-442a9100-aadf-4d75-bfd8-a1e1d4af453f-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:32:34 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-50cec784-c227-4ce1-b5cf-fe4f8fc93cda tempest-AttachVolumeNegativeTest-1281562092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:32:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-50cec784-c227-4ce1-b5cf-fe4f8fc93cda tempest-AttachVolumeNegativeTest-1281562092 None] Flow 'volume_create_manager' (cf7a377a-106b-46a1-8c02-64652cbd37f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:32:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-50cec784-c227-4ce1-b5cf-fe4f8fc93cda tempest-AttachVolumeNegativeTest-1281562092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9339a12d-f1a4-4d35-ae8a-605b6e502bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-50cec784-c227-4ce1-b5cf-fe4f8fc93cda tempest-AttachVolumeNegativeTest-1281562092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9339a12d-f1a4-4d35-ae8a-605b6e502bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-36902754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3765bb31-74da-4040-9e38-790e569bf7a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9c7d8a596348cdbef96a1243897c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:32:34Z,use_quota=True,user_id='7a7a7fce4a9b4e0fa44b300004914ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-50cec784-c227-4ce1-b5cf-fe4f8fc93cda tempest-AttachVolumeNegativeTest-1281562092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ff196d-40a2-48c5-801f-3120d13591a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-50cec784-c227-4ce1-b5cf-fe4f8fc93cda tempest-AttachVolumeNegativeTest-1281562092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ff196d-40a2-48c5-801f-3120d13591a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-50cec784-c227-4ce1-b5cf-fe4f8fc93cda tempest-AttachVolumeNegativeTest-1281562092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a82cd8b-f533-4852-912e-88e6e4d9f0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-50cec784-c227-4ce1-b5cf-fe4f8fc93cda tempest-AttachVolumeNegativeTest-1281562092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a82cd8b-f533-4852-912e-88e6e4d9f0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3765bb31-74da-4040-9e38-790e569bf7a9', 'volume_name': 'volume-3765bb31-74da-4040-9e38-790e569bf7a9', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-50cec784-c227-4ce1-b5cf-fe4f8fc93cda tempest-AttachVolumeNegativeTest-1281562092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f84f5e25-5a0b-49a5-a185-5b1b641803f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-50cec784-c227-4ce1-b5cf-fe4f8fc93cda tempest-AttachVolumeNegativeTest-1281562092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f84f5e25-5a0b-49a5-a185-5b1b641803f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-50cec784-c227-4ce1-b5cf-fe4f8fc93cda tempest-AttachVolumeNegativeTest-1281562092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e4a2e82-e1b6-4018-bfa9-dc438aff2e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:34 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-50cec784-c227-4ce1-b5cf-fe4f8fc93cda tempest-AttachVolumeNegativeTest-1281562092 None] Volume 3765bb31-74da-4040-9e38-790e569bf7a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3765bb31-74da-4040-9e38-790e569bf7a9', 'volume_size': 1} Nov 02 12:32:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-50cec784-c227-4ce1-b5cf-fe4f8fc93cda tempest-AttachVolumeNegativeTest-1281562092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-50cec784-c227-4ce1-b5cf-fe4f8fc93cda tempest-AttachVolumeNegativeTest-1281562092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-50cec784-c227-4ce1-b5cf-fe4f8fc93cda tempest-AttachVolumeNegativeTest-1281562092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-36902754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3765bb31-74da-4040-9e38-790e569bf7a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9c7d8a596348cdbef96a1243897c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:32:34Z,use_quota=True,user_id='7a7a7fce4a9b4e0fa44b300004914ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:32:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-50cec784-c227-4ce1-b5cf-fe4f8fc93cda tempest-AttachVolumeNegativeTest-1281562092 None] Creating volume 3765bb31-74da-4040-9e38-790e569bf7a9 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:32:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-50cec784-c227-4ce1-b5cf-fe4f8fc93cda tempest-AttachVolumeNegativeTest-1281562092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-50cec784-c227-4ce1-b5cf-fe4f8fc93cda tempest-AttachVolumeNegativeTest-1281562092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-50cec784-c227-4ce1-b5cf-fe4f8fc93cda tempest-AttachVolumeNegativeTest-1281562092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:32:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-50cec784-c227-4ce1-b5cf-fe4f8fc93cda tempest-AttachVolumeNegativeTest-1281562092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:32:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-50cec784-c227-4ce1-b5cf-fe4f8fc93cda tempest-AttachVolumeNegativeTest-1281562092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-50cec784-c227-4ce1-b5cf-fe4f8fc93cda tempest-AttachVolumeNegativeTest-1281562092 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:32:34 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-50cec784-c227-4ce1-b5cf-fe4f8fc93cda tempest-AttachVolumeNegativeTest-1281562092 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:32:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-50cec784-c227-4ce1-b5cf-fe4f8fc93cda tempest-AttachVolumeNegativeTest-1281562092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3765bb31-74da-4040-9e38-790e569bf7a9 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:34 devstack sudo[97243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3765bb31-74da-4040-9e38-790e569bf7a9 1073741824 Nov 02 12:32:34 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:35 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-50cec784-c227-4ce1-b5cf-fe4f8fc93cda tempest-AttachVolumeNegativeTest-1281562092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3765bb31-74da-4040-9e38-790e569bf7a9 1073741824" returned: 0 in 0.532s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-50cec784-c227-4ce1-b5cf-fe4f8fc93cda tempest-AttachVolumeNegativeTest-1281562092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3765bb31-74da-4040-9e38-790e569bf7a9 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:35 devstack sudo[97249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3765bb31-74da-4040-9e38-790e569bf7a9 Nov 02 12:32:35 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:35 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-50cec784-c227-4ce1-b5cf-fe4f8fc93cda tempest-AttachVolumeNegativeTest-1281562092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3765bb31-74da-4040-9e38-790e569bf7a9" returned: 0 in 0.320s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:35 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-50cec784-c227-4ce1-b5cf-fe4f8fc93cda tempest-AttachVolumeNegativeTest-1281562092 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:32:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-50cec784-c227-4ce1-b5cf-fe4f8fc93cda tempest-AttachVolumeNegativeTest-1281562092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:35 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-50cec784-c227-4ce1-b5cf-fe4f8fc93cda tempest-AttachVolumeNegativeTest-1281562092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e4a2e82-e1b6-4018-bfa9-dc438aff2e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3765bb31-74da-4040-9e38-790e569bf7a9', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:35 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-50cec784-c227-4ce1-b5cf-fe4f8fc93cda tempest-AttachVolumeNegativeTest-1281562092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a443b9-e4d3-4979-9e04-0294d8379566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:35 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-50cec784-c227-4ce1-b5cf-fe4f8fc93cda tempest-AttachVolumeNegativeTest-1281562092 None] Volume volume-3765bb31-74da-4040-9e38-790e569bf7a9 (3765bb31-74da-4040-9e38-790e569bf7a9): created successfully Nov 02 12:32:35 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-50cec784-c227-4ce1-b5cf-fe4f8fc93cda tempest-AttachVolumeNegativeTest-1281562092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a443b9-e4d3-4979-9e04-0294d8379566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:35 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-50cec784-c227-4ce1-b5cf-fe4f8fc93cda tempest-AttachVolumeNegativeTest-1281562092 None] Flow 'volume_create_manager' (cf7a377a-106b-46a1-8c02-64652cbd37f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:32:35 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-50cec784-c227-4ce1-b5cf-fe4f8fc93cda tempest-AttachVolumeNegativeTest-1281562092 None] Created volume successfully. Nov 02 12:32:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-c98a922c-7120-4cb3-bcff-9ae1750702a1 req-f2069692-c409-424e-85fa-6da62270c600 tempest-AttachVolumeNegativeTest-1281562092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-c98a922c-7120-4cb3-bcff-9ae1750702a1 req-f2069692-c409-424e-85fa-6da62270c600 tempest-AttachVolumeNegativeTest-1281562092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-c98a922c-7120-4cb3-bcff-9ae1750702a1 req-f2069692-c409-424e-85fa-6da62270c600 tempest-AttachVolumeNegativeTest-1281562092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-c98a922c-7120-4cb3-bcff-9ae1750702a1 req-f2069692-c409-424e-85fa-6da62270c600 tempest-AttachVolumeNegativeTest-1281562092 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae', 'name': 'volume-3765bb31-74da-4040-9e38-790e569bf7a9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fd3a9942-9055-42a7-b388-3b4915a6e3e9', 'enforce_multipath': True} {{(pid=86515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:32:37 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-c98a922c-7120-4cb3-bcff-9ae1750702a1 req-f2069692-c409-424e-85fa-6da62270c600 tempest-AttachVolumeNegativeTest-1281562092 None] attachment_update completed successfully. Nov 02 12:32:38 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6b46d4c-2437-442e-bc98-a7c4db5753ab tempest-VolumesGetTest-46404158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:32:38 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f6b46d4c-2437-442e-bc98-a7c4db5753ab tempest-VolumesGetTest-46404158 None] Flow 'volume_create_manager' (2e3036f3-17e6-4014-810d-06fbf04810b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:32:38 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f6b46d4c-2437-442e-bc98-a7c4db5753ab tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2531c3aa-e14d-4299-9c25-76b6442d946b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:38 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f6b46d4c-2437-442e-bc98-a7c4db5753ab tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2531c3aa-e14d-4299-9c25-76b6442d946b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1197703683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c008d4f2-f3e8-404d-b973-fe88de6103aa,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0f767ab595024bab992b0a3110ac694b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:32:39Z,use_quota=True,user_id='4a860355a6644529af2302fae112bdfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:38 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f6b46d4c-2437-442e-bc98-a7c4db5753ab tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cadd8fd-b63e-4e42-920e-3c40b797b110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:38 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f6b46d4c-2437-442e-bc98-a7c4db5753ab tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cadd8fd-b63e-4e42-920e-3c40b797b110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:38 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f6b46d4c-2437-442e-bc98-a7c4db5753ab tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (425f0d7d-44f1-4aa0-8292-0f76967a741d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:38 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f6b46d4c-2437-442e-bc98-a7c4db5753ab tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (425f0d7d-44f1-4aa0-8292-0f76967a741d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c008d4f2-f3e8-404d-b973-fe88de6103aa', 'volume_name': 'volume-c008d4f2-f3e8-404d-b973-fe88de6103aa', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:38 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f6b46d4c-2437-442e-bc98-a7c4db5753ab tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e57cee47-3528-42a9-9716-a3bffcc6b115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:38 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f6b46d4c-2437-442e-bc98-a7c4db5753ab tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e57cee47-3528-42a9-9716-a3bffcc6b115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:38 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f6b46d4c-2437-442e-bc98-a7c4db5753ab tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b295237-e85b-4b38-98d0-59375d6a64d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:38 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-f6b46d4c-2437-442e-bc98-a7c4db5753ab tempest-VolumesGetTest-46404158 None] Volume c008d4f2-f3e8-404d-b973-fe88de6103aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c008d4f2-f3e8-404d-b973-fe88de6103aa', 'volume_size': 1} Nov 02 12:32:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f6b46d4c-2437-442e-bc98-a7c4db5753ab tempest-VolumesGetTest-46404158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f6b46d4c-2437-442e-bc98-a7c4db5753ab tempest-VolumesGetTest-46404158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:38 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f6b46d4c-2437-442e-bc98-a7c4db5753ab tempest-VolumesGetTest-46404158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1197703683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c008d4f2-f3e8-404d-b973-fe88de6103aa,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0f767ab595024bab992b0a3110ac694b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:32:39Z,use_quota=True,user_id='4a860355a6644529af2302fae112bdfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:32:38 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-f6b46d4c-2437-442e-bc98-a7c4db5753ab tempest-VolumesGetTest-46404158 None] Creating volume c008d4f2-f3e8-404d-b973-fe88de6103aa {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:32:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f6b46d4c-2437-442e-bc98-a7c4db5753ab tempest-VolumesGetTest-46404158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f6b46d4c-2437-442e-bc98-a7c4db5753ab tempest-VolumesGetTest-46404158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:38 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f6b46d4c-2437-442e-bc98-a7c4db5753ab tempest-VolumesGetTest-46404158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:32:38 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f6b46d4c-2437-442e-bc98-a7c4db5753ab tempest-VolumesGetTest-46404158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:32:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f6b46d4c-2437-442e-bc98-a7c4db5753ab tempest-VolumesGetTest-46404158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:38 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f6b46d4c-2437-442e-bc98-a7c4db5753ab tempest-VolumesGetTest-46404158 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:32:38 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-f6b46d4c-2437-442e-bc98-a7c4db5753ab tempest-VolumesGetTest-46404158 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:32:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f6b46d4c-2437-442e-bc98-a7c4db5753ab tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c008d4f2-f3e8-404d-b973-fe88de6103aa 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:38 devstack sudo[97716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c008d4f2-f3e8-404d-b973-fe88de6103aa 1073741824 Nov 02 12:32:38 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:39 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f6b46d4c-2437-442e-bc98-a7c4db5753ab tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c008d4f2-f3e8-404d-b973-fe88de6103aa 1073741824" returned: 0 in 0.501s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f6b46d4c-2437-442e-bc98-a7c4db5753ab tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c008d4f2-f3e8-404d-b973-fe88de6103aa {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:39 devstack sudo[97722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c008d4f2-f3e8-404d-b973-fe88de6103aa Nov 02 12:32:39 devstack sudo[97722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:39 devstack sudo[97722]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f6b46d4c-2437-442e-bc98-a7c4db5753ab tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c008d4f2-f3e8-404d-b973-fe88de6103aa" returned: 0 in 0.255s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:39 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f6b46d4c-2437-442e-bc98-a7c4db5753ab tempest-VolumesGetTest-46404158 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:32:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f6b46d4c-2437-442e-bc98-a7c4db5753ab tempest-VolumesGetTest-46404158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f6b46d4c-2437-442e-bc98-a7c4db5753ab tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b295237-e85b-4b38-98d0-59375d6a64d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c008d4f2-f3e8-404d-b973-fe88de6103aa', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f6b46d4c-2437-442e-bc98-a7c4db5753ab tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e2f09c9-972b-43e9-8ec9-f16086867ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:39 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-f6b46d4c-2437-442e-bc98-a7c4db5753ab tempest-VolumesGetTest-46404158 None] Volume volume-c008d4f2-f3e8-404d-b973-fe88de6103aa (c008d4f2-f3e8-404d-b973-fe88de6103aa): created successfully Nov 02 12:32:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f6b46d4c-2437-442e-bc98-a7c4db5753ab tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e2f09c9-972b-43e9-8ec9-f16086867ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f6b46d4c-2437-442e-bc98-a7c4db5753ab tempest-VolumesGetTest-46404158 None] Flow 'volume_create_manager' (2e3036f3-17e6-4014-810d-06fbf04810b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:32:39 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-f6b46d4c-2437-442e-bc98-a7c4db5753ab tempest-VolumesGetTest-46404158 None] Created volume successfully. Nov 02 12:32:41 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a452aa9d-c3e6-47e5-914a-f50e83bd0eb5 tempest-VolumesNegativeTest-1833921564 None] Acquiring lock "cinder-c164ccef-111e-47ff-a5af-4f2cdeeade18-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:32:41 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a452aa9d-c3e6-47e5-914a-f50e83bd0eb5 tempest-VolumesNegativeTest-1833921564 None] Lock "cinder-c164ccef-111e-47ff-a5af-4f2cdeeade18-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:32:41 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a452aa9d-c3e6-47e5-914a-f50e83bd0eb5 tempest-VolumesNegativeTest-1833921564 None] Acquiring lock "cinder-quobyte-c164ccef-111e-47ff-a5af-4f2cdeeade18" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:32:41 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a452aa9d-c3e6-47e5-914a-f50e83bd0eb5 tempest-VolumesNegativeTest-1833921564 None] Lock "cinder-quobyte-c164ccef-111e-47ff-a5af-4f2cdeeade18" acquired by "delete_volume" :: waited 0.020s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:32:41 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[827d8680-d0b6-48b2-900d-afe0f6b019f4]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:32:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a452aa9d-c3e6-47e5-914a-f50e83bd0eb5 tempest-VolumesNegativeTest-1833921564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c164ccef-111e-47ff-a5af-4f2cdeeade18 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:41 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d2d8e16-bfa6-4331-9166-2a5bd4bcb493 tempest-VolumesGetTest-46404158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:32:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3d2d8e16-bfa6-4331-9166-2a5bd4bcb493 tempest-VolumesGetTest-46404158 None] Flow 'volume_create_manager' (1c0e876c-e8e8-4559-b98a-d25c5032a727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:32:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3d2d8e16-bfa6-4331-9166-2a5bd4bcb493 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eed7a27-a108-4501-8d40-b2133a74637d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3d2d8e16-bfa6-4331-9166-2a5bd4bcb493 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eed7a27-a108-4501-8d40-b2133a74637d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:32:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-128281180',display_name='tempest-VolumesGetTest-Volume-1879075330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2418d801-2c01-4e18-85d4-7ece4252783d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f767ab595024bab992b0a3110ac694b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:32:42Z,use_quota=True,user_id='4a860355a6644529af2302fae112bdfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3d2d8e16-bfa6-4331-9166-2a5bd4bcb493 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f796655-8d5e-4bfa-aa72-066390191cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3d2d8e16-bfa6-4331-9166-2a5bd4bcb493 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f796655-8d5e-4bfa-aa72-066390191cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3d2d8e16-bfa6-4331-9166-2a5bd4bcb493 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5b7f19b-4b4b-4c50-94b8-069865c0c35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3d2d8e16-bfa6-4331-9166-2a5bd4bcb493 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5b7f19b-4b4b-4c50-94b8-069865c0c35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2418d801-2c01-4e18-85d4-7ece4252783d', 'volume_name': 'volume-2418d801-2c01-4e18-85d4-7ece4252783d', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:41 devstack sudo[97726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c164ccef-111e-47ff-a5af-4f2cdeeade18 Nov 02 12:32:41 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3d2d8e16-bfa6-4331-9166-2a5bd4bcb493 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9737802-94ec-499a-aa80-819868a1dede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3d2d8e16-bfa6-4331-9166-2a5bd4bcb493 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9737802-94ec-499a-aa80-819868a1dede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3d2d8e16-bfa6-4331-9166-2a5bd4bcb493 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52c4d1b5-3ec7-433a-a488-c0681cf44957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:41 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-3d2d8e16-bfa6-4331-9166-2a5bd4bcb493 tempest-VolumesGetTest-46404158 None] Volume 2418d801-2c01-4e18-85d4-7ece4252783d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2418d801-2c01-4e18-85d4-7ece4252783d', 'volume_size': 1} Nov 02 12:32:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3d2d8e16-bfa6-4331-9166-2a5bd4bcb493 tempest-VolumesGetTest-46404158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3d2d8e16-bfa6-4331-9166-2a5bd4bcb493 tempest-VolumesGetTest-46404158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:41 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3d2d8e16-bfa6-4331-9166-2a5bd4bcb493 tempest-VolumesGetTest-46404158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:32:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-128281180',display_name='tempest-VolumesGetTest-Volume-1879075330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2418d801-2c01-4e18-85d4-7ece4252783d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f767ab595024bab992b0a3110ac694b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:32:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:32:42Z,use_quota=True,user_id='4a860355a6644529af2302fae112bdfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:32:41 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-3d2d8e16-bfa6-4331-9166-2a5bd4bcb493 tempest-VolumesGetTest-46404158 None] Creating volume 2418d801-2c01-4e18-85d4-7ece4252783d {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:32:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3d2d8e16-bfa6-4331-9166-2a5bd4bcb493 tempest-VolumesGetTest-46404158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3d2d8e16-bfa6-4331-9166-2a5bd4bcb493 tempest-VolumesGetTest-46404158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:41 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3d2d8e16-bfa6-4331-9166-2a5bd4bcb493 tempest-VolumesGetTest-46404158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:32:41 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3d2d8e16-bfa6-4331-9166-2a5bd4bcb493 tempest-VolumesGetTest-46404158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:32:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3d2d8e16-bfa6-4331-9166-2a5bd4bcb493 tempest-VolumesGetTest-46404158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:41 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3d2d8e16-bfa6-4331-9166-2a5bd4bcb493 tempest-VolumesGetTest-46404158 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:32:41 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-3d2d8e16-bfa6-4331-9166-2a5bd4bcb493 tempest-VolumesGetTest-46404158 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:32:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3d2d8e16-bfa6-4331-9166-2a5bd4bcb493 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2418d801-2c01-4e18-85d4-7ece4252783d 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:41 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2418d801-2c01-4e18-85d4-7ece4252783d 1073741824 Nov 02 12:32:41 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:42 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a452aa9d-c3e6-47e5-914a-f50e83bd0eb5 tempest-VolumesNegativeTest-1833921564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c164ccef-111e-47ff-a5af-4f2cdeeade18" returned: 0 in 0.401s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a452aa9d-c3e6-47e5-914a-f50e83bd0eb5 tempest-VolumesNegativeTest-1833921564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c164ccef-111e-47ff-a5af-4f2cdeeade18 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:42 devstack sudo[97737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c164ccef-111e-47ff-a5af-4f2cdeeade18 Nov 02 12:32:42 devstack sudo[97737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:42 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3d2d8e16-bfa6-4331-9166-2a5bd4bcb493 tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2418d801-2c01-4e18-85d4-7ece4252783d 1073741824" returned: 0 in 0.516s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3d2d8e16-bfa6-4331-9166-2a5bd4bcb493 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2418d801-2c01-4e18-85d4-7ece4252783d {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:42 devstack sudo[97737]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a452aa9d-c3e6-47e5-914a-f50e83bd0eb5 tempest-VolumesNegativeTest-1833921564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c164ccef-111e-47ff-a5af-4f2cdeeade18" returned: 0 in 0.316s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:42 devstack sudo[97741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2418d801-2c01-4e18-85d4-7ece4252783d Nov 02 12:32:42 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:42 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a452aa9d-c3e6-47e5-914a-f50e83bd0eb5 tempest-VolumesNegativeTest-1833921564 None] Lock "cinder-quobyte-c164ccef-111e-47ff-a5af-4f2cdeeade18" released by "delete_volume" :: held 0.771s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:32:42 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-a452aa9d-c3e6-47e5-914a-f50e83bd0eb5 tempest-VolumesNegativeTest-1833921564 None] Created reservations ['bd4bd8eb-d92b-45b4-95ce-15abaf7385c3', 'ecc8887a-e04a-4131-a07d-11ecf64a5c35', '195de4f0-6a0b-4fb9-b2f7-0631e2697f3f', 'a2d5cf13-65c1-408a-8c80-4773d662a2fc'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:32:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a452aa9d-c3e6-47e5-914a-f50e83bd0eb5 tempest-VolumesNegativeTest-1833921564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a452aa9d-c3e6-47e5-914a-f50e83bd0eb5 tempest-VolumesNegativeTest-1833921564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:42 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a452aa9d-c3e6-47e5-914a-f50e83bd0eb5 tempest-VolumesNegativeTest-1833921564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:32:42 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a452aa9d-c3e6-47e5-914a-f50e83bd0eb5 tempest-VolumesNegativeTest-1833921564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:32:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a452aa9d-c3e6-47e5-914a-f50e83bd0eb5 tempest-VolumesNegativeTest-1833921564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a452aa9d-c3e6-47e5-914a-f50e83bd0eb5 tempest-VolumesNegativeTest-1833921564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:42 devstack sudo[97744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:32:42 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:42 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3d2d8e16-bfa6-4331-9166-2a5bd4bcb493 tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2418d801-2c01-4e18-85d4-7ece4252783d" returned: 0 in 0.293s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:42 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3d2d8e16-bfa6-4331-9166-2a5bd4bcb493 tempest-VolumesGetTest-46404158 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:32:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3d2d8e16-bfa6-4331-9166-2a5bd4bcb493 tempest-VolumesGetTest-46404158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3d2d8e16-bfa6-4331-9166-2a5bd4bcb493 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52c4d1b5-3ec7-433a-a488-c0681cf44957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2418d801-2c01-4e18-85d4-7ece4252783d', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3d2d8e16-bfa6-4331-9166-2a5bd4bcb493 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b44d28a-cad1-408d-8fe0-dc66d88b4657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:42 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-3d2d8e16-bfa6-4331-9166-2a5bd4bcb493 tempest-VolumesGetTest-46404158 None] Volume volume-2418d801-2c01-4e18-85d4-7ece4252783d (2418d801-2c01-4e18-85d4-7ece4252783d): created successfully Nov 02 12:32:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3d2d8e16-bfa6-4331-9166-2a5bd4bcb493 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b44d28a-cad1-408d-8fe0-dc66d88b4657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:42 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3d2d8e16-bfa6-4331-9166-2a5bd4bcb493 tempest-VolumesGetTest-46404158 None] Flow 'volume_create_manager' (1c0e876c-e8e8-4559-b98a-d25c5032a727) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:32:42 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-3d2d8e16-bfa6-4331-9166-2a5bd4bcb493 tempest-VolumesGetTest-46404158 None] Created volume successfully. Nov 02 12:32:42 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a452aa9d-c3e6-47e5-914a-f50e83bd0eb5 tempest-VolumesNegativeTest-1833921564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.279s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:42 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-a452aa9d-c3e6-47e5-914a-f50e83bd0eb5 tempest-VolumesNegativeTest-1833921564 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:32:42 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-a452aa9d-c3e6-47e5-914a-f50e83bd0eb5 tempest-VolumesNegativeTest-1833921564 None] Deleted volume successfully. Nov 02 12:32:42 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a452aa9d-c3e6-47e5-914a-f50e83bd0eb5 tempest-VolumesNegativeTest-1833921564 None] Lock "cinder-c164ccef-111e-47ff-a5af-4f2cdeeade18-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:32:43 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:32:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:32:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:32:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:43 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:32:43 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:43 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-536e6af7-a828-48cc-81b0-0c473f7106f4 tempest-VolumesGetTest-46404158 None] Acquiring lock "cinder-2418d801-2c01-4e18-85d4-7ece4252783d-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:32:43 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-536e6af7-a828-48cc-81b0-0c473f7106f4 tempest-VolumesGetTest-46404158 None] Lock "cinder-2418d801-2c01-4e18-85d4-7ece4252783d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:32:44 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-536e6af7-a828-48cc-81b0-0c473f7106f4 tempest-VolumesGetTest-46404158 None] Acquiring lock "cinder-quobyte-2418d801-2c01-4e18-85d4-7ece4252783d" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:32:44 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-536e6af7-a828-48cc-81b0-0c473f7106f4 tempest-VolumesGetTest-46404158 None] Lock "cinder-quobyte-2418d801-2c01-4e18-85d4-7ece4252783d" acquired by "delete_volume" :: waited 0.027s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:32:44 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f8e5e6-5f7f-4f0d-bc7c-a0c0dbbf05f0]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:32:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-536e6af7-a828-48cc-81b0-0c473f7106f4 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2418d801-2c01-4e18-85d4-7ece4252783d {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:44 devstack sudo[97754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2418d801-2c01-4e18-85d4-7ece4252783d Nov 02 12:32:44 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:44 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.514s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:44 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:32:44 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager._thread_info {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:32:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread count: 28 {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:32:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread info: [<_MainThread(MainThread, started 129944084402304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:32:44 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-536e6af7-a828-48cc-81b0-0c473f7106f4 tempest-VolumesGetTest-46404158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2418d801-2c01-4e18-85d4-7ece4252783d" returned: 0 in 0.529s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-536e6af7-a828-48cc-81b0-0c473f7106f4 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2418d801-2c01-4e18-85d4-7ece4252783d {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:44 devstack sudo[97762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2418d801-2c01-4e18-85d4-7ece4252783d Nov 02 12:32:44 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:44 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-536e6af7-a828-48cc-81b0-0c473f7106f4 tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2418d801-2c01-4e18-85d4-7ece4252783d" returned: 0 in 0.298s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:44 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-536e6af7-a828-48cc-81b0-0c473f7106f4 tempest-VolumesGetTest-46404158 None] Lock "cinder-quobyte-2418d801-2c01-4e18-85d4-7ece4252783d" released by "delete_volume" :: held 0.895s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:32:45 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-536e6af7-a828-48cc-81b0-0c473f7106f4 tempest-VolumesGetTest-46404158 None] Created reservations ['035cdc53-c8fd-46c5-a8a4-7ad9f698b760', '40a2f7d7-1c34-4f1e-95cb-e661328e26e3', '7fee5259-111f-4458-b151-b8b4647a1e44', '9b8f8736-5937-46ce-a7e8-eade930c2b38'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:32:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-536e6af7-a828-48cc-81b0-0c473f7106f4 tempest-VolumesGetTest-46404158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-536e6af7-a828-48cc-81b0-0c473f7106f4 tempest-VolumesGetTest-46404158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:45 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-536e6af7-a828-48cc-81b0-0c473f7106f4 tempest-VolumesGetTest-46404158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:32:45 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-536e6af7-a828-48cc-81b0-0c473f7106f4 tempest-VolumesGetTest-46404158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:32:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-536e6af7-a828-48cc-81b0-0c473f7106f4 tempest-VolumesGetTest-46404158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-536e6af7-a828-48cc-81b0-0c473f7106f4 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:45 devstack sudo[97777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:32:45 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:45 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-52f6c529-b9e6-4898-a508-cde3dcf61025 tempest-VolumesGetTest-46404158 None] Acquiring lock "cinder-c008d4f2-f3e8-404d-b973-fe88de6103aa-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:32:45 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-52f6c529-b9e6-4898-a508-cde3dcf61025 tempest-VolumesGetTest-46404158 None] Lock "cinder-c008d4f2-f3e8-404d-b973-fe88de6103aa-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:32:45 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-52f6c529-b9e6-4898-a508-cde3dcf61025 tempest-VolumesGetTest-46404158 None] Acquiring lock "cinder-quobyte-c008d4f2-f3e8-404d-b973-fe88de6103aa" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:32:45 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-52f6c529-b9e6-4898-a508-cde3dcf61025 tempest-VolumesGetTest-46404158 None] Lock "cinder-quobyte-c008d4f2-f3e8-404d-b973-fe88de6103aa" acquired by "delete_volume" :: waited 0.029s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:32:45 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[6222c1c0-1a7a-47cf-b6f4-507967324a7b]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:32:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-52f6c529-b9e6-4898-a508-cde3dcf61025 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c008d4f2-f3e8-404d-b973-fe88de6103aa {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:45 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-536e6af7-a828-48cc-81b0-0c473f7106f4 tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.558s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:45 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-536e6af7-a828-48cc-81b0-0c473f7106f4 tempest-VolumesGetTest-46404158 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:32:45 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-536e6af7-a828-48cc-81b0-0c473f7106f4 tempest-VolumesGetTest-46404158 None] Deleted volume successfully. Nov 02 12:32:45 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-536e6af7-a828-48cc-81b0-0c473f7106f4 tempest-VolumesGetTest-46404158 None] Lock "cinder-2418d801-2c01-4e18-85d4-7ece4252783d-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:32:45 devstack sudo[97791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c008d4f2-f3e8-404d-b973-fe88de6103aa Nov 02 12:32:45 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:46 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-52f6c529-b9e6-4898-a508-cde3dcf61025 tempest-VolumesGetTest-46404158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c008d4f2-f3e8-404d-b973-fe88de6103aa" returned: 0 in 0.442s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-52f6c529-b9e6-4898-a508-cde3dcf61025 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c008d4f2-f3e8-404d-b973-fe88de6103aa {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:46 devstack sudo[97797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c008d4f2-f3e8-404d-b973-fe88de6103aa Nov 02 12:32:46 devstack sudo[97797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:46 devstack sudo[97797]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-52f6c529-b9e6-4898-a508-cde3dcf61025 tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c008d4f2-f3e8-404d-b973-fe88de6103aa" returned: 0 in 0.299s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:46 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-52f6c529-b9e6-4898-a508-cde3dcf61025 tempest-VolumesGetTest-46404158 None] Lock "cinder-quobyte-c008d4f2-f3e8-404d-b973-fe88de6103aa" released by "delete_volume" :: held 0.824s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:32:46 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-52f6c529-b9e6-4898-a508-cde3dcf61025 tempest-VolumesGetTest-46404158 None] Created reservations ['0e48b7bf-9640-426b-b590-a5dbba696984', '085e8a67-0923-4493-aa08-c49ad85c1a10', '1fa8cdbc-97de-4d69-ba27-52f4be8c9ec0', '995923c4-4c77-4565-bf88-122b82fb2513'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:32:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-52f6c529-b9e6-4898-a508-cde3dcf61025 tempest-VolumesGetTest-46404158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-52f6c529-b9e6-4898-a508-cde3dcf61025 tempest-VolumesGetTest-46404158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:46 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-52f6c529-b9e6-4898-a508-cde3dcf61025 tempest-VolumesGetTest-46404158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:32:46 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-52f6c529-b9e6-4898-a508-cde3dcf61025 tempest-VolumesGetTest-46404158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:32:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-52f6c529-b9e6-4898-a508-cde3dcf61025 tempest-VolumesGetTest-46404158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-52f6c529-b9e6-4898-a508-cde3dcf61025 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:46 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:32:46 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:46 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-52f6c529-b9e6-4898-a508-cde3dcf61025 tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.436s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-52f6c529-b9e6-4898-a508-cde3dcf61025 tempest-VolumesGetTest-46404158 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:32:47 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-52f6c529-b9e6-4898-a508-cde3dcf61025 tempest-VolumesGetTest-46404158 None] Deleted volume successfully. Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-52f6c529-b9e6-4898-a508-cde3dcf61025 tempest-VolumesGetTest-46404158 None] Lock "cinder-c008d4f2-f3e8-404d-b973-fe88de6103aa-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-16b14372-19ce-47c3-8858-1c42146d2abc tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-16b14372-19ce-47c3-8858-1c42146d2abc tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Flow 'volume_create_manager' (40940273-ec81-4044-809f-c62181b2fdc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-16b14372-19ce-47c3-8858-1c42146d2abc tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (680c1ec3-6f8c-4c4d-aa19-32b3acd89fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-16b14372-19ce-47c3-8858-1c42146d2abc tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (680c1ec3-6f8c-4c4d-aa19-32b3acd89fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1273308723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e9cc139-13ef-4981-829c-018957636c36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83c89a45817a43a3afad601367219683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:32:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:32:47Z,use_quota=True,user_id='f4cd27aa36ab4770a0c116212f39493b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-16b14372-19ce-47c3-8858-1c42146d2abc tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d5f6217-b7a9-4983-b1c9-4860100ecfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-16b14372-19ce-47c3-8858-1c42146d2abc tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d5f6217-b7a9-4983-b1c9-4860100ecfb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-16b14372-19ce-47c3-8858-1c42146d2abc tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2421f003-3b14-4395-8896-6c4dfdbe16f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-16b14372-19ce-47c3-8858-1c42146d2abc tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2421f003-3b14-4395-8896-6c4dfdbe16f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e9cc139-13ef-4981-829c-018957636c36', 'volume_name': 'volume-9e9cc139-13ef-4981-829c-018957636c36', 'volume_size': 2}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-16b14372-19ce-47c3-8858-1c42146d2abc tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab62d87a-e759-4076-b2ab-2006d40e48c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-16b14372-19ce-47c3-8858-1c42146d2abc tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab62d87a-e759-4076-b2ab-2006d40e48c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-16b14372-19ce-47c3-8858-1c42146d2abc tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b63fb693-3773-46b3-9c4b-d7bdbe38df9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:47 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-16b14372-19ce-47c3-8858-1c42146d2abc tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Volume 9e9cc139-13ef-4981-829c-018957636c36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e9cc139-13ef-4981-829c-018957636c36', 'volume_size': 2} Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-16b14372-19ce-47c3-8858-1c42146d2abc tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-16b14372-19ce-47c3-8858-1c42146d2abc tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-16b14372-19ce-47c3-8858-1c42146d2abc tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1273308723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e9cc139-13ef-4981-829c-018957636c36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83c89a45817a43a3afad601367219683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:32:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:32:47Z,use_quota=True,user_id='f4cd27aa36ab4770a0c116212f39493b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-16b14372-19ce-47c3-8858-1c42146d2abc tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Creating volume 9e9cc139-13ef-4981-829c-018957636c36 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-16b14372-19ce-47c3-8858-1c42146d2abc tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-16b14372-19ce-47c3-8858-1c42146d2abc tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-16b14372-19ce-47c3-8858-1c42146d2abc tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-16b14372-19ce-47c3-8858-1c42146d2abc tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-16b14372-19ce-47c3-8858-1c42146d2abc tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-16b14372-19ce-47c3-8858-1c42146d2abc tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:32:47 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-16b14372-19ce-47c3-8858-1c42146d2abc tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-16b14372-19ce-47c3-8858-1c42146d2abc tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36 2147483648 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:47 devstack sudo[97804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36 2147483648 Nov 02 12:32:47 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-c99e0473-5ce6-45c7-be7f-b19f54353cac tempest-VolumesGetTest-46404158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-c99e0473-5ce6-45c7-be7f-b19f54353cac tempest-VolumesGetTest-46404158 None] Flow 'volume_create_manager' (07769721-c16d-41ad-bfa3-840521a4db6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-c99e0473-5ce6-45c7-be7f-b19f54353cac tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe215c5-fea5-4d1e-810d-db0eeb1d24d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-c99e0473-5ce6-45c7-be7f-b19f54353cac tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe215c5-fea5-4d1e-810d-db0eeb1d24d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-729976316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd6896d4-9c93-42a9-a332-8a4119c370ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f767ab595024bab992b0a3110ac694b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:32:47Z,use_quota=True,user_id='4a860355a6644529af2302fae112bdfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-c99e0473-5ce6-45c7-be7f-b19f54353cac tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fb6746-6a57-4592-ab90-abfdee2971c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-c99e0473-5ce6-45c7-be7f-b19f54353cac tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fb6746-6a57-4592-ab90-abfdee2971c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-c99e0473-5ce6-45c7-be7f-b19f54353cac tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf9f8a50-6dd8-42f1-b1ca-ca9617c94ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-c99e0473-5ce6-45c7-be7f-b19f54353cac tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf9f8a50-6dd8-42f1-b1ca-ca9617c94ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd6896d4-9c93-42a9-a332-8a4119c370ac', 'volume_name': 'volume-bd6896d4-9c93-42a9-a332-8a4119c370ac', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-c99e0473-5ce6-45c7-be7f-b19f54353cac tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35e0fd74-426a-4938-a43a-3eeb22eba21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-c99e0473-5ce6-45c7-be7f-b19f54353cac tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35e0fd74-426a-4938-a43a-3eeb22eba21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-c99e0473-5ce6-45c7-be7f-b19f54353cac tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9ce26f-df59-4755-ac40-015837ac8770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:47 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-c99e0473-5ce6-45c7-be7f-b19f54353cac tempest-VolumesGetTest-46404158 None] Volume bd6896d4-9c93-42a9-a332-8a4119c370ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd6896d4-9c93-42a9-a332-8a4119c370ac', 'volume_size': 1} Nov 02 12:32:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c99e0473-5ce6-45c7-be7f-b19f54353cac tempest-VolumesGetTest-46404158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:48 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-16b14372-19ce-47c3-8858-1c42146d2abc tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36 2147483648" returned: 0 in 0.778s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-16b14372-19ce-47c3-8858-1c42146d2abc tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:48 devstack sudo[97851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36 Nov 02 12:32:48 devstack sudo[97851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:48 devstack sudo[97851]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-16b14372-19ce-47c3-8858-1c42146d2abc tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36" returned: 0 in 0.308s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-16b14372-19ce-47c3-8858-1c42146d2abc tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:32:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-16b14372-19ce-47c3-8858-1c42146d2abc tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c99e0473-5ce6-45c7-be7f-b19f54353cac tempest-VolumesGetTest-46404158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.926s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-c99e0473-5ce6-45c7-be7f-b19f54353cac tempest-VolumesGetTest-46404158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-729976316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd6896d4-9c93-42a9-a332-8a4119c370ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f767ab595024bab992b0a3110ac694b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:32:47Z,use_quota=True,user_id='4a860355a6644529af2302fae112bdfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:32:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-c99e0473-5ce6-45c7-be7f-b19f54353cac tempest-VolumesGetTest-46404158 None] Creating volume bd6896d4-9c93-42a9-a332-8a4119c370ac {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:32:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c99e0473-5ce6-45c7-be7f-b19f54353cac tempest-VolumesGetTest-46404158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c99e0473-5ce6-45c7-be7f-b19f54353cac tempest-VolumesGetTest-46404158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-c99e0473-5ce6-45c7-be7f-b19f54353cac tempest-VolumesGetTest-46404158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:32:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-c99e0473-5ce6-45c7-be7f-b19f54353cac tempest-VolumesGetTest-46404158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:32:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c99e0473-5ce6-45c7-be7f-b19f54353cac tempest-VolumesGetTest-46404158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-c99e0473-5ce6-45c7-be7f-b19f54353cac tempest-VolumesGetTest-46404158 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:32:48 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-c99e0473-5ce6-45c7-be7f-b19f54353cac tempest-VolumesGetTest-46404158 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:32:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c99e0473-5ce6-45c7-be7f-b19f54353cac tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:48 devstack sudo[97855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac 1073741824 Nov 02 12:32:48 devstack sudo[97855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-16b14372-19ce-47c3-8858-1c42146d2abc tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b63fb693-3773-46b3-9c4b-d7bdbe38df9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e9cc139-13ef-4981-829c-018957636c36', 'volume_size': 2}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-16b14372-19ce-47c3-8858-1c42146d2abc tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9677d04e-6237-42a6-9464-0a75ba46a670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:48 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-16b14372-19ce-47c3-8858-1c42146d2abc tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Volume volume-9e9cc139-13ef-4981-829c-018957636c36 (9e9cc139-13ef-4981-829c-018957636c36): created successfully Nov 02 12:32:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-16b14372-19ce-47c3-8858-1c42146d2abc tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9677d04e-6237-42a6-9464-0a75ba46a670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-16b14372-19ce-47c3-8858-1c42146d2abc tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Flow 'volume_create_manager' (40940273-ec81-4044-809f-c62181b2fdc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:32:48 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-16b14372-19ce-47c3-8858-1c42146d2abc tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Created volume successfully. Nov 02 12:32:49 devstack sudo[97855]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c99e0473-5ce6-45c7-be7f-b19f54353cac tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac 1073741824" returned: 0 in 0.536s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c99e0473-5ce6-45c7-be7f-b19f54353cac tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:49 devstack sudo[97863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac Nov 02 12:32:49 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:49 devstack sudo[97863]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c99e0473-5ce6-45c7-be7f-b19f54353cac tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac" returned: 0 in 0.483s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:49 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-c99e0473-5ce6-45c7-be7f-b19f54353cac tempest-VolumesGetTest-46404158 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:32:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c99e0473-5ce6-45c7-be7f-b19f54353cac tempest-VolumesGetTest-46404158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-c99e0473-5ce6-45c7-be7f-b19f54353cac tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9ce26f-df59-4755-ac40-015837ac8770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd6896d4-9c93-42a9-a332-8a4119c370ac', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-c99e0473-5ce6-45c7-be7f-b19f54353cac tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0e97598-d9ed-4f56-af43-d173e81a8b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3fb47604-342d-43b2-b78c-c324b22ec7c6 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3fb47604-342d-43b2-b78c-c324b22ec7c6 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:49 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-c99e0473-5ce6-45c7-be7f-b19f54353cac tempest-VolumesGetTest-46404158 None] Volume volume-bd6896d4-9c93-42a9-a332-8a4119c370ac (bd6896d4-9c93-42a9-a332-8a4119c370ac): created successfully Nov 02 12:32:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-c99e0473-5ce6-45c7-be7f-b19f54353cac tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0e97598-d9ed-4f56-af43-d173e81a8b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-c99e0473-5ce6-45c7-be7f-b19f54353cac tempest-VolumesGetTest-46404158 None] Flow 'volume_create_manager' (07769721-c16d-41ad-bfa3-840521a4db6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:32:49 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-3fb47604-342d-43b2-b78c-c324b22ec7c6 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Creating offline snapshot d6be8561-2dfb-491c-9da9-54a73bdc7fca of volume 9e9cc139-13ef-4981-829c-018957636c36 {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:32:49 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-c99e0473-5ce6-45c7-be7f-b19f54353cac tempest-VolumesGetTest-46404158 None] Created volume successfully. Nov 02 12:32:49 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb6cdfd-943a-4e3b-87f3-78a292e878f5]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:32:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3fb47604-342d-43b2-b78c-c324b22ec7c6 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:49 devstack sudo[97866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36 Nov 02 12:32:49 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:50 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3fb47604-342d-43b2-b78c-c324b22ec7c6 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36" returned: 0 in 0.416s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3fb47604-342d-43b2-b78c-c324b22ec7c6 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36.d6be8561-2dfb-491c-9da9-54a73bdc7fca 2G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:50 devstack sudo[97871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36.d6be8561-2dfb-491c-9da9-54a73bdc7fca 2G Nov 02 12:32:50 devstack sudo[97871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:50 devstack sudo[97871]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3fb47604-342d-43b2-b78c-c324b22ec7c6 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36.d6be8561-2dfb-491c-9da9-54a73bdc7fca 2G" returned: 0 in 0.610s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3fb47604-342d-43b2-b78c-c324b22ec7c6 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e9cc139-13ef-4981-829c-018957636c36 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36.d6be8561-2dfb-491c-9da9-54a73bdc7fca {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:50 devstack sudo[97876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e9cc139-13ef-4981-829c-018957636c36 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36.d6be8561-2dfb-491c-9da9-54a73bdc7fca Nov 02 12:32:50 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:51 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3fb47604-342d-43b2-b78c-c324b22ec7c6 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e9cc139-13ef-4981-829c-018957636c36 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36.d6be8561-2dfb-491c-9da9-54a73bdc7fca" returned: 0 in 0.523s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:51 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-3fb47604-342d-43b2-b78c-c324b22ec7c6 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36.d6be8561-2dfb-491c-9da9-54a73bdc7fca is being set with open permissions: ugo+rw Nov 02 12:32:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3fb47604-342d-43b2-b78c-c324b22ec7c6 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36.d6be8561-2dfb-491c-9da9-54a73bdc7fca {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:51 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:32:51 devstack sudo[97883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36.d6be8561-2dfb-491c-9da9-54a73bdc7fca Nov 02 12:32:51 devstack sudo[97883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Flow 'volume_create_manager' (96adee53-1f58-4a20-82ab-970821074882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:32:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb296a5-01b4-4432-b52d-74daea3a4f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb296a5-01b4-4432-b52d-74daea3a4f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2092705055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=063b9d9b-a07c-4d79-b02c-3881339a6e9e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0f767ab595024bab992b0a3110ac694b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=bd6896d4-9c93-42a9-a332-8a4119c370ac,status='creating',terminated_at=None,updated_at=2026-11-02T11:32:51Z,use_quota=True,user_id='4a860355a6644529af2302fae112bdfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c90684f-421f-4e7f-8452-9ead05e5b17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c90684f-421f-4e7f-8452-9ead05e5b17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b3cdce6-1526-4183-91a2-fb0706f7f9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b3cdce6-1526-4183-91a2-fb0706f7f9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '063b9d9b-a07c-4d79-b02c-3881339a6e9e', 'volume_name': 'volume-063b9d9b-a07c-4d79-b02c-3881339a6e9e', 'volume_size': 1, 'source_volid': 'bd6896d4-9c93-42a9-a332-8a4119c370ac', 'source_volstatus': 'available'}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8b5f706-5d6c-42a8-b1d8-1fd4d73fb4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8b5f706-5d6c-42a8-b1d8-1fd4d73fb4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:32:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b1ca02-ec92-4c6a-aa9d-60e165d8b0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:32:51 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Volume 063b9d9b-a07c-4d79-b02c-3881339a6e9e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-063b9d9b-a07c-4d79-b02c-3881339a6e9e', 'volume_size': 1, 'source_volid': 'bd6896d4-9c93-42a9-a332-8a4119c370ac', 'source_volstatus': 'available'} Nov 02 12:32:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:51 devstack sudo[97883]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3fb47604-342d-43b2-b78c-c324b22ec7c6 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36.d6be8561-2dfb-491c-9da9-54a73bdc7fca" returned: 0 in 0.469s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3fb47604-342d-43b2-b78c-c324b22ec7c6 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:51 devstack sudo[97892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36.info Nov 02 12:32:51 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:52 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3fb47604-342d-43b2-b78c-c324b22ec7c6 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36.info" returned: 0 in 0.328s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:52 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-3fb47604-342d-43b2-b78c-c324b22ec7c6 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36.info is being set with open permissions: ugo+rw Nov 02 12:32:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3fb47604-342d-43b2-b78c-c324b22ec7c6 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:52 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36.info Nov 02 12:32:52 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:52 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3fb47604-342d-43b2-b78c-c324b22ec7c6 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36.info" returned: 0 in 0.319s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3fb47604-342d-43b2-b78c-c324b22ec7c6 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.808s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.897s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:52 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Cloning volume bd6896d4-9c93-42a9-a332-8a4119c370ac to volume 063b9d9b-a07c-4d79-b02c-3881339a6e9e Nov 02 12:32:52 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-3fb47604-342d-43b2-b78c-c324b22ec7c6 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Create snapshot completed successfully Nov 02 12:32:52 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Creating offline snapshot ac736e7e-88f1-44ea-8150-723d85a1b2be of volume bd6896d4-9c93-42a9-a332-8a4119c370ac {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:32:52 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a93cff-671d-49b3-b4e2-e29169f2d250]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:32:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:52 devstack sudo[97909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac Nov 02 12:32:52 devstack sudo[97909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:52 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-903eb67a-b06f-486a-9562-6755a2477190 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Acquiring lock "cinder-d6be8561-2dfb-491c-9da9-54a73bdc7fca-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:32:52 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-903eb67a-b06f-486a-9562-6755a2477190 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Lock "cinder-d6be8561-2dfb-491c-9da9-54a73bdc7fca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:32:52 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-903eb67a-b06f-486a-9562-6755a2477190 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Acquiring lock "cinder-quobyte-9e9cc139-13ef-4981-829c-018957636c36" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:32:52 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-903eb67a-b06f-486a-9562-6755a2477190 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Lock "cinder-quobyte-9e9cc139-13ef-4981-829c-018957636c36" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:32:52 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-903eb67a-b06f-486a-9562-6755a2477190 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Acquiring lock "cinder-quobyte-d6be8561-2dfb-491c-9da9-54a73bdc7fca" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:32:53 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-903eb67a-b06f-486a-9562-6755a2477190 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Lock "cinder-quobyte-d6be8561-2dfb-491c-9da9-54a73bdc7fca" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:32:53 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-903eb67a-b06f-486a-9562-6755a2477190 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Deleting offline snapshot d6be8561-2dfb-491c-9da9-54a73bdc7fca of volume 9e9cc139-13ef-4981-829c-018957636c36 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:32:53 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-903eb67a-b06f-486a-9562-6755a2477190 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] snapshot_file for this snap is: volume-9e9cc139-13ef-4981-829c-018957636c36.d6be8561-2dfb-491c-9da9-54a73bdc7fca {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:32:53 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7a14c0-b488-4904-9196-eadf154ba6a3]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:32:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-903eb67a-b06f-486a-9562-6755a2477190 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36.d6be8561-2dfb-491c-9da9-54a73bdc7fca {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:53 devstack sudo[97909]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac" returned: 0 in 0.443s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac.ac736e7e-88f1-44ea-8150-723d85a1b2be 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:53 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac.ac736e7e-88f1-44ea-8150-723d85a1b2be 1G Nov 02 12:32:53 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:53 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36.d6be8561-2dfb-491c-9da9-54a73bdc7fca Nov 02 12:32:53 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:53 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-903eb67a-b06f-486a-9562-6755a2477190 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36.d6be8561-2dfb-491c-9da9-54a73bdc7fca" returned: 0 in 0.417s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:53 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-903eb67a-b06f-486a-9562-6755a2477190 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e9cc139-13ef-4981-829c-018957636c36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:32:53 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[323531a7-8f09-4fab-9ae9-60ac253f75f5]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:32:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-903eb67a-b06f-486a-9562-6755a2477190 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:53 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac.ac736e7e-88f1-44ea-8150-723d85a1b2be 1G" returned: 0 in 0.483s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd6896d4-9c93-42a9-a332-8a4119c370ac -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac.ac736e7e-88f1-44ea-8150-723d85a1b2be {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:53 devstack sudo[97926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd6896d4-9c93-42a9-a332-8a4119c370ac -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac.ac736e7e-88f1-44ea-8150-723d85a1b2be Nov 02 12:32:53 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:53 devstack sudo[97925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36 Nov 02 12:32:53 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:53 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:53 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd6896d4-9c93-42a9-a332-8a4119c370ac -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac.ac736e7e-88f1-44ea-8150-723d85a1b2be" returned: 0 in 0.311s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:53 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac.ac736e7e-88f1-44ea-8150-723d85a1b2be is being set with open permissions: ugo+rw Nov 02 12:32:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac.ac736e7e-88f1-44ea-8150-723d85a1b2be {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-903eb67a-b06f-486a-9562-6755a2477190 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36" returned: 0 in 0.387s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-903eb67a-b06f-486a-9562-6755a2477190 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36.d6be8561-2dfb-491c-9da9-54a73bdc7fca {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:53 devstack sudo[97935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac.ac736e7e-88f1-44ea-8150-723d85a1b2be Nov 02 12:32:53 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:53 devstack sudo[97936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36.d6be8561-2dfb-491c-9da9-54a73bdc7fca Nov 02 12:32:53 devstack sudo[97936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:54 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac.ac736e7e-88f1-44ea-8150-723d85a1b2be" returned: 0 in 0.268s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:54 devstack sudo[97943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac.info Nov 02 12:32:54 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:54 devstack sudo[97936]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-903eb67a-b06f-486a-9562-6755a2477190 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36.d6be8561-2dfb-491c-9da9-54a73bdc7fca" returned: 0 in 0.357s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-903eb67a-b06f-486a-9562-6755a2477190 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36.d6be8561-2dfb-491c-9da9-54a73bdc7fca {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:54 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36.d6be8561-2dfb-491c-9da9-54a73bdc7fca Nov 02 12:32:54 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:54 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac.info" returned: 0 in 0.284s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:54 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac.info is being set with open permissions: ugo+rw Nov 02 12:32:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:54 devstack sudo[97948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac.info Nov 02 12:32:54 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:54 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-903eb67a-b06f-486a-9562-6755a2477190 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36.d6be8561-2dfb-491c-9da9-54a73bdc7fca" returned: 0 in 0.275s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:54 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-903eb67a-b06f-486a-9562-6755a2477190 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Lock "cinder-quobyte-d6be8561-2dfb-491c-9da9-54a73bdc7fca" released by "_delete_snapshot" :: held 1.573s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:32:54 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-903eb67a-b06f-486a-9562-6755a2477190 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Lock "cinder-quobyte-9e9cc139-13ef-4981-829c-018957636c36" released by "delete_snapshot" :: held 1.601s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:32:54 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-903eb67a-b06f-486a-9562-6755a2477190 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Created reservations ['d951b65f-8398-4da7-865c-7c5d352f98d9', '964f266a-26e1-468f-b8d8-1cdb0d53feec', 'b0866367-64b2-431c-877c-23e708af2e38', '93faf523-cfae-434e-8d3d-e8dfbb66e8d2'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:32:54 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-903eb67a-b06f-486a-9562-6755a2477190 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Delete snapshot completed successfully. Nov 02 12:32:54 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-903eb67a-b06f-486a-9562-6755a2477190 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Lock "cinder-d6be8561-2dfb-491c-9da9-54a73bdc7fca-delete_snapshot" released by "delete_snapshot" :: held 1.761s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:32:54 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac.info" returned: 0 in 0.286s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:54 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Acquiring lock "cinder-quobyte-063b9d9b-a07c-4d79-b02c-3881339a6e9e" by "_copy_volume_from_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:32:54 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Lock "cinder-quobyte-063b9d9b-a07c-4d79-b02c-3881339a6e9e" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:32:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] snapshot: ac736e7e-88f1-44ea-8150-723d85a1b2be, volume: 063b9d9b-a07c-4d79-b02c-3881339a6e9e, {{(pid=86515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 12:32:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:32:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:32:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:54 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aff467d-348f-4e3c-a9ed-877f6dbae355]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:32:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac.ac736e7e-88f1-44ea-8150-723d85a1b2be {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:54 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac.ac736e7e-88f1-44ea-8150-723d85a1b2be Nov 02 12:32:54 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:55 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-05b94859-92ba-465a-bfad-75e9f65966d9 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Acquiring lock "cinder-9e9cc139-13ef-4981-829c-018957636c36-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:32:55 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-05b94859-92ba-465a-bfad-75e9f65966d9 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Lock "cinder-9e9cc139-13ef-4981-829c-018957636c36-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:32:55 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:55 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-05b94859-92ba-465a-bfad-75e9f65966d9 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Acquiring lock "cinder-quobyte-9e9cc139-13ef-4981-829c-018957636c36" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:32:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac.ac736e7e-88f1-44ea-8150-723d85a1b2be" returned: 0 in 0.454s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:55 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd6896d4-9c93-42a9-a332-8a4119c370ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:32:55 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-05b94859-92ba-465a-bfad-75e9f65966d9 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Lock "cinder-quobyte-9e9cc139-13ef-4981-829c-018957636c36" acquired by "delete_volume" :: waited 0.023s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:32:55 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[616b92e4-821e-48a9-8f27-d7aa6302c791]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:32:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:55 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c8f2b3-b34a-4589-ac35-61ce95c7ddcf]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:32:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-05b94859-92ba-465a-bfad-75e9f65966d9 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:55 devstack sudo[97957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac Nov 02 12:32:55 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:55 devstack sudo[97958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36 Nov 02 12:32:55 devstack sudo[97958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:55 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:55 devstack sudo[97958]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-05b94859-92ba-465a-bfad-75e9f65966d9 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36" returned: 0 in 0.370s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac" returned: 0 in 0.386s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-05b94859-92ba-465a-bfad-75e9f65966d9 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:55 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] will copy from snapshot at /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac {{(pid=86515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 12:32:55 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Creating direct copy from snapshot {{(pid=86515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 12:32:55 devstack cinder-volume[86515]: DEBUG cinder.utils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Path /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-063b9d9b-a07c-4d79-b02c-3881339a6e9e not found in is_blk_device check {{(pid=86515) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 12:32:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-063b9d9b-a07c-4d79-b02c-3881339a6e9e {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:55 devstack sudo[97967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36 Nov 02 12:32:55 devstack sudo[97967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:55 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-063b9d9b-a07c-4d79-b02c-3881339a6e9e Nov 02 12:32:55 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:55 devstack sudo[97967]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-05b94859-92ba-465a-bfad-75e9f65966d9 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9e9cc139-13ef-4981-829c-018957636c36" returned: 0 in 0.247s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:55 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-05b94859-92ba-465a-bfad-75e9f65966d9 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Lock "cinder-quobyte-9e9cc139-13ef-4981-829c-018957636c36" released by "delete_volume" :: held 0.687s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:32:56 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-05b94859-92ba-465a-bfad-75e9f65966d9 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Created reservations ['52b18d42-c0a3-4c9a-9c5e-88d2aace06e2', 'a5140396-9b53-488e-bdcd-c21ffb4b8c1d', 'e5fbe425-7085-422b-b72b-6c7e9dadf8bc', '9ddf3dda-e61c-47f3-8e06-b1e6b791e4fe'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:32:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-05b94859-92ba-465a-bfad-75e9f65966d9 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:32:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-05b94859-92ba-465a-bfad-75e9f65966d9 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:32:56 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-05b94859-92ba-465a-bfad-75e9f65966d9 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:32:56 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-05b94859-92ba-465a-bfad-75e9f65966d9 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:32:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-05b94859-92ba-465a-bfad-75e9f65966d9 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:32:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-05b94859-92ba-465a-bfad-75e9f65966d9 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:32:56 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:32:56 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:32:56 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Nov 02 12:32:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-05b94859-92ba-465a-bfad-75e9f65966d9 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.541s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:32:56 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-05b94859-92ba-465a-bfad-75e9f65966d9 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:32:56 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-05b94859-92ba-465a-bfad-75e9f65966d9 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Deleted volume successfully. Nov 02 12:32:56 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-05b94859-92ba-465a-bfad-75e9f65966d9 tempest-VolumesSnapshotNegativeTestJSON-1992028304 None] Lock "cinder-9e9cc139-13ef-4981-829c-018957636c36-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:33:04 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-063b9d9b-a07c-4d79-b02c-3881339a6e9e" returned: 0 in 8.316s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:04 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Image conversion details: src /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac, size 1024.00 MB, duration 8.32 sec, destination /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-063b9d9b-a07c-4d79-b02c-3881339a6e9e {{(pid=86515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 12:33:04 devstack cinder-volume[86515]: INFO cinder.image.image_utils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Converted 1024.00 MB image at 123.11 MB/s Nov 02 12:33:04 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-063b9d9b-a07c-4d79-b02c-3881339a6e9e is being set with open permissions: ugo+rw Nov 02 12:33:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-063b9d9b-a07c-4d79-b02c-3881339a6e9e {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:04 devstack sudo[98031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-063b9d9b-a07c-4d79-b02c-3881339a6e9e Nov 02 12:33:04 devstack sudo[98031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:04 devstack sudo[98031]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-063b9d9b-a07c-4d79-b02c-3881339a6e9e" returned: 0 in 0.255s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:04 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Lock "cinder-quobyte-063b9d9b-a07c-4d79-b02c-3881339a6e9e" released by "_copy_volume_from_snapshot" :: held 9.531s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:33:04 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:UPDATE=134,cinder:SELECT=108,cinder:INSERT=40,cinder:DELETE=13 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:33:04 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Acquiring lock "cinder-quobyte-ac736e7e-88f1-44ea-8150-723d85a1b2be" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:33:04 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Lock "cinder-quobyte-ac736e7e-88f1-44ea-8150-723d85a1b2be" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:33:04 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Deleting offline snapshot ac736e7e-88f1-44ea-8150-723d85a1b2be of volume bd6896d4-9c93-42a9-a332-8a4119c370ac {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:33:04 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] snapshot_file for this snap is: volume-bd6896d4-9c93-42a9-a332-8a4119c370ac.ac736e7e-88f1-44ea-8150-723d85a1b2be {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:33:04 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[528646a0-c1aa-43b6-bf38-277a83ac64ac]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:33:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac.ac736e7e-88f1-44ea-8150-723d85a1b2be {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:04 devstack sudo[98034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac.ac736e7e-88f1-44ea-8150-723d85a1b2be Nov 02 12:33:04 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:04 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac.ac736e7e-88f1-44ea-8150-723d85a1b2be" returned: 0 in 0.370s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:04 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd6896d4-9c93-42a9-a332-8a4119c370ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:33:04 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a17c95e-bab5-4aff-8042-6634d65cf3be]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:33:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:04 devstack sudo[98040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac Nov 02 12:33:04 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:05 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac" returned: 0 in 0.531s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac.ac736e7e-88f1-44ea-8150-723d85a1b2be {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:05 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac.ac736e7e-88f1-44ea-8150-723d85a1b2be Nov 02 12:33:05 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:05 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac.ac736e7e-88f1-44ea-8150-723d85a1b2be" returned: 0 in 0.349s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac.ac736e7e-88f1-44ea-8150-723d85a1b2be {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:05 devstack sudo[98050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac.ac736e7e-88f1-44ea-8150-723d85a1b2be Nov 02 12:33:05 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:05 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac.ac736e7e-88f1-44ea-8150-723d85a1b2be" returned: 0 in 0.266s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:06 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Lock "cinder-quobyte-ac736e7e-88f1-44ea-8150-723d85a1b2be" released by "_delete_snapshot" :: held 1.650s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:33:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.514s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:33:06 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b1ca02-ec92-4c6a-aa9d-60e165d8b0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-063b9d9b-a07c-4d79-b02c-3881339a6e9e', 'volume_size': 1, 'source_volid': 'bd6896d4-9c93-42a9-a332-8a4119c370ac', 'source_volstatus': 'available'}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:06 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac751cc4-3aca-4d8f-99e1-c1d63c18e690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:06 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Volume volume-063b9d9b-a07c-4d79-b02c-3881339a6e9e (063b9d9b-a07c-4d79-b02c-3881339a6e9e): created successfully Nov 02 12:33:06 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac751cc4-3aca-4d8f-99e1-c1d63c18e690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:06 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Flow 'volume_create_manager' (96adee53-1f58-4a20-82ab-970821074882) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:33:06 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-1754e86b-8016-45bd-a763-be9ef884c8b5 tempest-VolumesGetTest-46404158 None] Created volume successfully. Nov 02 12:33:07 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-66b17398-f469-46d5-b3f2-1ce586abe1e3 tempest-VolumesGetTest-46404158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:33:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-66b17398-f469-46d5-b3f2-1ce586abe1e3 tempest-VolumesGetTest-46404158 None] Flow 'volume_create_manager' (0446b76e-d2e3-433d-a3f8-66a82652c20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:33:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-66b17398-f469-46d5-b3f2-1ce586abe1e3 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77dedff2-e2df-426c-be9e-fbbfa159e7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-66b17398-f469-46d5-b3f2-1ce586abe1e3 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77dedff2-e2df-426c-be9e-fbbfa159e7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:33:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-923489053',display_name='tempest-VolumesGetTest-Volume-1893429273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a30764c-987d-4620-9e44-a07dd43fa5dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f767ab595024bab992b0a3110ac694b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:33:08Z,use_quota=True,user_id='4a860355a6644529af2302fae112bdfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-66b17398-f469-46d5-b3f2-1ce586abe1e3 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8288969-3f9d-453f-8e79-0646bc7a9f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-66b17398-f469-46d5-b3f2-1ce586abe1e3 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8288969-3f9d-453f-8e79-0646bc7a9f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-66b17398-f469-46d5-b3f2-1ce586abe1e3 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4e666c7-bd2f-4416-97c9-7da9ae1c6659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-66b17398-f469-46d5-b3f2-1ce586abe1e3 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4e666c7-bd2f-4416-97c9-7da9ae1c6659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a30764c-987d-4620-9e44-a07dd43fa5dd', 'volume_name': 'volume-9a30764c-987d-4620-9e44-a07dd43fa5dd', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-66b17398-f469-46d5-b3f2-1ce586abe1e3 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da50032b-297d-46a0-9470-d2cc148eace2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-66b17398-f469-46d5-b3f2-1ce586abe1e3 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da50032b-297d-46a0-9470-d2cc148eace2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-66b17398-f469-46d5-b3f2-1ce586abe1e3 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (082d919f-b7e6-475a-a95e-06a431c2eb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:07 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-66b17398-f469-46d5-b3f2-1ce586abe1e3 tempest-VolumesGetTest-46404158 None] Volume 9a30764c-987d-4620-9e44-a07dd43fa5dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a30764c-987d-4620-9e44-a07dd43fa5dd', 'volume_size': 1} Nov 02 12:33:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-66b17398-f469-46d5-b3f2-1ce586abe1e3 tempest-VolumesGetTest-46404158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:33:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-66b17398-f469-46d5-b3f2-1ce586abe1e3 tempest-VolumesGetTest-46404158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:33:07 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-66b17398-f469-46d5-b3f2-1ce586abe1e3 tempest-VolumesGetTest-46404158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:33:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-923489053',display_name='tempest-VolumesGetTest-Volume-1893429273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a30764c-987d-4620-9e44-a07dd43fa5dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f767ab595024bab992b0a3110ac694b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:33:08Z,use_quota=True,user_id='4a860355a6644529af2302fae112bdfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:33:07 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-66b17398-f469-46d5-b3f2-1ce586abe1e3 tempest-VolumesGetTest-46404158 None] Creating volume 9a30764c-987d-4620-9e44-a07dd43fa5dd {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:33:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-66b17398-f469-46d5-b3f2-1ce586abe1e3 tempest-VolumesGetTest-46404158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:33:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-66b17398-f469-46d5-b3f2-1ce586abe1e3 tempest-VolumesGetTest-46404158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:33:07 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-66b17398-f469-46d5-b3f2-1ce586abe1e3 tempest-VolumesGetTest-46404158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:33:07 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-66b17398-f469-46d5-b3f2-1ce586abe1e3 tempest-VolumesGetTest-46404158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:33:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-66b17398-f469-46d5-b3f2-1ce586abe1e3 tempest-VolumesGetTest-46404158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:33:07 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-66b17398-f469-46d5-b3f2-1ce586abe1e3 tempest-VolumesGetTest-46404158 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:33:07 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-66b17398-f469-46d5-b3f2-1ce586abe1e3 tempest-VolumesGetTest-46404158 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:33:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-66b17398-f469-46d5-b3f2-1ce586abe1e3 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9a30764c-987d-4620-9e44-a07dd43fa5dd 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:07 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9a30764c-987d-4620-9e44-a07dd43fa5dd 1073741824 Nov 02 12:33:07 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:08 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-66b17398-f469-46d5-b3f2-1ce586abe1e3 tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9a30764c-987d-4620-9e44-a07dd43fa5dd 1073741824" returned: 0 in 0.565s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-66b17398-f469-46d5-b3f2-1ce586abe1e3 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9a30764c-987d-4620-9e44-a07dd43fa5dd {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:08 devstack sudo[98060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9a30764c-987d-4620-9e44-a07dd43fa5dd Nov 02 12:33:08 devstack sudo[98060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:08 devstack sudo[98060]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-66b17398-f469-46d5-b3f2-1ce586abe1e3 tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9a30764c-987d-4620-9e44-a07dd43fa5dd" returned: 0 in 0.349s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:08 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-66b17398-f469-46d5-b3f2-1ce586abe1e3 tempest-VolumesGetTest-46404158 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:33:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-66b17398-f469-46d5-b3f2-1ce586abe1e3 tempest-VolumesGetTest-46404158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:33:08 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-66b17398-f469-46d5-b3f2-1ce586abe1e3 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (082d919f-b7e6-475a-a95e-06a431c2eb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a30764c-987d-4620-9e44-a07dd43fa5dd', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:08 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-66b17398-f469-46d5-b3f2-1ce586abe1e3 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c31ff0bd-4d30-4b80-b65b-15d956bb12cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:08 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-66b17398-f469-46d5-b3f2-1ce586abe1e3 tempest-VolumesGetTest-46404158 None] Volume volume-9a30764c-987d-4620-9e44-a07dd43fa5dd (9a30764c-987d-4620-9e44-a07dd43fa5dd): created successfully Nov 02 12:33:08 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-66b17398-f469-46d5-b3f2-1ce586abe1e3 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c31ff0bd-4d30-4b80-b65b-15d956bb12cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:08 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-66b17398-f469-46d5-b3f2-1ce586abe1e3 tempest-VolumesGetTest-46404158 None] Flow 'volume_create_manager' (0446b76e-d2e3-433d-a3f8-66a82652c20e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:33:08 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-66b17398-f469-46d5-b3f2-1ce586abe1e3 tempest-VolumesGetTest-46404158 None] Created volume successfully. Nov 02 12:33:09 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9b25f640-0a2a-40f5-a8cf-1b43f1f39666 tempest-VolumesGetTest-46404158 None] Acquiring lock "cinder-9a30764c-987d-4620-9e44-a07dd43fa5dd-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:33:09 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9b25f640-0a2a-40f5-a8cf-1b43f1f39666 tempest-VolumesGetTest-46404158 None] Lock "cinder-9a30764c-987d-4620-9e44-a07dd43fa5dd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:33:09 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9b25f640-0a2a-40f5-a8cf-1b43f1f39666 tempest-VolumesGetTest-46404158 None] Acquiring lock "cinder-quobyte-9a30764c-987d-4620-9e44-a07dd43fa5dd" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:33:09 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9b25f640-0a2a-40f5-a8cf-1b43f1f39666 tempest-VolumesGetTest-46404158 None] Lock "cinder-quobyte-9a30764c-987d-4620-9e44-a07dd43fa5dd" acquired by "delete_volume" :: waited 0.023s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:33:10 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1f64e3-eb90-449e-a38f-586c6df284bc]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:33:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9b25f640-0a2a-40f5-a8cf-1b43f1f39666 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9a30764c-987d-4620-9e44-a07dd43fa5dd {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:10 devstack sudo[98063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9a30764c-987d-4620-9e44-a07dd43fa5dd Nov 02 12:33:10 devstack sudo[98063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:10 devstack sudo[98063]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9b25f640-0a2a-40f5-a8cf-1b43f1f39666 tempest-VolumesGetTest-46404158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9a30764c-987d-4620-9e44-a07dd43fa5dd" returned: 0 in 0.495s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9b25f640-0a2a-40f5-a8cf-1b43f1f39666 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9a30764c-987d-4620-9e44-a07dd43fa5dd {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:10 devstack sudo[98068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9a30764c-987d-4620-9e44-a07dd43fa5dd Nov 02 12:33:10 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:10 devstack sudo[98068]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9b25f640-0a2a-40f5-a8cf-1b43f1f39666 tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9a30764c-987d-4620-9e44-a07dd43fa5dd" returned: 0 in 0.309s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:10 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9b25f640-0a2a-40f5-a8cf-1b43f1f39666 tempest-VolumesGetTest-46404158 None] Lock "cinder-quobyte-9a30764c-987d-4620-9e44-a07dd43fa5dd" released by "delete_volume" :: held 0.885s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:33:10 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-9b25f640-0a2a-40f5-a8cf-1b43f1f39666 tempest-VolumesGetTest-46404158 None] Created reservations ['41f09316-a2d8-4c80-a843-0f2e662f183b', 'b3ecbf9f-93d0-4cf0-ae98-9374802d86c9', '3cf7588f-a30e-41e9-8d93-f032474a63b7', '7ed9b76c-b024-46d1-af55-3fe645980c34'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:33:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-9b25f640-0a2a-40f5-a8cf-1b43f1f39666 tempest-VolumesGetTest-46404158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:33:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-9b25f640-0a2a-40f5-a8cf-1b43f1f39666 tempest-VolumesGetTest-46404158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:33:11 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-9b25f640-0a2a-40f5-a8cf-1b43f1f39666 tempest-VolumesGetTest-46404158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:33:11 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-9b25f640-0a2a-40f5-a8cf-1b43f1f39666 tempest-VolumesGetTest-46404158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:33:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-9b25f640-0a2a-40f5-a8cf-1b43f1f39666 tempest-VolumesGetTest-46404158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:33:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9b25f640-0a2a-40f5-a8cf-1b43f1f39666 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:11 devstack sudo[98071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:33:11 devstack sudo[98071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:11 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-13f8d646-c1aa-44c6-b7e6-64c249c998a3 tempest-VolumesGetTest-46404158 None] Acquiring lock "cinder-063b9d9b-a07c-4d79-b02c-3881339a6e9e-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:33:11 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-13f8d646-c1aa-44c6-b7e6-64c249c998a3 tempest-VolumesGetTest-46404158 None] Lock "cinder-063b9d9b-a07c-4d79-b02c-3881339a6e9e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:33:11 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-13f8d646-c1aa-44c6-b7e6-64c249c998a3 tempest-VolumesGetTest-46404158 None] Acquiring lock "cinder-quobyte-063b9d9b-a07c-4d79-b02c-3881339a6e9e" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:33:11 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-13f8d646-c1aa-44c6-b7e6-64c249c998a3 tempest-VolumesGetTest-46404158 None] Lock "cinder-quobyte-063b9d9b-a07c-4d79-b02c-3881339a6e9e" acquired by "delete_volume" :: waited 0.028s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:33:11 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86356f0-fcec-4a00-9b57-52d5d675b1d0]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:33:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-13f8d646-c1aa-44c6-b7e6-64c249c998a3 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-063b9d9b-a07c-4d79-b02c-3881339a6e9e {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:11 devstack sudo[98071]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9b25f640-0a2a-40f5-a8cf-1b43f1f39666 tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.410s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:11 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-9b25f640-0a2a-40f5-a8cf-1b43f1f39666 tempest-VolumesGetTest-46404158 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:33:11 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-9b25f640-0a2a-40f5-a8cf-1b43f1f39666 tempest-VolumesGetTest-46404158 None] Deleted volume successfully. Nov 02 12:33:11 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9b25f640-0a2a-40f5-a8cf-1b43f1f39666 tempest-VolumesGetTest-46404158 None] Lock "cinder-9a30764c-987d-4620-9e44-a07dd43fa5dd-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:33:11 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-063b9d9b-a07c-4d79-b02c-3881339a6e9e Nov 02 12:33:11 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:11 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-13f8d646-c1aa-44c6-b7e6-64c249c998a3 tempest-VolumesGetTest-46404158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-063b9d9b-a07c-4d79-b02c-3881339a6e9e" returned: 0 in 0.539s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-13f8d646-c1aa-44c6-b7e6-64c249c998a3 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-063b9d9b-a07c-4d79-b02c-3881339a6e9e {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:11 devstack sudo[98082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-063b9d9b-a07c-4d79-b02c-3881339a6e9e Nov 02 12:33:11 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:12 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-13f8d646-c1aa-44c6-b7e6-64c249c998a3 tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-063b9d9b-a07c-4d79-b02c-3881339a6e9e" returned: 0 in 0.369s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:12 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-13f8d646-c1aa-44c6-b7e6-64c249c998a3 tempest-VolumesGetTest-46404158 None] Lock "cinder-quobyte-063b9d9b-a07c-4d79-b02c-3881339a6e9e" released by "delete_volume" :: held 0.966s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:33:12 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=92,cinder:INSERT=32,cinder:UPDATE=111,cinder:DELETE=11 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:33:12 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-13f8d646-c1aa-44c6-b7e6-64c249c998a3 tempest-VolumesGetTest-46404158 None] Created reservations ['d3b63a71-ce3a-48be-95c8-3b68cff80811', '76e4cbb0-87fe-45e0-b5be-076fb8e3cb79', '5d0864d7-9327-405a-92ad-09f232fd5cba', '5206c5b6-eaa2-43ca-add4-5859953efed5'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:33:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-13f8d646-c1aa-44c6-b7e6-64c249c998a3 tempest-VolumesGetTest-46404158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:33:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-13f8d646-c1aa-44c6-b7e6-64c249c998a3 tempest-VolumesGetTest-46404158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:33:12 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-13f8d646-c1aa-44c6-b7e6-64c249c998a3 tempest-VolumesGetTest-46404158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:33:12 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-13f8d646-c1aa-44c6-b7e6-64c249c998a3 tempest-VolumesGetTest-46404158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:33:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-13f8d646-c1aa-44c6-b7e6-64c249c998a3 tempest-VolumesGetTest-46404158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:33:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-13f8d646-c1aa-44c6-b7e6-64c249c998a3 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:12 devstack sudo[98098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:33:12 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:12 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-13f8d646-c1aa-44c6-b7e6-64c249c998a3 tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.437s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:12 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-13f8d646-c1aa-44c6-b7e6-64c249c998a3 tempest-VolumesGetTest-46404158 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:33:12 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-13f8d646-c1aa-44c6-b7e6-64c249c998a3 tempest-VolumesGetTest-46404158 None] Deleted volume successfully. Nov 02 12:33:13 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-13f8d646-c1aa-44c6-b7e6-64c249c998a3 tempest-VolumesGetTest-46404158 None] Lock "cinder-063b9d9b-a07c-4d79-b02c-3881339a6e9e-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:33:13 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-1e53e8e8-fdb5-46a3-823d-926d4f0dd74a tempest-VolumesGetTest-46404158 None] Acquiring lock "cinder-bd6896d4-9c93-42a9-a332-8a4119c370ac-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:33:13 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-1e53e8e8-fdb5-46a3-823d-926d4f0dd74a tempest-VolumesGetTest-46404158 None] Lock "cinder-bd6896d4-9c93-42a9-a332-8a4119c370ac-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:33:13 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-1e53e8e8-fdb5-46a3-823d-926d4f0dd74a tempest-VolumesGetTest-46404158 None] Acquiring lock "cinder-quobyte-bd6896d4-9c93-42a9-a332-8a4119c370ac" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:33:13 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-1e53e8e8-fdb5-46a3-823d-926d4f0dd74a tempest-VolumesGetTest-46404158 None] Lock "cinder-quobyte-bd6896d4-9c93-42a9-a332-8a4119c370ac" acquired by "delete_volume" :: waited 0.015s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:33:13 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[2900f1cb-caae-4301-9495-c766159f9dce]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:33:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1e53e8e8-fdb5-46a3-823d-926d4f0dd74a tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:13 devstack sudo[98114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac Nov 02 12:33:13 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:14 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1e53e8e8-fdb5-46a3-823d-926d4f0dd74a tempest-VolumesGetTest-46404158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac" returned: 0 in 0.477s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1e53e8e8-fdb5-46a3-823d-926d4f0dd74a tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:14 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac Nov 02 12:33:14 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:14 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1e53e8e8-fdb5-46a3-823d-926d4f0dd74a tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd6896d4-9c93-42a9-a332-8a4119c370ac" returned: 0 in 0.310s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:14 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-1e53e8e8-fdb5-46a3-823d-926d4f0dd74a tempest-VolumesGetTest-46404158 None] Lock "cinder-quobyte-bd6896d4-9c93-42a9-a332-8a4119c370ac" released by "delete_volume" :: held 0.876s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:33:14 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-1e53e8e8-fdb5-46a3-823d-926d4f0dd74a tempest-VolumesGetTest-46404158 None] Created reservations ['e86b87ee-5a27-4513-a788-807fc1484b00', 'e534f09c-bfbf-4450-bc40-6f1c5120cb43', '9e2dd69f-ab17-4f1c-b010-fbd9eaa27b83', '04ddaa88-9b9a-4999-8f58-dd4f8818c2e1'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:33:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1e53e8e8-fdb5-46a3-823d-926d4f0dd74a tempest-VolumesGetTest-46404158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:33:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1e53e8e8-fdb5-46a3-823d-926d4f0dd74a tempest-VolumesGetTest-46404158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:33:14 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-1e53e8e8-fdb5-46a3-823d-926d4f0dd74a tempest-VolumesGetTest-46404158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:33:14 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-1e53e8e8-fdb5-46a3-823d-926d4f0dd74a tempest-VolumesGetTest-46404158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:33:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1e53e8e8-fdb5-46a3-823d-926d4f0dd74a tempest-VolumesGetTest-46404158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:33:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1e53e8e8-fdb5-46a3-823d-926d4f0dd74a tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:14 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:33:14 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:15 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1e53e8e8-fdb5-46a3-823d-926d4f0dd74a tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.325s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:15 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-1e53e8e8-fdb5-46a3-823d-926d4f0dd74a tempest-VolumesGetTest-46404158 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:33:15 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-1e53e8e8-fdb5-46a3-823d-926d4f0dd74a tempest-VolumesGetTest-46404158 None] Deleted volume successfully. Nov 02 12:33:15 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-1e53e8e8-fdb5-46a3-823d-926d4f0dd74a tempest-VolumesGetTest-46404158 None] Lock "cinder-bd6896d4-9c93-42a9-a332-8a4119c370ac-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:33:15 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:33:15 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Flow 'volume_create_manager' (c6f0a88d-79ea-40ef-b11a-df27d36e8a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:33:15 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fc3d960-0fb9-45c4-aa52-2ae624708cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:15 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fc3d960-0fb9-45c4-aa52-2ae624708cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-134137960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f725f7d1-aa66-4f2a-9324-5e9d368d74a3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0f767ab595024bab992b0a3110ac694b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:33:16Z,use_quota=True,user_id='4a860355a6644529af2302fae112bdfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:15 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b71d9bf8-9b82-4341-8eb6-863a3a088b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:15 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b71d9bf8-9b82-4341-8eb6-863a3a088b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:15 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98e1cc08-56f4-42fb-b0ef-3cbf3c5c2ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:15 devstack cinder-volume[86515]: DEBUG cinder.image.glance [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Creating Keystone auth plugin from conf {{(pid=86515) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 12:33:16 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98e1cc08-56f4-42fb-b0ef-3cbf3c5c2ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f725f7d1-aa66-4f2a-9324-5e9d368d74a3', 'volume_name': 'volume-f725f7d1-aa66-4f2a-9324-5e9d368d74a3', 'volume_size': 1, 'image_id': '4d531188-e398-41fe-8056-e52aa8e7c4ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d531188-e398-41fe-8056-e52aa8e7c4ab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ea64174531846a688f10d8f38a757ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d531188-e398-41fe-8056-e52aa8e7c4ab', 'created_at': datetime.datetime(2026, 11, 2, 11, 16, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 16, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d531188-e398-41fe-8056-e52aa8e7c4ab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:16 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d28c28ea-a40f-4539-a988-a4044c11498d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:16 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d28c28ea-a40f-4539-a988-a4044c11498d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:16 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fee61ac-3f3b-430f-a112-622702bc3366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:16 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Volume f725f7d1-aa66-4f2a-9324-5e9d368d74a3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f725f7d1-aa66-4f2a-9324-5e9d368d74a3', 'volume_size': 1, 'image_id': '4d531188-e398-41fe-8056-e52aa8e7c4ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d531188-e398-41fe-8056-e52aa8e7c4ab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ea64174531846a688f10d8f38a757ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d531188-e398-41fe-8056-e52aa8e7c4ab', 'created_at': datetime.datetime(2026, 11, 2, 11, 16, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 16, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d531188-e398-41fe-8056-e52aa8e7c4ab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 12:33:16 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Trying to clone f725f7d1-aa66-4f2a-9324-5e9d368d74a3 from image 4d531188-e398-41fe-8056-e52aa8e7c4ab at location (None, [{'url': 'file:///opt/stack/data/glance/images/4d531188-e398-41fe-8056-e52aa8e7c4ab', 'metadata': {}}]). {{(pid=86515) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1127}} Nov 02 12:33:16 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_0zyhnrjjdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86515) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 12:33:16 devstack cinder-volume[86515]: INFO cinder.image.image_utils [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Image download 20.69 MB at 20.69 MB/s Nov 02 12:33:16 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b20067-7965-46b4-b645-d454dfee09ee]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:33:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_0zyhnrjjdevstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:16 devstack sudo[98129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_0zyhnrjjdevstack@QuobyteHD Nov 02 12:33:16 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:17 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_0zyhnrjjdevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:17 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Temporary image 4d531188-e398-41fe-8056-e52aa8e7c4ab is fetched for user 4a860355a6644529af2302fae112bdfe. {{(pid=86515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 12:33:17 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bec20e0-7ac3-4c7e-8095-9d7423e0a7d1]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:33:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_0zyhnrjjdevstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:17 devstack sudo[98134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_0zyhnrjjdevstack@QuobyteHD Nov 02 12:33:17 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:17 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-ce949ab7-de50-4517-951a-6c77d36dfa8a req-0e3ae510-0ad4-4f76-9aa8-c27d2dd3d84a tempest-AttachVolumeNegativeTest-1281562092 None] Terminate volume connection completed successfully. Nov 02 12:33:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-ce949ab7-de50-4517-951a-6c77d36dfa8a req-0e3ae510-0ad4-4f76-9aa8-c27d2dd3d84a tempest-AttachVolumeNegativeTest-1281562092 None] Deleting attachment fd3a9942-9055-42a7-b388-3b4915a6e3e9. {{(pid=86515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:33:17 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_0zyhnrjjdevstack@QuobyteHD" returned: 0 in 0.410s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:33:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:33:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-134137960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f725f7d1-aa66-4f2a-9324-5e9d368d74a3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0f767ab595024bab992b0a3110ac694b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:33:16Z,use_quota=True,user_id='4a860355a6644529af2302fae112bdfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:33:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Creating volume f725f7d1-aa66-4f2a-9324-5e9d368d74a3 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:33:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:33:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:33:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:33:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:33:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:33:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:33:17 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:33:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f725f7d1-aa66-4f2a-9324-5e9d368d74a3 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:17 devstack sudo[98143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f725f7d1-aa66-4f2a-9324-5e9d368d74a3 1073741824 Nov 02 12:33:17 devstack sudo[98143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:18 devstack sudo[98143]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f725f7d1-aa66-4f2a-9324-5e9d368d74a3 1073741824" returned: 0 in 0.617s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f725f7d1-aa66-4f2a-9324-5e9d368d74a3 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:18 devstack sudo[98149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f725f7d1-aa66-4f2a-9324-5e9d368d74a3 Nov 02 12:33:18 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:18 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f725f7d1-aa66-4f2a-9324-5e9d368d74a3" returned: 0 in 0.332s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:18 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:33:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:33:18 devstack cinder-volume[86515]: DEBUG cinder.volume.volume_utils [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Attempting download of 4d531188-e398-41fe-8056-e52aa8e7c4ab ((None, [{'url': 'file:///opt/stack/data/glance/images/4d531188-e398-41fe-8056-e52aa8e7c4ab', 'metadata': {}}])) to volume f725f7d1-aa66-4f2a-9324-5e9d368d74a3. {{(pid=86515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 12:33:18 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[385de27e-494a-4b1e-aa2a-7a56feaedc9f]: (4, 'raw') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:33:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d531188-e398-41fe-8056-e52aa8e7c4ab_02uk1i5z {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:18 devstack sudo[98152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d531188-e398-41fe-8056-e52aa8e7c4ab_02uk1i5z Nov 02 12:33:18 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:19 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d531188-e398-41fe-8056-e52aa8e7c4ab_02uk1i5z" returned: 0 in 0.571s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d531188-e398-41fe-8056-e52aa8e7c4ab_02uk1i5z {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:19 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d531188-e398-41fe-8056-e52aa8e7c4ab_02uk1i5z Nov 02 12:33:19 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:19 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d531188-e398-41fe-8056-e52aa8e7c4ab_02uk1i5z" returned: 1 in 0.363s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d531188-e398-41fe-8056-e52aa8e7c4ab_02uk1i5z' failed. Not Retrying. {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:33:19 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8d4643-bca8-4e99-93ce-6b14a25935fc]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:33:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_0zyhnrjjdevstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:19 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_0zyhnrjjdevstack@QuobyteHD Nov 02 12:33:19 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:20 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_0zyhnrjjdevstack@QuobyteHD" returned: 0 in 0.471s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:20 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] 4d531188-e398-41fe-8056-e52aa8e7c4ab was qcow2, converting to qcow2 {{(pid=86515) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 12:33:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_0zyhnrjjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f725f7d1-aa66-4f2a-9324-5e9d368d74a3 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:20 devstack sudo[98186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_0zyhnrjjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f725f7d1-aa66-4f2a-9324-5e9d368d74a3 Nov 02 12:33:20 devstack sudo[98186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:22 devstack sudo[98186]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_0zyhnrjjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f725f7d1-aa66-4f2a-9324-5e9d368d74a3" returned: 0 in 2.494s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:22 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_0zyhnrjjdevstack@QuobyteHD, size 112.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f725f7d1-aa66-4f2a-9324-5e9d368d74a3 {{(pid=86515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 12:33:22 devstack cinder-volume[86515]: INFO cinder.image.image_utils [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Converted 112.00 MB image at 44.89 MB/s Nov 02 12:33:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f725f7d1-aa66-4f2a-9324-5e9d368d74a3 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:22 devstack sudo[98197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f725f7d1-aa66-4f2a-9324-5e9d368d74a3 1G Nov 02 12:33:22 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:23 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f725f7d1-aa66-4f2a-9324-5e9d368d74a3 1G" returned: 0 in 0.366s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:23 devstack cinder-volume[86515]: DEBUG cinder.volume.volume_utils [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Downloaded image 4d531188-e398-41fe-8056-e52aa8e7c4ab ((None, [{'url': 'file:///opt/stack/data/glance/images/4d531188-e398-41fe-8056-e52aa8e7c4ab', 'metadata': {}}])) to volume f725f7d1-aa66-4f2a-9324-5e9d368d74a3 successfully. {{(pid=86515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 12:33:23 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Temporary image 4d531188-e398-41fe-8056-e52aa8e7c4ab for user 4a860355a6644529af2302fae112bdfe is deleted. {{(pid=86515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 12:33:23 devstack cinder-volume[86515]: DEBUG cinder.volume.volume_utils [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Marking volume f725f7d1-aa66-4f2a-9324-5e9d368d74a3 as bootable. {{(pid=86515) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 12:33:23 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Copying metadata from image 4d531188-e398-41fe-8056-e52aa8e7c4ab to f725f7d1-aa66-4f2a-9324-5e9d368d74a3. {{(pid=86515) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 12:33:23 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Creating volume glance metadata for volume f725f7d1-aa66-4f2a-9324-5e9d368d74a3 backed by image 4d531188-e398-41fe-8056-e52aa8e7c4ab with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4d531188-e398-41fe-8056-e52aa8e7c4ab', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86515) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 12:33:23 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fee61ac-3f3b-430f-a112-622702bc3366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f725f7d1-aa66-4f2a-9324-5e9d368d74a3', 'volume_size': 1, 'image_id': '4d531188-e398-41fe-8056-e52aa8e7c4ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d531188-e398-41fe-8056-e52aa8e7c4ab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ea64174531846a688f10d8f38a757ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d531188-e398-41fe-8056-e52aa8e7c4ab', 'created_at': datetime.datetime(2026, 11, 2, 11, 16, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 16, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d531188-e398-41fe-8056-e52aa8e7c4ab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:23 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4916fd9-d14c-47c9-9438-93c0242cdae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:23 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Volume volume-f725f7d1-aa66-4f2a-9324-5e9d368d74a3 (f725f7d1-aa66-4f2a-9324-5e9d368d74a3): created successfully Nov 02 12:33:23 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4916fd9-d14c-47c9-9438-93c0242cdae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:23 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Flow 'volume_create_manager' (c6f0a88d-79ea-40ef-b11a-df27d36e8a26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:33:23 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-77e7ab89-1899-4945-8969-9c351efab6b0 tempest-VolumesGetTest-46404158 None] Created volume successfully. Nov 02 12:33:25 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca72084d-7610-4a5e-ab1f-a85bc01bd63a tempest-VolumesGetTest-46404158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:33:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ca72084d-7610-4a5e-ab1f-a85bc01bd63a tempest-VolumesGetTest-46404158 None] Flow 'volume_create_manager' (fdf0da8b-5687-43f0-9b3e-0e367ee5058b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:33:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ca72084d-7610-4a5e-ab1f-a85bc01bd63a tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f789a42-55f9-478b-8fb8-b9ad08eae83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ca72084d-7610-4a5e-ab1f-a85bc01bd63a tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f789a42-55f9-478b-8fb8-b9ad08eae83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:33:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-777305409',display_name='tempest-VolumesGetTest-Volume-1474809944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0a75f27-2ffd-478a-ab0d-d4da5c7f6771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f767ab595024bab992b0a3110ac694b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:33:25Z,use_quota=True,user_id='4a860355a6644529af2302fae112bdfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ca72084d-7610-4a5e-ab1f-a85bc01bd63a tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a95e1a-1e56-4dcd-9d10-4e700509f03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ca72084d-7610-4a5e-ab1f-a85bc01bd63a tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a95e1a-1e56-4dcd-9d10-4e700509f03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ca72084d-7610-4a5e-ab1f-a85bc01bd63a tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5feea86e-413e-44f3-a3c1-22269c450eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ca72084d-7610-4a5e-ab1f-a85bc01bd63a tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5feea86e-413e-44f3-a3c1-22269c450eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0a75f27-2ffd-478a-ab0d-d4da5c7f6771', 'volume_name': 'volume-e0a75f27-2ffd-478a-ab0d-d4da5c7f6771', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ca72084d-7610-4a5e-ab1f-a85bc01bd63a tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2d3ea1c-15ca-47eb-8d32-aa0d2c2d7a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ca72084d-7610-4a5e-ab1f-a85bc01bd63a tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2d3ea1c-15ca-47eb-8d32-aa0d2c2d7a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ca72084d-7610-4a5e-ab1f-a85bc01bd63a tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ee1514-32e0-4bcf-a4d7-b546f76f6e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:25 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-ca72084d-7610-4a5e-ab1f-a85bc01bd63a tempest-VolumesGetTest-46404158 None] Volume e0a75f27-2ffd-478a-ab0d-d4da5c7f6771: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0a75f27-2ffd-478a-ab0d-d4da5c7f6771', 'volume_size': 1} Nov 02 12:33:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ca72084d-7610-4a5e-ab1f-a85bc01bd63a tempest-VolumesGetTest-46404158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:33:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ca72084d-7610-4a5e-ab1f-a85bc01bd63a tempest-VolumesGetTest-46404158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:33:25 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ca72084d-7610-4a5e-ab1f-a85bc01bd63a tempest-VolumesGetTest-46404158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:33:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-777305409',display_name='tempest-VolumesGetTest-Volume-1474809944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0a75f27-2ffd-478a-ab0d-d4da5c7f6771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f767ab595024bab992b0a3110ac694b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:33:25Z,use_quota=True,user_id='4a860355a6644529af2302fae112bdfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:33:25 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-ca72084d-7610-4a5e-ab1f-a85bc01bd63a tempest-VolumesGetTest-46404158 None] Creating volume e0a75f27-2ffd-478a-ab0d-d4da5c7f6771 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:33:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ca72084d-7610-4a5e-ab1f-a85bc01bd63a tempest-VolumesGetTest-46404158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:33:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ca72084d-7610-4a5e-ab1f-a85bc01bd63a tempest-VolumesGetTest-46404158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:33:25 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ca72084d-7610-4a5e-ab1f-a85bc01bd63a tempest-VolumesGetTest-46404158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:33:25 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ca72084d-7610-4a5e-ab1f-a85bc01bd63a tempest-VolumesGetTest-46404158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:33:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ca72084d-7610-4a5e-ab1f-a85bc01bd63a tempest-VolumesGetTest-46404158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:33:25 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ca72084d-7610-4a5e-ab1f-a85bc01bd63a tempest-VolumesGetTest-46404158 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:33:25 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-ca72084d-7610-4a5e-ab1f-a85bc01bd63a tempest-VolumesGetTest-46404158 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:33:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ca72084d-7610-4a5e-ab1f-a85bc01bd63a tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0a75f27-2ffd-478a-ab0d-d4da5c7f6771 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:25 devstack sudo[98204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0a75f27-2ffd-478a-ab0d-d4da5c7f6771 1073741824 Nov 02 12:33:25 devstack sudo[98204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:26 devstack sudo[98204]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ca72084d-7610-4a5e-ab1f-a85bc01bd63a tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0a75f27-2ffd-478a-ab0d-d4da5c7f6771 1073741824" returned: 0 in 0.487s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ca72084d-7610-4a5e-ab1f-a85bc01bd63a tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0a75f27-2ffd-478a-ab0d-d4da5c7f6771 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:26 devstack sudo[98210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0a75f27-2ffd-478a-ab0d-d4da5c7f6771 Nov 02 12:33:26 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:26 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ca72084d-7610-4a5e-ab1f-a85bc01bd63a tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0a75f27-2ffd-478a-ab0d-d4da5c7f6771" returned: 0 in 0.325s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:26 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ca72084d-7610-4a5e-ab1f-a85bc01bd63a tempest-VolumesGetTest-46404158 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:33:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ca72084d-7610-4a5e-ab1f-a85bc01bd63a tempest-VolumesGetTest-46404158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:33:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ca72084d-7610-4a5e-ab1f-a85bc01bd63a tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ee1514-32e0-4bcf-a4d7-b546f76f6e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0a75f27-2ffd-478a-ab0d-d4da5c7f6771', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ca72084d-7610-4a5e-ab1f-a85bc01bd63a tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eecf3ec3-30a3-4627-8904-f2aad295990f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:26 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-ca72084d-7610-4a5e-ab1f-a85bc01bd63a tempest-VolumesGetTest-46404158 None] Volume volume-e0a75f27-2ffd-478a-ab0d-d4da5c7f6771 (e0a75f27-2ffd-478a-ab0d-d4da5c7f6771): created successfully Nov 02 12:33:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ca72084d-7610-4a5e-ab1f-a85bc01bd63a tempest-VolumesGetTest-46404158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eecf3ec3-30a3-4627-8904-f2aad295990f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ca72084d-7610-4a5e-ab1f-a85bc01bd63a tempest-VolumesGetTest-46404158 None] Flow 'volume_create_manager' (fdf0da8b-5687-43f0-9b3e-0e367ee5058b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:33:26 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-ca72084d-7610-4a5e-ab1f-a85bc01bd63a tempest-VolumesGetTest-46404158 None] Created volume successfully. Nov 02 12:33:27 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b171ceac-928d-487b-bf31-96ff8a3f63a1 tempest-VolumesGetTest-46404158 None] Acquiring lock "cinder-e0a75f27-2ffd-478a-ab0d-d4da5c7f6771-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:33:27 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b171ceac-928d-487b-bf31-96ff8a3f63a1 tempest-VolumesGetTest-46404158 None] Lock "cinder-e0a75f27-2ffd-478a-ab0d-d4da5c7f6771-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:33:27 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b171ceac-928d-487b-bf31-96ff8a3f63a1 tempest-VolumesGetTest-46404158 None] Acquiring lock "cinder-quobyte-e0a75f27-2ffd-478a-ab0d-d4da5c7f6771" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:33:27 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b171ceac-928d-487b-bf31-96ff8a3f63a1 tempest-VolumesGetTest-46404158 None] Lock "cinder-quobyte-e0a75f27-2ffd-478a-ab0d-d4da5c7f6771" acquired by "delete_volume" :: waited 0.025s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:33:27 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d2c2f3-50f3-44ce-9e44-c6dbf9d75233]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:33:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b171ceac-928d-487b-bf31-96ff8a3f63a1 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0a75f27-2ffd-478a-ab0d-d4da5c7f6771 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:27 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0a75f27-2ffd-478a-ab0d-d4da5c7f6771 Nov 02 12:33:27 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:28 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b171ceac-928d-487b-bf31-96ff8a3f63a1 tempest-VolumesGetTest-46404158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0a75f27-2ffd-478a-ab0d-d4da5c7f6771" returned: 0 in 0.444s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b171ceac-928d-487b-bf31-96ff8a3f63a1 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0a75f27-2ffd-478a-ab0d-d4da5c7f6771 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:28 devstack sudo[98234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0a75f27-2ffd-478a-ab0d-d4da5c7f6771 Nov 02 12:33:28 devstack sudo[98234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:28 devstack sudo[98234]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b171ceac-928d-487b-bf31-96ff8a3f63a1 tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e0a75f27-2ffd-478a-ab0d-d4da5c7f6771" returned: 0 in 0.323s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b171ceac-928d-487b-bf31-96ff8a3f63a1 tempest-VolumesGetTest-46404158 None] Lock "cinder-quobyte-e0a75f27-2ffd-478a-ab0d-d4da5c7f6771" released by "delete_volume" :: held 0.828s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:33:28 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-b171ceac-928d-487b-bf31-96ff8a3f63a1 tempest-VolumesGetTest-46404158 None] Created reservations ['267929e4-8281-428d-8d39-cf00d6a08fe8', '1ca6fddf-e12c-41d9-bec0-219a3b047bf5', '8bd60246-8372-4c66-8e69-96806002254d', 'd9e5c0f2-fde0-4d0b-adfb-9a8fe4458c7b'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:33:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b171ceac-928d-487b-bf31-96ff8a3f63a1 tempest-VolumesGetTest-46404158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:33:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b171ceac-928d-487b-bf31-96ff8a3f63a1 tempest-VolumesGetTest-46404158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:33:28 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b171ceac-928d-487b-bf31-96ff8a3f63a1 tempest-VolumesGetTest-46404158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:33:28 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b171ceac-928d-487b-bf31-96ff8a3f63a1 tempest-VolumesGetTest-46404158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:33:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b171ceac-928d-487b-bf31-96ff8a3f63a1 tempest-VolumesGetTest-46404158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:33:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b171ceac-928d-487b-bf31-96ff8a3f63a1 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:28 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:33:28 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:29 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7747325f-adbe-454a-b3ad-4c4e26727ec9 tempest-VolumesGetTest-46404158 None] Acquiring lock "cinder-f725f7d1-aa66-4f2a-9324-5e9d368d74a3-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:33:29 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7747325f-adbe-454a-b3ad-4c4e26727ec9 tempest-VolumesGetTest-46404158 None] Lock "cinder-f725f7d1-aa66-4f2a-9324-5e9d368d74a3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:33:29 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7747325f-adbe-454a-b3ad-4c4e26727ec9 tempest-VolumesGetTest-46404158 None] Acquiring lock "cinder-quobyte-f725f7d1-aa66-4f2a-9324-5e9d368d74a3" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:33:29 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7747325f-adbe-454a-b3ad-4c4e26727ec9 tempest-VolumesGetTest-46404158 None] Lock "cinder-quobyte-f725f7d1-aa66-4f2a-9324-5e9d368d74a3" acquired by "delete_volume" :: waited 0.020s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:33:29 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89ca6d9-4ff6-4928-aa84-578672470f85]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:33:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7747325f-adbe-454a-b3ad-4c4e26727ec9 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f725f7d1-aa66-4f2a-9324-5e9d368d74a3 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:29 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b171ceac-928d-487b-bf31-96ff8a3f63a1 tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.473s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:29 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-b171ceac-928d-487b-bf31-96ff8a3f63a1 tempest-VolumesGetTest-46404158 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:33:29 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-b171ceac-928d-487b-bf31-96ff8a3f63a1 tempest-VolumesGetTest-46404158 None] Deleted volume successfully. Nov 02 12:33:29 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b171ceac-928d-487b-bf31-96ff8a3f63a1 tempest-VolumesGetTest-46404158 None] Lock "cinder-e0a75f27-2ffd-478a-ab0d-d4da5c7f6771-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:33:29 devstack sudo[98245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f725f7d1-aa66-4f2a-9324-5e9d368d74a3 Nov 02 12:33:29 devstack sudo[98245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:29 devstack sudo[98245]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7747325f-adbe-454a-b3ad-4c4e26727ec9 tempest-VolumesGetTest-46404158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f725f7d1-aa66-4f2a-9324-5e9d368d74a3" returned: 0 in 0.395s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7747325f-adbe-454a-b3ad-4c4e26727ec9 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f725f7d1-aa66-4f2a-9324-5e9d368d74a3 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:29 devstack sudo[98250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f725f7d1-aa66-4f2a-9324-5e9d368d74a3 Nov 02 12:33:29 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:29 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7747325f-adbe-454a-b3ad-4c4e26727ec9 tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f725f7d1-aa66-4f2a-9324-5e9d368d74a3" returned: 0 in 0.255s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:29 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7747325f-adbe-454a-b3ad-4c4e26727ec9 tempest-VolumesGetTest-46404158 None] Lock "cinder-quobyte-f725f7d1-aa66-4f2a-9324-5e9d368d74a3" released by "delete_volume" :: held 0.722s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:33:30 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-7747325f-adbe-454a-b3ad-4c4e26727ec9 tempest-VolumesGetTest-46404158 None] Created reservations ['8dbdd81a-6a21-4d81-a47f-d7d5ed7c72f3', 'a9fa4dab-3e39-4948-9a1b-f0b2c2ac28fc', '168d8c39-0d19-4841-90c2-82d00be18b46', '46420d2a-2e8e-464a-9f2c-cfed1827c8c5'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:33:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7747325f-adbe-454a-b3ad-4c4e26727ec9 tempest-VolumesGetTest-46404158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:33:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7747325f-adbe-454a-b3ad-4c4e26727ec9 tempest-VolumesGetTest-46404158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:33:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-7747325f-adbe-454a-b3ad-4c4e26727ec9 tempest-VolumesGetTest-46404158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:33:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-7747325f-adbe-454a-b3ad-4c4e26727ec9 tempest-VolumesGetTest-46404158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:33:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7747325f-adbe-454a-b3ad-4c4e26727ec9 tempest-VolumesGetTest-46404158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:33:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7747325f-adbe-454a-b3ad-4c4e26727ec9 tempest-VolumesGetTest-46404158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:30 devstack sudo[98254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:33:30 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:30 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7747325f-adbe-454a-b3ad-4c4e26727ec9 tempest-VolumesGetTest-46404158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.400s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:30 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-7747325f-adbe-454a-b3ad-4c4e26727ec9 tempest-VolumesGetTest-46404158 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:33:30 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-7747325f-adbe-454a-b3ad-4c4e26727ec9 tempest-VolumesGetTest-46404158 None] Deleted volume successfully. Nov 02 12:33:30 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7747325f-adbe-454a-b3ad-4c4e26727ec9 tempest-VolumesGetTest-46404158 None] Lock "cinder-f725f7d1-aa66-4f2a-9324-5e9d368d74a3-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:33:30 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-8183c2c5-e917-4866-bfd9-e6f4a9b85580 tempest-TestInstancesWithCinderVolumes-1242200050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:33:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8183c2c5-e917-4866-bfd9-e6f4a9b85580 tempest-TestInstancesWithCinderVolumes-1242200050 None] Flow 'volume_create_manager' (e872008e-09d4-4d40-843f-956deac8a8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:33:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8183c2c5-e917-4866-bfd9-e6f4a9b85580 tempest-TestInstancesWithCinderVolumes-1242200050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b1bff22-de35-4e31-9325-4e7246fce85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8183c2c5-e917-4866-bfd9-e6f4a9b85580 tempest-TestInstancesWithCinderVolumes-1242200050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b1bff22-de35-4e31-9325-4e7246fce85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1824557301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41837457-d319-4564-a546-a0e4b6dc9d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4d09f042354e3aa3bb6dbbf131326d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:33:31Z,use_quota=True,user_id='0a2e363f8b0944fe9c8ee02c9a69c299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d48592b1-0761-403f-87ad-f15b918e3d90),volume_type_id=d48592b1-0761-403f-87ad-f15b918e3d90)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8183c2c5-e917-4866-bfd9-e6f4a9b85580 tempest-TestInstancesWithCinderVolumes-1242200050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c600bbd-1236-48c8-8c3b-476ea358912f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8183c2c5-e917-4866-bfd9-e6f4a9b85580 tempest-TestInstancesWithCinderVolumes-1242200050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c600bbd-1236-48c8-8c3b-476ea358912f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8183c2c5-e917-4866-bfd9-e6f4a9b85580 tempest-TestInstancesWithCinderVolumes-1242200050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c87fd53-6138-44a3-8e75-dad8fb9a2e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8183c2c5-e917-4866-bfd9-e6f4a9b85580 tempest-TestInstancesWithCinderVolumes-1242200050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c87fd53-6138-44a3-8e75-dad8fb9a2e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41837457-d319-4564-a546-a0e4b6dc9d8a', 'volume_name': 'volume-41837457-d319-4564-a546-a0e4b6dc9d8a', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8183c2c5-e917-4866-bfd9-e6f4a9b85580 tempest-TestInstancesWithCinderVolumes-1242200050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b344b7a6-df25-43f1-8041-b57f79c659d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8183c2c5-e917-4866-bfd9-e6f4a9b85580 tempest-TestInstancesWithCinderVolumes-1242200050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b344b7a6-df25-43f1-8041-b57f79c659d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8183c2c5-e917-4866-bfd9-e6f4a9b85580 tempest-TestInstancesWithCinderVolumes-1242200050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e772cfe-ce1f-47a1-add0-14d48d23572a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:30 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-8183c2c5-e917-4866-bfd9-e6f4a9b85580 tempest-TestInstancesWithCinderVolumes-1242200050 None] Volume 41837457-d319-4564-a546-a0e4b6dc9d8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41837457-d319-4564-a546-a0e4b6dc9d8a', 'volume_size': 1} Nov 02 12:33:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8183c2c5-e917-4866-bfd9-e6f4a9b85580 tempest-TestInstancesWithCinderVolumes-1242200050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:33:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8183c2c5-e917-4866-bfd9-e6f4a9b85580 tempest-TestInstancesWithCinderVolumes-1242200050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:33:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8183c2c5-e917-4866-bfd9-e6f4a9b85580 tempest-TestInstancesWithCinderVolumes-1242200050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1824557301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41837457-d319-4564-a546-a0e4b6dc9d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4d09f042354e3aa3bb6dbbf131326d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:33:31Z,use_quota=True,user_id='0a2e363f8b0944fe9c8ee02c9a69c299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d48592b1-0761-403f-87ad-f15b918e3d90),volume_type_id=d48592b1-0761-403f-87ad-f15b918e3d90)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:33:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-8183c2c5-e917-4866-bfd9-e6f4a9b85580 tempest-TestInstancesWithCinderVolumes-1242200050 None] Creating volume 41837457-d319-4564-a546-a0e4b6dc9d8a {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:33:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8183c2c5-e917-4866-bfd9-e6f4a9b85580 tempest-TestInstancesWithCinderVolumes-1242200050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:33:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8183c2c5-e917-4866-bfd9-e6f4a9b85580 tempest-TestInstancesWithCinderVolumes-1242200050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:33:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8183c2c5-e917-4866-bfd9-e6f4a9b85580 tempest-TestInstancesWithCinderVolumes-1242200050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:33:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8183c2c5-e917-4866-bfd9-e6f4a9b85580 tempest-TestInstancesWithCinderVolumes-1242200050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:33:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8183c2c5-e917-4866-bfd9-e6f4a9b85580 tempest-TestInstancesWithCinderVolumes-1242200050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:33:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8183c2c5-e917-4866-bfd9-e6f4a9b85580 tempest-TestInstancesWithCinderVolumes-1242200050 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:33:30 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-8183c2c5-e917-4866-bfd9-e6f4a9b85580 tempest-TestInstancesWithCinderVolumes-1242200050 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:33:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8183c2c5-e917-4866-bfd9-e6f4a9b85580 tempest-TestInstancesWithCinderVolumes-1242200050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-41837457-d319-4564-a546-a0e4b6dc9d8a 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:30 devstack sudo[98257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-41837457-d319-4564-a546-a0e4b6dc9d8a 1073741824 Nov 02 12:33:30 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:31 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-68f5b723-67c8-40c0-9b72-366be5c92c35 tempest-TestInstancesWithCinderVolumes-1242200050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:33:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-68f5b723-67c8-40c0-9b72-366be5c92c35 tempest-TestInstancesWithCinderVolumes-1242200050 None] Flow 'volume_create_manager' (46f94698-e332-484a-abe5-d12984039fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:33:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-68f5b723-67c8-40c0-9b72-366be5c92c35 tempest-TestInstancesWithCinderVolumes-1242200050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8288b933-7ff1-4d8d-88f1-d46cedf7ca30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-68f5b723-67c8-40c0-9b72-366be5c92c35 tempest-TestInstancesWithCinderVolumes-1242200050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8288b933-7ff1-4d8d-88f1-d46cedf7ca30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1145310873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9850101b-f5d4-4cf0-b552-4627d5ba609c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4d09f042354e3aa3bb6dbbf131326d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:33:31Z,use_quota=True,user_id='0a2e363f8b0944fe9c8ee02c9a69c299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1eed862b-e540-401f-b678-388e5bec060a),volume_type_id=1eed862b-e540-401f-b678-388e5bec060a)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-68f5b723-67c8-40c0-9b72-366be5c92c35 tempest-TestInstancesWithCinderVolumes-1242200050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd6c9c84-c31f-43e7-aa4b-42b5cc643044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-68f5b723-67c8-40c0-9b72-366be5c92c35 tempest-TestInstancesWithCinderVolumes-1242200050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd6c9c84-c31f-43e7-aa4b-42b5cc643044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-68f5b723-67c8-40c0-9b72-366be5c92c35 tempest-TestInstancesWithCinderVolumes-1242200050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4987c50-e4bd-4171-8229-0eb226f8b218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-68f5b723-67c8-40c0-9b72-366be5c92c35 tempest-TestInstancesWithCinderVolumes-1242200050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4987c50-e4bd-4171-8229-0eb226f8b218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9850101b-f5d4-4cf0-b552-4627d5ba609c', 'volume_name': 'volume-9850101b-f5d4-4cf0-b552-4627d5ba609c', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-68f5b723-67c8-40c0-9b72-366be5c92c35 tempest-TestInstancesWithCinderVolumes-1242200050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01bdb47-f7e7-4232-9680-bd6d24c7623c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-68f5b723-67c8-40c0-9b72-366be5c92c35 tempest-TestInstancesWithCinderVolumes-1242200050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01bdb47-f7e7-4232-9680-bd6d24c7623c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-68f5b723-67c8-40c0-9b72-366be5c92c35 tempest-TestInstancesWithCinderVolumes-1242200050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ef5cce-6398-424f-825f-15900e21fab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:31 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-68f5b723-67c8-40c0-9b72-366be5c92c35 tempest-TestInstancesWithCinderVolumes-1242200050 None] Volume 9850101b-f5d4-4cf0-b552-4627d5ba609c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9850101b-f5d4-4cf0-b552-4627d5ba609c', 'volume_size': 1} Nov 02 12:33:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-68f5b723-67c8-40c0-9b72-366be5c92c35 tempest-TestInstancesWithCinderVolumes-1242200050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:33:31 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8183c2c5-e917-4866-bfd9-e6f4a9b85580 tempest-TestInstancesWithCinderVolumes-1242200050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-41837457-d319-4564-a546-a0e4b6dc9d8a 1073741824" returned: 0 in 1.014s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8183c2c5-e917-4866-bfd9-e6f4a9b85580 tempest-TestInstancesWithCinderVolumes-1242200050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-41837457-d319-4564-a546-a0e4b6dc9d8a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:31 devstack sudo[98316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-41837457-d319-4564-a546-a0e4b6dc9d8a Nov 02 12:33:31 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:32 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8183c2c5-e917-4866-bfd9-e6f4a9b85580 tempest-TestInstancesWithCinderVolumes-1242200050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-41837457-d319-4564-a546-a0e4b6dc9d8a" returned: 0 in 0.444s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:32 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8183c2c5-e917-4866-bfd9-e6f4a9b85580 tempest-TestInstancesWithCinderVolumes-1242200050 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:33:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8183c2c5-e917-4866-bfd9-e6f4a9b85580 tempest-TestInstancesWithCinderVolumes-1242200050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:33:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-68f5b723-67c8-40c0-9b72-366be5c92c35 tempest-TestInstancesWithCinderVolumes-1242200050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.862s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:33:32 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-68f5b723-67c8-40c0-9b72-366be5c92c35 tempest-TestInstancesWithCinderVolumes-1242200050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1145310873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9850101b-f5d4-4cf0-b552-4627d5ba609c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4d09f042354e3aa3bb6dbbf131326d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:33:31Z,use_quota=True,user_id='0a2e363f8b0944fe9c8ee02c9a69c299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1eed862b-e540-401f-b678-388e5bec060a),volume_type_id=1eed862b-e540-401f-b678-388e5bec060a)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:33:32 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-68f5b723-67c8-40c0-9b72-366be5c92c35 tempest-TestInstancesWithCinderVolumes-1242200050 None] Creating volume 9850101b-f5d4-4cf0-b552-4627d5ba609c {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:33:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-68f5b723-67c8-40c0-9b72-366be5c92c35 tempest-TestInstancesWithCinderVolumes-1242200050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:33:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-68f5b723-67c8-40c0-9b72-366be5c92c35 tempest-TestInstancesWithCinderVolumes-1242200050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:33:32 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-68f5b723-67c8-40c0-9b72-366be5c92c35 tempest-TestInstancesWithCinderVolumes-1242200050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:33:32 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-68f5b723-67c8-40c0-9b72-366be5c92c35 tempest-TestInstancesWithCinderVolumes-1242200050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:33:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-68f5b723-67c8-40c0-9b72-366be5c92c35 tempest-TestInstancesWithCinderVolumes-1242200050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:33:32 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-68f5b723-67c8-40c0-9b72-366be5c92c35 tempest-TestInstancesWithCinderVolumes-1242200050 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:33:32 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-68f5b723-67c8-40c0-9b72-366be5c92c35 tempest-TestInstancesWithCinderVolumes-1242200050 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:33:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-68f5b723-67c8-40c0-9b72-366be5c92c35 tempest-TestInstancesWithCinderVolumes-1242200050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9850101b-f5d4-4cf0-b552-4627d5ba609c 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:32 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8183c2c5-e917-4866-bfd9-e6f4a9b85580 tempest-TestInstancesWithCinderVolumes-1242200050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e772cfe-ce1f-47a1-add0-14d48d23572a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41837457-d319-4564-a546-a0e4b6dc9d8a', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:32 devstack sudo[98330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9850101b-f5d4-4cf0-b552-4627d5ba609c 1073741824 Nov 02 12:33:32 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:32 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8183c2c5-e917-4866-bfd9-e6f4a9b85580 tempest-TestInstancesWithCinderVolumes-1242200050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d22a295-0eb6-4f02-a730-660925cea74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:32 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-8183c2c5-e917-4866-bfd9-e6f4a9b85580 tempest-TestInstancesWithCinderVolumes-1242200050 None] Volume volume-41837457-d319-4564-a546-a0e4b6dc9d8a (41837457-d319-4564-a546-a0e4b6dc9d8a): created successfully Nov 02 12:33:32 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8183c2c5-e917-4866-bfd9-e6f4a9b85580 tempest-TestInstancesWithCinderVolumes-1242200050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d22a295-0eb6-4f02-a730-660925cea74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:32 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8183c2c5-e917-4866-bfd9-e6f4a9b85580 tempest-TestInstancesWithCinderVolumes-1242200050 None] Flow 'volume_create_manager' (e872008e-09d4-4d40-843f-956deac8a8f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:33:32 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-8183c2c5-e917-4866-bfd9-e6f4a9b85580 tempest-TestInstancesWithCinderVolumes-1242200050 None] Created volume successfully. Nov 02 12:33:33 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:33:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Flow 'volume_create_manager' (be00c6a3-20e8-4573-bc75-f38d734605b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:33:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4298e32d-a17d-49d5-a4af-c8e9131d05fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4298e32d-a17d-49d5-a4af-c8e9131d05fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-824876036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=483fab07-3d93-4561-9322-c1d2327b1d56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4d09f042354e3aa3bb6dbbf131326d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:33:33Z,use_quota=True,user_id='0a2e363f8b0944fe9c8ee02c9a69c299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dd43900-c442-4412-a6dc-37ece34bcd1a),volume_type_id=6dd43900-c442-4412-a6dc-37ece34bcd1a)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d1cb5c-52c8-4916-a0d8-45ed71f621c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d1cb5c-52c8-4916-a0d8-45ed71f621c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c50ace58-a4ef-4ece-a65b-2ad8a452efc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:33 devstack cinder-volume[86515]: DEBUG cinder.image.glance [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Creating Keystone auth plugin from conf {{(pid=86515) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 12:33:33 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-68f5b723-67c8-40c0-9b72-366be5c92c35 tempest-TestInstancesWithCinderVolumes-1242200050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9850101b-f5d4-4cf0-b552-4627d5ba609c 1073741824" returned: 0 in 1.005s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-68f5b723-67c8-40c0-9b72-366be5c92c35 tempest-TestInstancesWithCinderVolumes-1242200050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9850101b-f5d4-4cf0-b552-4627d5ba609c {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:33 devstack sudo[98342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9850101b-f5d4-4cf0-b552-4627d5ba609c Nov 02 12:33:33 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c50ace58-a4ef-4ece-a65b-2ad8a452efc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '483fab07-3d93-4561-9322-c1d2327b1d56', 'volume_name': 'volume-483fab07-3d93-4561-9322-c1d2327b1d56', 'volume_size': 1, 'image_id': '9cb9ff34-1a8c-4adf-967f-2b254f8f4894', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9cb9ff34-1a8c-4adf-967f-2b254f8f4894', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1093537273', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3b4d09f042354e3aa3bb6dbbf131326d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9cb9ff34-1a8c-4adf-967f-2b254f8f4894', 'created_at': datetime.datetime(2026, 11, 2, 11, 33, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 33, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9cb9ff34-1a8c-4adf-967f-2b254f8f4894/file', 'properties': {}}, 'image_service': }' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72190479-f77e-411b-b107-635376e5df08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72190479-f77e-411b-b107-635376e5df08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50f5aa80-e5a0-411e-9b13-175792116cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:33 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Volume 483fab07-3d93-4561-9322-c1d2327b1d56: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-483fab07-3d93-4561-9322-c1d2327b1d56', 'volume_size': 1, 'image_id': '9cb9ff34-1a8c-4adf-967f-2b254f8f4894', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9cb9ff34-1a8c-4adf-967f-2b254f8f4894', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1093537273', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3b4d09f042354e3aa3bb6dbbf131326d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9cb9ff34-1a8c-4adf-967f-2b254f8f4894', 'created_at': datetime.datetime(2026, 11, 2, 11, 33, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 33, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9cb9ff34-1a8c-4adf-967f-2b254f8f4894/file', 'properties': {}}, 'image_service': } Nov 02 12:33:33 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Trying to clone 483fab07-3d93-4561-9322-c1d2327b1d56 from image 9cb9ff34-1a8c-4adf-967f-2b254f8f4894 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9cb9ff34-1a8c-4adf-967f-2b254f8f4894', 'metadata': {}}]). {{(pid=86515) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1127}} Nov 02 12:33:33 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-68f5b723-67c8-40c0-9b72-366be5c92c35 tempest-TestInstancesWithCinderVolumes-1242200050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9850101b-f5d4-4cf0-b552-4627d5ba609c" returned: 0 in 0.448s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-68f5b723-67c8-40c0-9b72-366be5c92c35 tempest-TestInstancesWithCinderVolumes-1242200050 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:33:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-68f5b723-67c8-40c0-9b72-366be5c92c35 tempest-TestInstancesWithCinderVolumes-1242200050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:33:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-68f5b723-67c8-40c0-9b72-366be5c92c35 tempest-TestInstancesWithCinderVolumes-1242200050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ef5cce-6398-424f-825f-15900e21fab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9850101b-f5d4-4cf0-b552-4627d5ba609c', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-68f5b723-67c8-40c0-9b72-366be5c92c35 tempest-TestInstancesWithCinderVolumes-1242200050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4a4154b-1b22-4211-9677-1e6198a2306d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:33 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-68f5b723-67c8-40c0-9b72-366be5c92c35 tempest-TestInstancesWithCinderVolumes-1242200050 None] Volume volume-9850101b-f5d4-4cf0-b552-4627d5ba609c (9850101b-f5d4-4cf0-b552-4627d5ba609c): created successfully Nov 02 12:33:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-68f5b723-67c8-40c0-9b72-366be5c92c35 tempest-TestInstancesWithCinderVolumes-1242200050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4a4154b-1b22-4211-9677-1e6198a2306d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-68f5b723-67c8-40c0-9b72-366be5c92c35 tempest-TestInstancesWithCinderVolumes-1242200050 None] Flow 'volume_create_manager' (46f94698-e332-484a-abe5-d12984039fd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:33:33 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-68f5b723-67c8-40c0-9b72-366be5c92c35 tempest-TestInstancesWithCinderVolumes-1242200050 None] Created volume successfully. Nov 02 12:33:38 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9cb9ff34-1a8c-4adf-967f-2b254f8f4894_1610o0s7devstack@QuobyteHD, size 20.69 MB, duration 4.40 sec {{(pid=86515) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 12:33:38 devstack cinder-volume[86515]: INFO cinder.image.image_utils [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Image download 20.69 MB at 4.70 MB/s Nov 02 12:33:38 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7392e6c-93e8-4785-8cdb-c6e8f396bd78]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:33:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9cb9ff34-1a8c-4adf-967f-2b254f8f4894_1610o0s7devstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:38 devstack sudo[98351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9cb9ff34-1a8c-4adf-967f-2b254f8f4894_1610o0s7devstack@QuobyteHD Nov 02 12:33:38 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:38 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9cb9ff34-1a8c-4adf-967f-2b254f8f4894_1610o0s7devstack@QuobyteHD" returned: 0 in 0.361s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:38 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Temporary image 9cb9ff34-1a8c-4adf-967f-2b254f8f4894 is fetched for user 0a2e363f8b0944fe9c8ee02c9a69c299. {{(pid=86515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 12:33:38 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8db568-6aa9-4d80-9a62-71b394d13842]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:33:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9cb9ff34-1a8c-4adf-967f-2b254f8f4894_1610o0s7devstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:39 devstack sudo[98390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9cb9ff34-1a8c-4adf-967f-2b254f8f4894_1610o0s7devstack@QuobyteHD Nov 02 12:33:39 devstack sudo[98390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:39 devstack sudo[98390]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9cb9ff34-1a8c-4adf-967f-2b254f8f4894_1610o0s7devstack@QuobyteHD" returned: 0 in 0.438s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:33:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:33:39 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-824876036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=483fab07-3d93-4561-9322-c1d2327b1d56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4d09f042354e3aa3bb6dbbf131326d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:33:33Z,use_quota=True,user_id='0a2e363f8b0944fe9c8ee02c9a69c299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dd43900-c442-4412-a6dc-37ece34bcd1a),volume_type_id=6dd43900-c442-4412-a6dc-37ece34bcd1a)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:33:39 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Creating volume 483fab07-3d93-4561-9322-c1d2327b1d56 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:33:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:33:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:33:39 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:33:39 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:33:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:33:39 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:33:39 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:33:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-483fab07-3d93-4561-9322-c1d2327b1d56 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:39 devstack sudo[98398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-483fab07-3d93-4561-9322-c1d2327b1d56 1073741824 Nov 02 12:33:39 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:39 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-483fab07-3d93-4561-9322-c1d2327b1d56 1073741824" returned: 0 in 0.456s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-483fab07-3d93-4561-9322-c1d2327b1d56 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:39 devstack sudo[98403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-483fab07-3d93-4561-9322-c1d2327b1d56 Nov 02 12:33:39 devstack sudo[98403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:40 devstack sudo[98403]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-483fab07-3d93-4561-9322-c1d2327b1d56" returned: 0 in 0.304s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:40 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:33:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:33:40 devstack cinder-volume[86515]: DEBUG cinder.volume.volume_utils [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Attempting download of 9cb9ff34-1a8c-4adf-967f-2b254f8f4894 ((None, [{'url': 'file:///opt/stack/data/glance/images/9cb9ff34-1a8c-4adf-967f-2b254f8f4894', 'metadata': {}}])) to volume 483fab07-3d93-4561-9322-c1d2327b1d56. {{(pid=86515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 12:33:40 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5012b1b-da87-4c8d-a8ca-e306fff4b923]: (4, 'raw') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:33:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9cb9ff34-1a8c-4adf-967f-2b254f8f4894_s6wzvv49 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:40 devstack sudo[98406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9cb9ff34-1a8c-4adf-967f-2b254f8f4894_s6wzvv49 Nov 02 12:33:40 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:40 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9cb9ff34-1a8c-4adf-967f-2b254f8f4894_s6wzvv49" returned: 0 in 0.356s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9cb9ff34-1a8c-4adf-967f-2b254f8f4894_s6wzvv49 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:40 devstack sudo[98410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9cb9ff34-1a8c-4adf-967f-2b254f8f4894_s6wzvv49 Nov 02 12:33:40 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:40 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9cb9ff34-1a8c-4adf-967f-2b254f8f4894_s6wzvv49" returned: 1 in 0.338s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9cb9ff34-1a8c-4adf-967f-2b254f8f4894_s6wzvv49' failed. Not Retrying. {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:33:40 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c38f553-aa9c-4eb9-a801-64acbfef6d4e]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:33:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9cb9ff34-1a8c-4adf-967f-2b254f8f4894_1610o0s7devstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:41 devstack sudo[98414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9cb9ff34-1a8c-4adf-967f-2b254f8f4894_1610o0s7devstack@QuobyteHD Nov 02 12:33:41 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:41 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9cb9ff34-1a8c-4adf-967f-2b254f8f4894_1610o0s7devstack@QuobyteHD" returned: 0 in 0.504s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:41 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] 9cb9ff34-1a8c-4adf-967f-2b254f8f4894 was qcow2, converting to qcow2 {{(pid=86515) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 12:33:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9cb9ff34-1a8c-4adf-967f-2b254f8f4894_1610o0s7devstack@QuobyteHD /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-483fab07-3d93-4561-9322-c1d2327b1d56 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:41 devstack sudo[98420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9cb9ff34-1a8c-4adf-967f-2b254f8f4894_1610o0s7devstack@QuobyteHD /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-483fab07-3d93-4561-9322-c1d2327b1d56 Nov 02 12:33:41 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:43 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:33:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:33:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:33:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:33:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:33:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:33:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:43 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:33:43 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:44 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9cb9ff34-1a8c-4adf-967f-2b254f8f4894_1610o0s7devstack@QuobyteHD /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-483fab07-3d93-4561-9322-c1d2327b1d56" returned: 0 in 2.593s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:44 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9cb9ff34-1a8c-4adf-967f-2b254f8f4894_1610o0s7devstack@QuobyteHD, size 112.00 MB, duration 2.59 sec, destination /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-483fab07-3d93-4561-9322-c1d2327b1d56 {{(pid=86515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 12:33:44 devstack cinder-volume[86515]: INFO cinder.image.image_utils [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Converted 112.00 MB image at 43.17 MB/s Nov 02 12:33:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-483fab07-3d93-4561-9322-c1d2327b1d56 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:44 devstack sudo[98432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-483fab07-3d93-4561-9322-c1d2327b1d56 1G Nov 02 12:33:44 devstack sudo[98432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:44 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.438s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:44 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:33:44 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager._thread_info {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:33:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread count: 28 {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:33:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread info: [<_MainThread(MainThread, started 129944084402304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:33:44 devstack sudo[98432]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-483fab07-3d93-4561-9322-c1d2327b1d56 1G" returned: 0 in 0.494s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:44 devstack cinder-volume[86515]: DEBUG cinder.volume.volume_utils [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Downloaded image 9cb9ff34-1a8c-4adf-967f-2b254f8f4894 ((None, [{'url': 'file:///opt/stack/data/glance/images/9cb9ff34-1a8c-4adf-967f-2b254f8f4894', 'metadata': {}}])) to volume 483fab07-3d93-4561-9322-c1d2327b1d56 successfully. {{(pid=86515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 12:33:44 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Temporary image 9cb9ff34-1a8c-4adf-967f-2b254f8f4894 for user 0a2e363f8b0944fe9c8ee02c9a69c299 is deleted. {{(pid=86515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 12:33:44 devstack cinder-volume[86515]: DEBUG cinder.volume.volume_utils [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Marking volume 483fab07-3d93-4561-9322-c1d2327b1d56 as bootable. {{(pid=86515) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 12:33:44 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Copying metadata from image 9cb9ff34-1a8c-4adf-967f-2b254f8f4894 to 483fab07-3d93-4561-9322-c1d2327b1d56. {{(pid=86515) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 12:33:44 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Creating volume glance metadata for volume 483fab07-3d93-4561-9322-c1d2327b1d56 backed by image 9cb9ff34-1a8c-4adf-967f-2b254f8f4894 with: {'image_id': '9cb9ff34-1a8c-4adf-967f-2b254f8f4894', 'image_name': 'tempest-scenario-img--1093537273', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86515) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 12:33:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50f5aa80-e5a0-411e-9b13-175792116cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-483fab07-3d93-4561-9322-c1d2327b1d56', 'volume_size': 1, 'image_id': '9cb9ff34-1a8c-4adf-967f-2b254f8f4894', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9cb9ff34-1a8c-4adf-967f-2b254f8f4894', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1093537273', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3b4d09f042354e3aa3bb6dbbf131326d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9cb9ff34-1a8c-4adf-967f-2b254f8f4894', 'created_at': datetime.datetime(2026, 11, 2, 11, 33, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 33, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9cb9ff34-1a8c-4adf-967f-2b254f8f4894/file', 'properties': {}}, 'image_service': }' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53c000e6-f63e-4138-a087-85935bffbdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:44 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Volume volume-483fab07-3d93-4561-9322-c1d2327b1d56 (483fab07-3d93-4561-9322-c1d2327b1d56): created successfully Nov 02 12:33:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53c000e6-f63e-4138-a087-85935bffbdfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Flow 'volume_create_manager' (be00c6a3-20e8-4573-bc75-f38d734605b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:33:44 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-74ff08f7-8a63-45d2-a34a-f5cb1cd9ee84 tempest-TestInstancesWithCinderVolumes-1242200050 None] Created volume successfully. Nov 02 12:33:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-cb8bdbc6-15ca-488c-8e9b-0c5aefa93710 req-baea1e80-1942-4eb2-b297-607abcb85535 tempest-TestInstancesWithCinderVolumes-1242200050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:33:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-cb8bdbc6-15ca-488c-8e9b-0c5aefa93710 req-baea1e80-1942-4eb2-b297-607abcb85535 tempest-TestInstancesWithCinderVolumes-1242200050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:33:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-cb8bdbc6-15ca-488c-8e9b-0c5aefa93710 req-baea1e80-1942-4eb2-b297-607abcb85535 tempest-TestInstancesWithCinderVolumes-1242200050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:33:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-cb8bdbc6-15ca-488c-8e9b-0c5aefa93710 req-baea1e80-1942-4eb2-b297-607abcb85535 tempest-TestInstancesWithCinderVolumes-1242200050 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae', 'name': 'volume-483fab07-3d93-4561-9322-c1d2327b1d56', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bd2a5a3e-6ac2-4341-a5fc-92aca3934d05', 'enforce_multipath': True} {{(pid=86515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:33:48 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-cb8bdbc6-15ca-488c-8e9b-0c5aefa93710 req-baea1e80-1942-4eb2-b297-607abcb85535 tempest-TestInstancesWithCinderVolumes-1242200050 None] attachment_update completed successfully. Nov 02 12:33:56 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-73fe91ba-06de-4b4d-9785-117540935e06 tempest-AttachVolumeNegativeTest-1281562092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:33:56 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-73fe91ba-06de-4b4d-9785-117540935e06 tempest-AttachVolumeNegativeTest-1281562092 None] Flow 'volume_create_manager' (afe84ffe-944d-4ccd-a16d-f5489ab55dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:33:56 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-73fe91ba-06de-4b4d-9785-117540935e06 tempest-AttachVolumeNegativeTest-1281562092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47421bd6-22aa-4f08-b5a9-4b33e6185199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:56 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-73fe91ba-06de-4b4d-9785-117540935e06 tempest-AttachVolumeNegativeTest-1281562092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47421bd6-22aa-4f08-b5a9-4b33e6185199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-708751550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cf4066e-5a5d-4fa4-8e06-c8527d35089a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9c7d8a596348cdbef96a1243897c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:33:57Z,use_quota=True,user_id='7a7a7fce4a9b4e0fa44b300004914ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:56 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-73fe91ba-06de-4b4d-9785-117540935e06 tempest-AttachVolumeNegativeTest-1281562092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9841bef5-8a17-4e93-9029-85d36a2e2032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:56 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-73fe91ba-06de-4b4d-9785-117540935e06 tempest-AttachVolumeNegativeTest-1281562092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9841bef5-8a17-4e93-9029-85d36a2e2032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:56 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-73fe91ba-06de-4b4d-9785-117540935e06 tempest-AttachVolumeNegativeTest-1281562092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f04e3b22-fbd3-425b-ba58-50349e25a9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:56 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-73fe91ba-06de-4b4d-9785-117540935e06 tempest-AttachVolumeNegativeTest-1281562092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f04e3b22-fbd3-425b-ba58-50349e25a9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cf4066e-5a5d-4fa4-8e06-c8527d35089a', 'volume_name': 'volume-1cf4066e-5a5d-4fa4-8e06-c8527d35089a', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-73fe91ba-06de-4b4d-9785-117540935e06 tempest-AttachVolumeNegativeTest-1281562092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab9430b0-aa9f-48c6-8741-1e0d2f194443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-73fe91ba-06de-4b4d-9785-117540935e06 tempest-AttachVolumeNegativeTest-1281562092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab9430b0-aa9f-48c6-8741-1e0d2f194443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-73fe91ba-06de-4b4d-9785-117540935e06 tempest-AttachVolumeNegativeTest-1281562092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (687ca931-941f-42ba-9ae2-f3c81aeb8cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:57 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-73fe91ba-06de-4b4d-9785-117540935e06 tempest-AttachVolumeNegativeTest-1281562092 None] Volume 1cf4066e-5a5d-4fa4-8e06-c8527d35089a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cf4066e-5a5d-4fa4-8e06-c8527d35089a', 'volume_size': 1} Nov 02 12:33:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-73fe91ba-06de-4b4d-9785-117540935e06 tempest-AttachVolumeNegativeTest-1281562092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:33:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-73fe91ba-06de-4b4d-9785-117540935e06 tempest-AttachVolumeNegativeTest-1281562092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:33:57 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-73fe91ba-06de-4b4d-9785-117540935e06 tempest-AttachVolumeNegativeTest-1281562092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-708751550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cf4066e-5a5d-4fa4-8e06-c8527d35089a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9c7d8a596348cdbef96a1243897c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:33:57Z,use_quota=True,user_id='7a7a7fce4a9b4e0fa44b300004914ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:33:57 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-73fe91ba-06de-4b4d-9785-117540935e06 tempest-AttachVolumeNegativeTest-1281562092 None] Creating volume 1cf4066e-5a5d-4fa4-8e06-c8527d35089a {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:33:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-73fe91ba-06de-4b4d-9785-117540935e06 tempest-AttachVolumeNegativeTest-1281562092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:33:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-73fe91ba-06de-4b4d-9785-117540935e06 tempest-AttachVolumeNegativeTest-1281562092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:33:57 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-73fe91ba-06de-4b4d-9785-117540935e06 tempest-AttachVolumeNegativeTest-1281562092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:33:57 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-73fe91ba-06de-4b4d-9785-117540935e06 tempest-AttachVolumeNegativeTest-1281562092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:33:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-73fe91ba-06de-4b4d-9785-117540935e06 tempest-AttachVolumeNegativeTest-1281562092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:33:57 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-73fe91ba-06de-4b4d-9785-117540935e06 tempest-AttachVolumeNegativeTest-1281562092 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:33:57 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-73fe91ba-06de-4b4d-9785-117540935e06 tempest-AttachVolumeNegativeTest-1281562092 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:33:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-73fe91ba-06de-4b4d-9785-117540935e06 tempest-AttachVolumeNegativeTest-1281562092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1cf4066e-5a5d-4fa4-8e06-c8527d35089a 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:57 devstack sudo[98971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1cf4066e-5a5d-4fa4-8e06-c8527d35089a 1073741824 Nov 02 12:33:57 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:57 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-73fe91ba-06de-4b4d-9785-117540935e06 tempest-AttachVolumeNegativeTest-1281562092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1cf4066e-5a5d-4fa4-8e06-c8527d35089a 1073741824" returned: 0 in 0.858s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-73fe91ba-06de-4b4d-9785-117540935e06 tempest-AttachVolumeNegativeTest-1281562092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1cf4066e-5a5d-4fa4-8e06-c8527d35089a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:33:58 devstack sudo[98977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1cf4066e-5a5d-4fa4-8e06-c8527d35089a Nov 02 12:33:58 devstack sudo[98977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:33:58 devstack sudo[98977]: pam_unix(sudo:session): session closed for user root Nov 02 12:33:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-73fe91ba-06de-4b4d-9785-117540935e06 tempest-AttachVolumeNegativeTest-1281562092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1cf4066e-5a5d-4fa4-8e06-c8527d35089a" returned: 0 in 0.395s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:33:58 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-73fe91ba-06de-4b4d-9785-117540935e06 tempest-AttachVolumeNegativeTest-1281562092 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:33:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-73fe91ba-06de-4b4d-9785-117540935e06 tempest-AttachVolumeNegativeTest-1281562092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:33:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-73fe91ba-06de-4b4d-9785-117540935e06 tempest-AttachVolumeNegativeTest-1281562092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (687ca931-941f-42ba-9ae2-f3c81aeb8cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cf4066e-5a5d-4fa4-8e06-c8527d35089a', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-73fe91ba-06de-4b4d-9785-117540935e06 tempest-AttachVolumeNegativeTest-1281562092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d859c4ac-c588-4b8c-9b29-b9ce1a4e27e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:33:58 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-73fe91ba-06de-4b4d-9785-117540935e06 tempest-AttachVolumeNegativeTest-1281562092 None] Volume volume-1cf4066e-5a5d-4fa4-8e06-c8527d35089a (1cf4066e-5a5d-4fa4-8e06-c8527d35089a): created successfully Nov 02 12:33:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-73fe91ba-06de-4b4d-9785-117540935e06 tempest-AttachVolumeNegativeTest-1281562092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d859c4ac-c588-4b8c-9b29-b9ce1a4e27e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:33:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-73fe91ba-06de-4b4d-9785-117540935e06 tempest-AttachVolumeNegativeTest-1281562092 None] Flow 'volume_create_manager' (afe84ffe-944d-4ccd-a16d-f5489ab55dd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:33:58 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-73fe91ba-06de-4b4d-9785-117540935e06 tempest-AttachVolumeNegativeTest-1281562092 None] Created volume successfully. Nov 02 12:34:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-5dc95641-fd5d-4d6c-94ff-44a6c871f710 req-4be14921-154c-4d39-a196-e8094b410e4b tempest-AttachVolumeNegativeTest-1281562092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:34:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-5dc95641-fd5d-4d6c-94ff-44a6c871f710 req-4be14921-154c-4d39-a196-e8094b410e4b tempest-AttachVolumeNegativeTest-1281562092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:34:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-5dc95641-fd5d-4d6c-94ff-44a6c871f710 req-4be14921-154c-4d39-a196-e8094b410e4b tempest-AttachVolumeNegativeTest-1281562092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:34:00 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-5dc95641-fd5d-4d6c-94ff-44a6c871f710 req-4be14921-154c-4d39-a196-e8094b410e4b tempest-AttachVolumeNegativeTest-1281562092 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae', 'name': 'volume-1cf4066e-5a5d-4fa4-8e06-c8527d35089a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd51a15e6-c634-48d8-b7cb-7eb4c5cb3c7e', 'enforce_multipath': True} {{(pid=86515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:34:00 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-5dc95641-fd5d-4d6c-94ff-44a6c871f710 req-4be14921-154c-4d39-a196-e8094b410e4b tempest-AttachVolumeNegativeTest-1281562092 None] attachment_update completed successfully. Nov 02 12:34:02 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-d0329fd7-2a78-4568-a78b-32a46033d933 req-70fd2494-5603-44e2-8d4f-03722d6c7a5b tempest-AttachVolumeNegativeTest-1281562092 None] Terminate volume connection completed successfully. Nov 02 12:34:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-d0329fd7-2a78-4568-a78b-32a46033d933 req-70fd2494-5603-44e2-8d4f-03722d6c7a5b tempest-AttachVolumeNegativeTest-1281562092 None] Deleting attachment d51a15e6-c634-48d8-b7cb-7eb4c5cb3c7e. {{(pid=86515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:34:12 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:UPDATE=72,cinder:SELECT=69,cinder:DELETE=6,cinder:INSERT=33 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:34:12 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:INSERT=14,cinder:UPDATE=52,cinder:SELECT=61,cinder:DELETE=5 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:34:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-85069297-2537-4e8a-a1a5-1f4a315f2ad6 req-14fcf103-dfa4-445d-9bba-e1befd069c68 tempest-TestInstancesWithCinderVolumes-1242200050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:34:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-85069297-2537-4e8a-a1a5-1f4a315f2ad6 req-14fcf103-dfa4-445d-9bba-e1befd069c68 tempest-TestInstancesWithCinderVolumes-1242200050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:34:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-85069297-2537-4e8a-a1a5-1f4a315f2ad6 req-14fcf103-dfa4-445d-9bba-e1befd069c68 tempest-TestInstancesWithCinderVolumes-1242200050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:34:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-85069297-2537-4e8a-a1a5-1f4a315f2ad6 req-14fcf103-dfa4-445d-9bba-e1befd069c68 tempest-TestInstancesWithCinderVolumes-1242200050 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae', 'name': 'volume-41837457-d319-4564-a546-a0e4b6dc9d8a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7cdb57bf-67a0-4494-b784-cf50df66c6ed', 'enforce_multipath': True} {{(pid=86515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:34:25 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-85069297-2537-4e8a-a1a5-1f4a315f2ad6 req-14fcf103-dfa4-445d-9bba-e1befd069c68 tempest-TestInstancesWithCinderVolumes-1242200050 None] attachment_update completed successfully. Nov 02 12:34:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-d6b40d47-2a72-48be-9b52-19c2a2fb7df2 req-59940597-4fdd-4ae0-93fc-400c2c62e449 tempest-TestInstancesWithCinderVolumes-1242200050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:34:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-d6b40d47-2a72-48be-9b52-19c2a2fb7df2 req-59940597-4fdd-4ae0-93fc-400c2c62e449 tempest-TestInstancesWithCinderVolumes-1242200050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:34:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-d6b40d47-2a72-48be-9b52-19c2a2fb7df2 req-59940597-4fdd-4ae0-93fc-400c2c62e449 tempest-TestInstancesWithCinderVolumes-1242200050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:34:27 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-d6b40d47-2a72-48be-9b52-19c2a2fb7df2 req-59940597-4fdd-4ae0-93fc-400c2c62e449 tempest-TestInstancesWithCinderVolumes-1242200050 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae', 'name': 'volume-9850101b-f5d4-4cf0-b552-4627d5ba609c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '845180d8-5095-4c6a-a7d5-cbadf965dc8b', 'enforce_multipath': True} {{(pid=86515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:34:27 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-d6b40d47-2a72-48be-9b52-19c2a2fb7df2 req-59940597-4fdd-4ae0-93fc-400c2c62e449 tempest-TestInstancesWithCinderVolumes-1242200050 None] attachment_update completed successfully. Nov 02 12:34:32 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-f508171c-e21c-4abf-827d-81b49a68005f req-76fd09a1-23f9-40a0-af99-426fbd175d0d tempest-TestInstancesWithCinderVolumes-1242200050 None] Terminate volume connection completed successfully. Nov 02 12:34:32 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-f508171c-e21c-4abf-827d-81b49a68005f req-76fd09a1-23f9-40a0-af99-426fbd175d0d tempest-TestInstancesWithCinderVolumes-1242200050 None] Deleting attachment 7cdb57bf-67a0-4494-b784-cf50df66c6ed. {{(pid=86515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:34:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ce7b0837-a343-4dab-8a36-ab6453bad511 tempest-TestInstancesWithCinderVolumes-1242200050 None] Acquiring lock "cinder-41837457-d319-4564-a546-a0e4b6dc9d8a-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:34:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ce7b0837-a343-4dab-8a36-ab6453bad511 tempest-TestInstancesWithCinderVolumes-1242200050 None] Lock "cinder-41837457-d319-4564-a546-a0e4b6dc9d8a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:34:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ce7b0837-a343-4dab-8a36-ab6453bad511 tempest-TestInstancesWithCinderVolumes-1242200050 None] Acquiring lock "cinder-quobyte-41837457-d319-4564-a546-a0e4b6dc9d8a" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:34:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ce7b0837-a343-4dab-8a36-ab6453bad511 tempest-TestInstancesWithCinderVolumes-1242200050 None] Lock "cinder-quobyte-41837457-d319-4564-a546-a0e4b6dc9d8a" acquired by "delete_volume" :: waited 0.023s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:34:33 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e79a373-285b-46d1-a8ae-8f0792c5de9f]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:34:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ce7b0837-a343-4dab-8a36-ab6453bad511 tempest-TestInstancesWithCinderVolumes-1242200050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-41837457-d319-4564-a546-a0e4b6dc9d8a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:34:33 devstack sudo[99357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-41837457-d319-4564-a546-a0e4b6dc9d8a Nov 02 12:34:33 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:34:33 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root Nov 02 12:34:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ce7b0837-a343-4dab-8a36-ab6453bad511 tempest-TestInstancesWithCinderVolumes-1242200050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-41837457-d319-4564-a546-a0e4b6dc9d8a" returned: 0 in 0.511s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:34:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ce7b0837-a343-4dab-8a36-ab6453bad511 tempest-TestInstancesWithCinderVolumes-1242200050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-41837457-d319-4564-a546-a0e4b6dc9d8a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:34:33 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-41837457-d319-4564-a546-a0e4b6dc9d8a Nov 02 12:34:33 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:34:33 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Nov 02 12:34:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ce7b0837-a343-4dab-8a36-ab6453bad511 tempest-TestInstancesWithCinderVolumes-1242200050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-41837457-d319-4564-a546-a0e4b6dc9d8a" returned: 0 in 0.288s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:34:33 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-944fbd4f-ada6-4215-8388-162d0951cb74 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:34:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-944fbd4f-ada6-4215-8388-162d0951cb74 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Flow 'volume_create_manager' (f71aba10-3ae6-4974-892a-e91e700b501c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:34:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-944fbd4f-ada6-4215-8388-162d0951cb74 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d3824ca-2890-4dad-a6eb-5f4960066d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:34:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ce7b0837-a343-4dab-8a36-ab6453bad511 tempest-TestInstancesWithCinderVolumes-1242200050 None] Lock "cinder-quobyte-41837457-d319-4564-a546-a0e4b6dc9d8a" released by "delete_volume" :: held 0.891s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-944fbd4f-ada6-4215-8388-162d0951cb74 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d3824ca-2890-4dad-a6eb-5f4960066d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-556723979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7d5c2e0-5332-4983-b507-00e5980ce590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be6753403b4c4245914f3cfa80c1de02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:34:34Z,use_quota=True,user_id='3f6dcfebb08a470da1cd827a383d139b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-944fbd4f-ada6-4215-8388-162d0951cb74 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf0bba1-f3d8-42c3-8924-98f67f4d3a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-944fbd4f-ada6-4215-8388-162d0951cb74 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf0bba1-f3d8-42c3-8924-98f67f4d3a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-944fbd4f-ada6-4215-8388-162d0951cb74 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58c27dc4-45c3-4339-9f84-03c30ff7791f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-944fbd4f-ada6-4215-8388-162d0951cb74 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58c27dc4-45c3-4339-9f84-03c30ff7791f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7d5c2e0-5332-4983-b507-00e5980ce590', 'volume_name': 'volume-f7d5c2e0-5332-4983-b507-00e5980ce590', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-944fbd4f-ada6-4215-8388-162d0951cb74 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d62d424f-d2e4-45fc-a49a-4331613a1108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-944fbd4f-ada6-4215-8388-162d0951cb74 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d62d424f-d2e4-45fc-a49a-4331613a1108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-944fbd4f-ada6-4215-8388-162d0951cb74 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8998a02-3de5-4e22-989e-42bf88812201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:34:34 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-944fbd4f-ada6-4215-8388-162d0951cb74 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Volume f7d5c2e0-5332-4983-b507-00e5980ce590: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7d5c2e0-5332-4983-b507-00e5980ce590', 'volume_size': 1} Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-944fbd4f-ada6-4215-8388-162d0951cb74 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-944fbd4f-ada6-4215-8388-162d0951cb74 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-944fbd4f-ada6-4215-8388-162d0951cb74 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-556723979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7d5c2e0-5332-4983-b507-00e5980ce590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be6753403b4c4245914f3cfa80c1de02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:34:34Z,use_quota=True,user_id='3f6dcfebb08a470da1cd827a383d139b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-944fbd4f-ada6-4215-8388-162d0951cb74 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Creating volume f7d5c2e0-5332-4983-b507-00e5980ce590 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-944fbd4f-ada6-4215-8388-162d0951cb74 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-944fbd4f-ada6-4215-8388-162d0951cb74 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-944fbd4f-ada6-4215-8388-162d0951cb74 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-944fbd4f-ada6-4215-8388-162d0951cb74 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-944fbd4f-ada6-4215-8388-162d0951cb74 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-944fbd4f-ada6-4215-8388-162d0951cb74 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:34:34 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-944fbd4f-ada6-4215-8388-162d0951cb74 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-944fbd4f-ada6-4215-8388-162d0951cb74 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f7d5c2e0-5332-4983-b507-00e5980ce590 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:34:34 devstack sudo[99401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f7d5c2e0-5332-4983-b507-00e5980ce590 1073741824 Nov 02 12:34:34 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:34:34 devstack cinder-volume[86515]: WARNING cinder.quota [None req-ce7b0837-a343-4dab-8a36-ab6453bad511 tempest-TestInstancesWithCinderVolumes-1242200050 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1796769548-1955911821 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1796769548-1955911821, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:34:34 devstack cinder-volume[86515]: WARNING cinder.quota [None req-ce7b0837-a343-4dab-8a36-ab6453bad511 tempest-TestInstancesWithCinderVolumes-1242200050 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1796769548-1955911821 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1796769548-1955911821, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-ce7b0837-a343-4dab-8a36-ab6453bad511 tempest-TestInstancesWithCinderVolumes-1242200050 None] Created reservations ['e7703ca5-b431-4d56-aeda-5503936c3ed2', 'f57b63c1-8f75-4a2b-a636-0d1b24604cd4', '63414587-a817-4e25-9a6e-c054925a8d35', '2a8c292d-6895-4ef2-908a-a28034e32c95'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ce7b0837-a343-4dab-8a36-ab6453bad511 tempest-TestInstancesWithCinderVolumes-1242200050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ce7b0837-a343-4dab-8a36-ab6453bad511 tempest-TestInstancesWithCinderVolumes-1242200050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ce7b0837-a343-4dab-8a36-ab6453bad511 tempest-TestInstancesWithCinderVolumes-1242200050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ce7b0837-a343-4dab-8a36-ab6453bad511 tempest-TestInstancesWithCinderVolumes-1242200050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ce7b0837-a343-4dab-8a36-ab6453bad511 tempest-TestInstancesWithCinderVolumes-1242200050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ce7b0837-a343-4dab-8a36-ab6453bad511 tempest-TestInstancesWithCinderVolumes-1242200050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:34:34 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:34:34 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:34:34 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ce7b0837-a343-4dab-8a36-ab6453bad511 tempest-TestInstancesWithCinderVolumes-1242200050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.260s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-ce7b0837-a343-4dab-8a36-ab6453bad511 tempest-TestInstancesWithCinderVolumes-1242200050 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:34:34 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-ce7b0837-a343-4dab-8a36-ab6453bad511 tempest-TestInstancesWithCinderVolumes-1242200050 None] Deleted volume successfully. Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ce7b0837-a343-4dab-8a36-ab6453bad511 tempest-TestInstancesWithCinderVolumes-1242200050 None] Lock "cinder-41837457-d319-4564-a546-a0e4b6dc9d8a-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:34:34 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-944fbd4f-ada6-4215-8388-162d0951cb74 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f7d5c2e0-5332-4983-b507-00e5980ce590 1073741824" returned: 0 in 0.510s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-944fbd4f-ada6-4215-8388-162d0951cb74 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f7d5c2e0-5332-4983-b507-00e5980ce590 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:34:34 devstack sudo[99410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f7d5c2e0-5332-4983-b507-00e5980ce590 Nov 02 12:34:34 devstack sudo[99410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:34:34 devstack sudo[99410]: pam_unix(sudo:session): session closed for user root Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-944fbd4f-ada6-4215-8388-162d0951cb74 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f7d5c2e0-5332-4983-b507-00e5980ce590" returned: 0 in 0.264s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-944fbd4f-ada6-4215-8388-162d0951cb74 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-944fbd4f-ada6-4215-8388-162d0951cb74 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-944fbd4f-ada6-4215-8388-162d0951cb74 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8998a02-3de5-4e22-989e-42bf88812201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7d5c2e0-5332-4983-b507-00e5980ce590', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-944fbd4f-ada6-4215-8388-162d0951cb74 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d2233a-3070-4be9-8f93-b7f1d5a74ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:34:34 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-944fbd4f-ada6-4215-8388-162d0951cb74 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Volume volume-f7d5c2e0-5332-4983-b507-00e5980ce590 (f7d5c2e0-5332-4983-b507-00e5980ce590): created successfully Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-944fbd4f-ada6-4215-8388-162d0951cb74 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d2233a-3070-4be9-8f93-b7f1d5a74ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:34:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-944fbd4f-ada6-4215-8388-162d0951cb74 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Flow 'volume_create_manager' (f71aba10-3ae6-4974-892a-e91e700b501c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:34:34 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-944fbd4f-ada6-4215-8388-162d0951cb74 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Created volume successfully. Nov 02 12:34:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-e7efcb17-95af-46e6-8d0c-c1be3fa113a9 req-0e7bd2ce-38b2-4dc3-9c04-3e53cd982ed9 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:34:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-e7efcb17-95af-46e6-8d0c-c1be3fa113a9 req-0e7bd2ce-38b2-4dc3-9c04-3e53cd982ed9 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:34:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-e7efcb17-95af-46e6-8d0c-c1be3fa113a9 req-0e7bd2ce-38b2-4dc3-9c04-3e53cd982ed9 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:34:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-e7efcb17-95af-46e6-8d0c-c1be3fa113a9 req-0e7bd2ce-38b2-4dc3-9c04-3e53cd982ed9 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae', 'name': 'volume-f7d5c2e0-5332-4983-b507-00e5980ce590', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '50081409-22ae-4511-9778-377c757c28f1', 'enforce_multipath': True} {{(pid=86515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:34:36 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-e7efcb17-95af-46e6-8d0c-c1be3fa113a9 req-0e7bd2ce-38b2-4dc3-9c04-3e53cd982ed9 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] attachment_update completed successfully. Nov 02 12:34:37 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-eee7bc35-ffe7-42d1-b638-ed8e41659033 req-39d18e10-3faf-416b-8d58-e3df369b97ae tempest-TestInstancesWithCinderVolumes-1242200050 None] Terminate volume connection completed successfully. Nov 02 12:34:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-eee7bc35-ffe7-42d1-b638-ed8e41659033 req-39d18e10-3faf-416b-8d58-e3df369b97ae tempest-TestInstancesWithCinderVolumes-1242200050 None] Deleting attachment 845180d8-5095-4c6a-a7d5-cbadf965dc8b. {{(pid=86515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:34:37 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-09e7d338-78c0-44ba-92c0-b5ec5c5f2448 tempest-TestInstancesWithCinderVolumes-1242200050 None] Acquiring lock "cinder-9850101b-f5d4-4cf0-b552-4627d5ba609c-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:34:37 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-09e7d338-78c0-44ba-92c0-b5ec5c5f2448 tempest-TestInstancesWithCinderVolumes-1242200050 None] Lock "cinder-9850101b-f5d4-4cf0-b552-4627d5ba609c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:34:37 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-09e7d338-78c0-44ba-92c0-b5ec5c5f2448 tempest-TestInstancesWithCinderVolumes-1242200050 None] Acquiring lock "cinder-quobyte-9850101b-f5d4-4cf0-b552-4627d5ba609c" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:34:37 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-09e7d338-78c0-44ba-92c0-b5ec5c5f2448 tempest-TestInstancesWithCinderVolumes-1242200050 None] Lock "cinder-quobyte-9850101b-f5d4-4cf0-b552-4627d5ba609c" acquired by "delete_volume" :: waited 0.017s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:34:37 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[06213fc5-0240-4753-82e3-af86c97d276c]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:34:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-09e7d338-78c0-44ba-92c0-b5ec5c5f2448 tempest-TestInstancesWithCinderVolumes-1242200050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9850101b-f5d4-4cf0-b552-4627d5ba609c {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:34:38 devstack sudo[99449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9850101b-f5d4-4cf0-b552-4627d5ba609c Nov 02 12:34:38 devstack sudo[99449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:34:38 devstack sudo[99449]: pam_unix(sudo:session): session closed for user root Nov 02 12:34:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-09e7d338-78c0-44ba-92c0-b5ec5c5f2448 tempest-TestInstancesWithCinderVolumes-1242200050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9850101b-f5d4-4cf0-b552-4627d5ba609c" returned: 0 in 0.409s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:34:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-09e7d338-78c0-44ba-92c0-b5ec5c5f2448 tempest-TestInstancesWithCinderVolumes-1242200050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9850101b-f5d4-4cf0-b552-4627d5ba609c {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:34:38 devstack sudo[99454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9850101b-f5d4-4cf0-b552-4627d5ba609c Nov 02 12:34:38 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:34:38 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root Nov 02 12:34:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-09e7d338-78c0-44ba-92c0-b5ec5c5f2448 tempest-TestInstancesWithCinderVolumes-1242200050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9850101b-f5d4-4cf0-b552-4627d5ba609c" returned: 0 in 0.282s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:34:38 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-09e7d338-78c0-44ba-92c0-b5ec5c5f2448 tempest-TestInstancesWithCinderVolumes-1242200050 None] Lock "cinder-quobyte-9850101b-f5d4-4cf0-b552-4627d5ba609c" released by "delete_volume" :: held 0.745s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:34:38 devstack cinder-volume[86515]: WARNING cinder.quota [None req-09e7d338-78c0-44ba-92c0-b5ec5c5f2448 tempest-TestInstancesWithCinderVolumes-1242200050 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2067983754-292590649 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2067983754-292590649, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:34:38 devstack cinder-volume[86515]: WARNING cinder.quota [None req-09e7d338-78c0-44ba-92c0-b5ec5c5f2448 tempest-TestInstancesWithCinderVolumes-1242200050 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2067983754-292590649 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2067983754-292590649, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:34:38 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-09e7d338-78c0-44ba-92c0-b5ec5c5f2448 tempest-TestInstancesWithCinderVolumes-1242200050 None] Created reservations ['df73bb8d-ace2-43c2-8bd2-2188619557d3', 'd1f9d4e6-ea63-4b02-8b81-418c7a939a53', 'f1d0af0e-b27e-45a1-97ec-50d2c0f70ca1', '831ba360-1ea2-43de-9ebf-d379dff88c43'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:34:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-09e7d338-78c0-44ba-92c0-b5ec5c5f2448 tempest-TestInstancesWithCinderVolumes-1242200050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:34:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-09e7d338-78c0-44ba-92c0-b5ec5c5f2448 tempest-TestInstancesWithCinderVolumes-1242200050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:34:38 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-09e7d338-78c0-44ba-92c0-b5ec5c5f2448 tempest-TestInstancesWithCinderVolumes-1242200050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:34:38 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-09e7d338-78c0-44ba-92c0-b5ec5c5f2448 tempest-TestInstancesWithCinderVolumes-1242200050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:34:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-09e7d338-78c0-44ba-92c0-b5ec5c5f2448 tempest-TestInstancesWithCinderVolumes-1242200050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:34:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-09e7d338-78c0-44ba-92c0-b5ec5c5f2448 tempest-TestInstancesWithCinderVolumes-1242200050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:34:38 devstack sudo[99457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:34:38 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:34:39 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-e31d8485-8e7d-4da9-a137-72c21bf1c7b4 req-7fc67770-8358-480f-8dd3-76792f53dee1 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Terminate volume connection completed successfully. Nov 02 12:34:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-e31d8485-8e7d-4da9-a137-72c21bf1c7b4 req-7fc67770-8358-480f-8dd3-76792f53dee1 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Deleting attachment 50081409-22ae-4511-9778-377c757c28f1. {{(pid=86515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:34:39 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root Nov 02 12:34:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-09e7d338-78c0-44ba-92c0-b5ec5c5f2448 tempest-TestInstancesWithCinderVolumes-1242200050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.355s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:34:39 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-09e7d338-78c0-44ba-92c0-b5ec5c5f2448 tempest-TestInstancesWithCinderVolumes-1242200050 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:34:39 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-09e7d338-78c0-44ba-92c0-b5ec5c5f2448 tempest-TestInstancesWithCinderVolumes-1242200050 None] Deleted volume successfully. Nov 02 12:34:39 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-09e7d338-78c0-44ba-92c0-b5ec5c5f2448 tempest-TestInstancesWithCinderVolumes-1242200050 None] Lock "cinder-9850101b-f5d4-4cf0-b552-4627d5ba609c-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:34:40 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-30278bc5-fa61-4d06-a1f2-bb4287089306 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Acquiring lock "cinder-f7d5c2e0-5332-4983-b507-00e5980ce590-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:34:40 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-30278bc5-fa61-4d06-a1f2-bb4287089306 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Lock "cinder-f7d5c2e0-5332-4983-b507-00e5980ce590-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:34:40 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-30278bc5-fa61-4d06-a1f2-bb4287089306 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Acquiring lock "cinder-quobyte-f7d5c2e0-5332-4983-b507-00e5980ce590" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:34:40 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-30278bc5-fa61-4d06-a1f2-bb4287089306 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Lock "cinder-quobyte-f7d5c2e0-5332-4983-b507-00e5980ce590" acquired by "delete_volume" :: waited 0.022s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:34:40 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a019dbf-311b-438e-b30d-1d88c3f55ea3]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:34:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-30278bc5-fa61-4d06-a1f2-bb4287089306 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f7d5c2e0-5332-4983-b507-00e5980ce590 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:34:40 devstack sudo[99500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f7d5c2e0-5332-4983-b507-00e5980ce590 Nov 02 12:34:40 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:34:40 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root Nov 02 12:34:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-30278bc5-fa61-4d06-a1f2-bb4287089306 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f7d5c2e0-5332-4983-b507-00e5980ce590" returned: 0 in 0.494s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:34:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-30278bc5-fa61-4d06-a1f2-bb4287089306 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f7d5c2e0-5332-4983-b507-00e5980ce590 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:34:40 devstack sudo[99507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f7d5c2e0-5332-4983-b507-00e5980ce590 Nov 02 12:34:40 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:34:40 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root Nov 02 12:34:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-30278bc5-fa61-4d06-a1f2-bb4287089306 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f7d5c2e0-5332-4983-b507-00e5980ce590" returned: 0 in 0.285s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:34:41 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-30278bc5-fa61-4d06-a1f2-bb4287089306 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Lock "cinder-quobyte-f7d5c2e0-5332-4983-b507-00e5980ce590" released by "delete_volume" :: held 0.857s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:34:41 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-30278bc5-fa61-4d06-a1f2-bb4287089306 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Created reservations ['8951bbe3-fe6f-4f45-b7e8-6ab542f21c8f', '1c102d0b-7a62-49fd-865a-d2696b82510c', '1867b45a-c45c-456f-8f31-4fa3261d423f', '0ff6bd86-5dac-4e55-aaa7-4ddf6e478903'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:34:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-30278bc5-fa61-4d06-a1f2-bb4287089306 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:34:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-30278bc5-fa61-4d06-a1f2-bb4287089306 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:34:41 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-30278bc5-fa61-4d06-a1f2-bb4287089306 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:34:41 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-30278bc5-fa61-4d06-a1f2-bb4287089306 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:34:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-30278bc5-fa61-4d06-a1f2-bb4287089306 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:34:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-30278bc5-fa61-4d06-a1f2-bb4287089306 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:34:41 devstack sudo[99513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:34:41 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:34:41 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root Nov 02 12:34:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-30278bc5-fa61-4d06-a1f2-bb4287089306 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.615s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:34:41 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-30278bc5-fa61-4d06-a1f2-bb4287089306 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:34:41 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-30278bc5-fa61-4d06-a1f2-bb4287089306 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Deleted volume successfully. Nov 02 12:34:41 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-30278bc5-fa61-4d06-a1f2-bb4287089306 tempest-TestServerVolumeAttachScenarioOldVersion-1611039403 None] Lock "cinder-f7d5c2e0-5332-4983-b507-00e5980ce590-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:34:43 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd6fdcf6-cc7e-4432-b184-0636ae820eed tempest-AttachVolumeNegativeTest-1281562092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:34:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-dd6fdcf6-cc7e-4432-b184-0636ae820eed tempest-AttachVolumeNegativeTest-1281562092 None] Flow 'volume_create_manager' (2656c3c7-f029-4dbe-9993-c1ed8fad402c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:34:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-dd6fdcf6-cc7e-4432-b184-0636ae820eed tempest-AttachVolumeNegativeTest-1281562092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f16a0e04-ff2c-48f9-9021-3be73544dc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:34:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-dd6fdcf6-cc7e-4432-b184-0636ae820eed tempest-AttachVolumeNegativeTest-1281562092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f16a0e04-ff2c-48f9-9021-3be73544dc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1831955648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3435c64-af4b-4515-a837-38d88b878d65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9c7d8a596348cdbef96a1243897c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:34:43Z,use_quota=True,user_id='7a7a7fce4a9b4e0fa44b300004914ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:34:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-dd6fdcf6-cc7e-4432-b184-0636ae820eed tempest-AttachVolumeNegativeTest-1281562092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e3bab5-2ad1-4ac4-b343-06c6ca2a1795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:34:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-dd6fdcf6-cc7e-4432-b184-0636ae820eed tempest-AttachVolumeNegativeTest-1281562092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e3bab5-2ad1-4ac4-b343-06c6ca2a1795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:34:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-dd6fdcf6-cc7e-4432-b184-0636ae820eed tempest-AttachVolumeNegativeTest-1281562092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (023c2bc1-00f7-433b-b68b-115fd5de053b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:34:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-dd6fdcf6-cc7e-4432-b184-0636ae820eed tempest-AttachVolumeNegativeTest-1281562092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (023c2bc1-00f7-433b-b68b-115fd5de053b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3435c64-af4b-4515-a837-38d88b878d65', 'volume_name': 'volume-d3435c64-af4b-4515-a837-38d88b878d65', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:34:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-dd6fdcf6-cc7e-4432-b184-0636ae820eed tempest-AttachVolumeNegativeTest-1281562092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e8a6a0-182e-4ccf-aa8c-dd003c2b5dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:34:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-dd6fdcf6-cc7e-4432-b184-0636ae820eed tempest-AttachVolumeNegativeTest-1281562092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e8a6a0-182e-4ccf-aa8c-dd003c2b5dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:34:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-dd6fdcf6-cc7e-4432-b184-0636ae820eed tempest-AttachVolumeNegativeTest-1281562092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d1cd0f8-0c13-4618-8478-67fbd8439855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:34:43 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-dd6fdcf6-cc7e-4432-b184-0636ae820eed tempest-AttachVolumeNegativeTest-1281562092 None] Volume d3435c64-af4b-4515-a837-38d88b878d65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3435c64-af4b-4515-a837-38d88b878d65', 'volume_size': 1} Nov 02 12:34:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-dd6fdcf6-cc7e-4432-b184-0636ae820eed tempest-AttachVolumeNegativeTest-1281562092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:34:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-dd6fdcf6-cc7e-4432-b184-0636ae820eed tempest-AttachVolumeNegativeTest-1281562092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:34:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-dd6fdcf6-cc7e-4432-b184-0636ae820eed tempest-AttachVolumeNegativeTest-1281562092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1831955648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3435c64-af4b-4515-a837-38d88b878d65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9c7d8a596348cdbef96a1243897c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:34:43Z,use_quota=True,user_id='7a7a7fce4a9b4e0fa44b300004914ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:34:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-dd6fdcf6-cc7e-4432-b184-0636ae820eed tempest-AttachVolumeNegativeTest-1281562092 None] Creating volume d3435c64-af4b-4515-a837-38d88b878d65 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:34:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-dd6fdcf6-cc7e-4432-b184-0636ae820eed tempest-AttachVolumeNegativeTest-1281562092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:34:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-dd6fdcf6-cc7e-4432-b184-0636ae820eed tempest-AttachVolumeNegativeTest-1281562092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:34:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-dd6fdcf6-cc7e-4432-b184-0636ae820eed tempest-AttachVolumeNegativeTest-1281562092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:34:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-dd6fdcf6-cc7e-4432-b184-0636ae820eed tempest-AttachVolumeNegativeTest-1281562092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:34:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-dd6fdcf6-cc7e-4432-b184-0636ae820eed tempest-AttachVolumeNegativeTest-1281562092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:34:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-dd6fdcf6-cc7e-4432-b184-0636ae820eed tempest-AttachVolumeNegativeTest-1281562092 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:34:43 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-dd6fdcf6-cc7e-4432-b184-0636ae820eed tempest-AttachVolumeNegativeTest-1281562092 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:34:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-dd6fdcf6-cc7e-4432-b184-0636ae820eed tempest-AttachVolumeNegativeTest-1281562092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d3435c64-af4b-4515-a837-38d88b878d65 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:34:43 devstack sudo[99556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d3435c64-af4b-4515-a837-38d88b878d65 1073741824 Nov 02 12:34:43 devstack sudo[99556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:34:43 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-96f1d36c-8de1-4b6d-8bb1-55cda006c0ec req-384a8884-9e31-433a-bafc-3f8a9ce399df tempest-TestInstancesWithCinderVolumes-1242200050 None] Terminate volume connection completed successfully. Nov 02 12:34:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-96f1d36c-8de1-4b6d-8bb1-55cda006c0ec req-384a8884-9e31-433a-bafc-3f8a9ce399df tempest-TestInstancesWithCinderVolumes-1242200050 None] Deleting attachment bd2a5a3e-6ac2-4341-a5fc-92aca3934d05. {{(pid=86515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:34:43 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:34:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:34:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:34:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:34:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:34:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:34:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:34:43 devstack sudo[99556]: pam_unix(sudo:session): session closed for user root Nov 02 12:34:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-dd6fdcf6-cc7e-4432-b184-0636ae820eed tempest-AttachVolumeNegativeTest-1281562092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d3435c64-af4b-4515-a837-38d88b878d65 1073741824" returned: 0 in 0.766s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:34:43 devstack sudo[99565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:34:43 devstack sudo[99565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:34:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-dd6fdcf6-cc7e-4432-b184-0636ae820eed tempest-AttachVolumeNegativeTest-1281562092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d3435c64-af4b-4515-a837-38d88b878d65 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:34:44 devstack sudo[99567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d3435c64-af4b-4515-a837-38d88b878d65 Nov 02 12:34:44 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:34:44 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root Nov 02 12:34:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-dd6fdcf6-cc7e-4432-b184-0636ae820eed tempest-AttachVolumeNegativeTest-1281562092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d3435c64-af4b-4515-a837-38d88b878d65" returned: 0 in 0.434s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:34:44 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-dd6fdcf6-cc7e-4432-b184-0636ae820eed tempest-AttachVolumeNegativeTest-1281562092 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:34:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-dd6fdcf6-cc7e-4432-b184-0636ae820eed tempest-AttachVolumeNegativeTest-1281562092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:34:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-dd6fdcf6-cc7e-4432-b184-0636ae820eed tempest-AttachVolumeNegativeTest-1281562092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d1cd0f8-0c13-4618-8478-67fbd8439855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3435c64-af4b-4515-a837-38d88b878d65', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:34:44 devstack sudo[99565]: pam_unix(sudo:session): session closed for user root Nov 02 12:34:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-dd6fdcf6-cc7e-4432-b184-0636ae820eed tempest-AttachVolumeNegativeTest-1281562092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277d2c85-b99d-4ac1-a52b-f90d188bb077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:34:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.543s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:34:44 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:34:44 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager._thread_info {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:34:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread count: 28 {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:34:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread info: [<_MainThread(MainThread, started 129944084402304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:34:44 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-dd6fdcf6-cc7e-4432-b184-0636ae820eed tempest-AttachVolumeNegativeTest-1281562092 None] Volume volume-d3435c64-af4b-4515-a837-38d88b878d65 (d3435c64-af4b-4515-a837-38d88b878d65): created successfully Nov 02 12:34:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-dd6fdcf6-cc7e-4432-b184-0636ae820eed tempest-AttachVolumeNegativeTest-1281562092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277d2c85-b99d-4ac1-a52b-f90d188bb077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:34:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-dd6fdcf6-cc7e-4432-b184-0636ae820eed tempest-AttachVolumeNegativeTest-1281562092 None] Flow 'volume_create_manager' (2656c3c7-f029-4dbe-9993-c1ed8fad402c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:34:44 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-dd6fdcf6-cc7e-4432-b184-0636ae820eed tempest-AttachVolumeNegativeTest-1281562092 None] Created volume successfully. Nov 02 12:34:45 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3a0b77e5-945d-409a-8833-58ca840a1023 tempest-TestInstancesWithCinderVolumes-1242200050 None] Acquiring lock "cinder-483fab07-3d93-4561-9322-c1d2327b1d56-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:34:45 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3a0b77e5-945d-409a-8833-58ca840a1023 tempest-TestInstancesWithCinderVolumes-1242200050 None] Lock "cinder-483fab07-3d93-4561-9322-c1d2327b1d56-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:34:45 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3a0b77e5-945d-409a-8833-58ca840a1023 tempest-TestInstancesWithCinderVolumes-1242200050 None] Acquiring lock "cinder-quobyte-483fab07-3d93-4561-9322-c1d2327b1d56" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:34:45 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3a0b77e5-945d-409a-8833-58ca840a1023 tempest-TestInstancesWithCinderVolumes-1242200050 None] Lock "cinder-quobyte-483fab07-3d93-4561-9322-c1d2327b1d56" acquired by "delete_volume" :: waited 0.015s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:34:45 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a2634a-9e8d-4e71-aa36-a72abd0e8027]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:34:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3a0b77e5-945d-409a-8833-58ca840a1023 tempest-TestInstancesWithCinderVolumes-1242200050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-483fab07-3d93-4561-9322-c1d2327b1d56 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:34:45 devstack sudo[99576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-483fab07-3d93-4561-9322-c1d2327b1d56 Nov 02 12:34:45 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:34:45 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root Nov 02 12:34:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3a0b77e5-945d-409a-8833-58ca840a1023 tempest-TestInstancesWithCinderVolumes-1242200050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-483fab07-3d93-4561-9322-c1d2327b1d56" returned: 0 in 0.412s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:34:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3a0b77e5-945d-409a-8833-58ca840a1023 tempest-TestInstancesWithCinderVolumes-1242200050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-483fab07-3d93-4561-9322-c1d2327b1d56 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:34:45 devstack sudo[99589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-483fab07-3d93-4561-9322-c1d2327b1d56 Nov 02 12:34:45 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:34:46 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root Nov 02 12:34:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3a0b77e5-945d-409a-8833-58ca840a1023 tempest-TestInstancesWithCinderVolumes-1242200050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-483fab07-3d93-4561-9322-c1d2327b1d56" returned: 0 in 0.312s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:34:46 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3a0b77e5-945d-409a-8833-58ca840a1023 tempest-TestInstancesWithCinderVolumes-1242200050 None] Lock "cinder-quobyte-483fab07-3d93-4561-9322-c1d2327b1d56" released by "delete_volume" :: held 0.774s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:34:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-718f35e0-2499-4693-9751-20f5fe3f02c9 req-c4cc57a0-6ae6-4b7c-af7b-8e22678d8438 tempest-AttachVolumeNegativeTest-1281562092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:34:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-718f35e0-2499-4693-9751-20f5fe3f02c9 req-c4cc57a0-6ae6-4b7c-af7b-8e22678d8438 tempest-AttachVolumeNegativeTest-1281562092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:34:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-718f35e0-2499-4693-9751-20f5fe3f02c9 req-c4cc57a0-6ae6-4b7c-af7b-8e22678d8438 tempest-AttachVolumeNegativeTest-1281562092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:34:46 devstack cinder-volume[86515]: WARNING cinder.quota [None req-3a0b77e5-945d-409a-8833-58ca840a1023 tempest-TestInstancesWithCinderVolumes-1242200050 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-376392842-723143761 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-376392842-723143761, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:34:46 devstack cinder-volume[86515]: WARNING cinder.quota [None req-3a0b77e5-945d-409a-8833-58ca840a1023 tempest-TestInstancesWithCinderVolumes-1242200050 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-376392842-723143761 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-376392842-723143761, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:34:46 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-3a0b77e5-945d-409a-8833-58ca840a1023 tempest-TestInstancesWithCinderVolumes-1242200050 None] Created reservations ['edc6219a-75d7-44b7-bb78-4994cbec6f2a', 'd57c0192-be39-46bc-a397-90255f8b064a', '56663a0e-15ee-433d-9431-c15a2b3e9ae6', '2d87f746-15bd-47c5-ac6d-2140030f3115'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:34:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-718f35e0-2499-4693-9751-20f5fe3f02c9 req-c4cc57a0-6ae6-4b7c-af7b-8e22678d8438 tempest-AttachVolumeNegativeTest-1281562092 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae', 'name': 'volume-d3435c64-af4b-4515-a837-38d88b878d65', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '34552b6e-f8a1-4a62-9df3-20c7af290824', 'enforce_multipath': True} {{(pid=86515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:34:46 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-718f35e0-2499-4693-9751-20f5fe3f02c9 req-c4cc57a0-6ae6-4b7c-af7b-8e22678d8438 tempest-AttachVolumeNegativeTest-1281562092 None] attachment_update completed successfully. Nov 02 12:34:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3a0b77e5-945d-409a-8833-58ca840a1023 tempest-TestInstancesWithCinderVolumes-1242200050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:34:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3a0b77e5-945d-409a-8833-58ca840a1023 tempest-TestInstancesWithCinderVolumes-1242200050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:34:46 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3a0b77e5-945d-409a-8833-58ca840a1023 tempest-TestInstancesWithCinderVolumes-1242200050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:34:46 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3a0b77e5-945d-409a-8833-58ca840a1023 tempest-TestInstancesWithCinderVolumes-1242200050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:34:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3a0b77e5-945d-409a-8833-58ca840a1023 tempest-TestInstancesWithCinderVolumes-1242200050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:34:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3a0b77e5-945d-409a-8833-58ca840a1023 tempest-TestInstancesWithCinderVolumes-1242200050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:34:46 devstack sudo[99603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:34:46 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:34:46 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root Nov 02 12:34:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3a0b77e5-945d-409a-8833-58ca840a1023 tempest-TestInstancesWithCinderVolumes-1242200050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.364s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:34:46 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-3a0b77e5-945d-409a-8833-58ca840a1023 tempest-TestInstancesWithCinderVolumes-1242200050 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:34:46 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-3a0b77e5-945d-409a-8833-58ca840a1023 tempest-TestInstancesWithCinderVolumes-1242200050 None] Deleted volume successfully. Nov 02 12:34:46 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3a0b77e5-945d-409a-8833-58ca840a1023 tempest-TestInstancesWithCinderVolumes-1242200050 None] Lock "cinder-483fab07-3d93-4561-9322-c1d2327b1d56-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:34:49 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-5ab03bea-ce3a-4f7e-a6d0-d7c2f890d3cf req-9a837e49-cfaf-4194-80da-d45771c855c0 tempest-AttachVolumeNegativeTest-1281562092 None] Terminate volume connection completed successfully. Nov 02 12:34:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-5ab03bea-ce3a-4f7e-a6d0-d7c2f890d3cf req-9a837e49-cfaf-4194-80da-d45771c855c0 tempest-AttachVolumeNegativeTest-1281562092 None] Deleting attachment 34552b6e-f8a1-4a62-9df3-20c7af290824. {{(pid=86515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:34:56 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=62,cinder:UPDATE=37,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:34:57 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3e621627-7264-4fbf-aca5-fb8b8b5afba3 tempest-AttachVolumeNegativeTest-1281562092 None] Acquiring lock "cinder-d3435c64-af4b-4515-a837-38d88b878d65-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:34:57 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3e621627-7264-4fbf-aca5-fb8b8b5afba3 tempest-AttachVolumeNegativeTest-1281562092 None] Lock "cinder-d3435c64-af4b-4515-a837-38d88b878d65-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:34:57 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3e621627-7264-4fbf-aca5-fb8b8b5afba3 tempest-AttachVolumeNegativeTest-1281562092 None] Acquiring lock "cinder-quobyte-d3435c64-af4b-4515-a837-38d88b878d65" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:34:57 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3e621627-7264-4fbf-aca5-fb8b8b5afba3 tempest-AttachVolumeNegativeTest-1281562092 None] Lock "cinder-quobyte-d3435c64-af4b-4515-a837-38d88b878d65" acquired by "delete_volume" :: waited 0.018s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:34:57 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d98906-96f7-420a-b574-e0360b956c02]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:34:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3e621627-7264-4fbf-aca5-fb8b8b5afba3 tempest-AttachVolumeNegativeTest-1281562092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d3435c64-af4b-4515-a837-38d88b878d65 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:34:58 devstack sudo[100080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d3435c64-af4b-4515-a837-38d88b878d65 Nov 02 12:34:58 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:34:58 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root Nov 02 12:34:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3e621627-7264-4fbf-aca5-fb8b8b5afba3 tempest-AttachVolumeNegativeTest-1281562092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d3435c64-af4b-4515-a837-38d88b878d65" returned: 0 in 0.421s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:34:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3e621627-7264-4fbf-aca5-fb8b8b5afba3 tempest-AttachVolumeNegativeTest-1281562092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d3435c64-af4b-4515-a837-38d88b878d65 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:34:58 devstack sudo[100086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d3435c64-af4b-4515-a837-38d88b878d65 Nov 02 12:34:58 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:34:58 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root Nov 02 12:34:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3e621627-7264-4fbf-aca5-fb8b8b5afba3 tempest-AttachVolumeNegativeTest-1281562092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d3435c64-af4b-4515-a837-38d88b878d65" returned: 0 in 0.301s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:34:58 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3e621627-7264-4fbf-aca5-fb8b8b5afba3 tempest-AttachVolumeNegativeTest-1281562092 None] Lock "cinder-quobyte-d3435c64-af4b-4515-a837-38d88b878d65" released by "delete_volume" :: held 0.793s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:34:58 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-3e621627-7264-4fbf-aca5-fb8b8b5afba3 tempest-AttachVolumeNegativeTest-1281562092 None] Created reservations ['bee44e26-4204-4df4-812a-be19b97a9485', '5fd3dffb-96f3-4d64-a89a-778b41aac4dd', '4a5b1874-4106-468a-a587-7c4a0eea6532', '4c4622da-1cbe-4080-ab3e-dc11e27bbe2a'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:34:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3e621627-7264-4fbf-aca5-fb8b8b5afba3 tempest-AttachVolumeNegativeTest-1281562092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:34:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3e621627-7264-4fbf-aca5-fb8b8b5afba3 tempest-AttachVolumeNegativeTest-1281562092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:34:58 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3e621627-7264-4fbf-aca5-fb8b8b5afba3 tempest-AttachVolumeNegativeTest-1281562092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:34:58 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3e621627-7264-4fbf-aca5-fb8b8b5afba3 tempest-AttachVolumeNegativeTest-1281562092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:34:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3e621627-7264-4fbf-aca5-fb8b8b5afba3 tempest-AttachVolumeNegativeTest-1281562092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:34:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3e621627-7264-4fbf-aca5-fb8b8b5afba3 tempest-AttachVolumeNegativeTest-1281562092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:34:58 devstack sudo[100090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:34:58 devstack sudo[100090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:34:59 devstack sudo[100090]: pam_unix(sudo:session): session closed for user root Nov 02 12:34:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3e621627-7264-4fbf-aca5-fb8b8b5afba3 tempest-AttachVolumeNegativeTest-1281562092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.318s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:34:59 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-3e621627-7264-4fbf-aca5-fb8b8b5afba3 tempest-AttachVolumeNegativeTest-1281562092 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:34:59 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-3e621627-7264-4fbf-aca5-fb8b8b5afba3 tempest-AttachVolumeNegativeTest-1281562092 None] Deleted volume successfully. Nov 02 12:34:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3e621627-7264-4fbf-aca5-fb8b8b5afba3 tempest-AttachVolumeNegativeTest-1281562092 None] Lock "cinder-d3435c64-af4b-4515-a837-38d88b878d65-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:34:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4f3c0dd7-f3f3-480f-b640-d0363a59caac tempest-AttachVolumeNegativeTest-1281562092 None] Acquiring lock "cinder-1cf4066e-5a5d-4fa4-8e06-c8527d35089a-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:34:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4f3c0dd7-f3f3-480f-b640-d0363a59caac tempest-AttachVolumeNegativeTest-1281562092 None] Lock "cinder-1cf4066e-5a5d-4fa4-8e06-c8527d35089a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:34:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4f3c0dd7-f3f3-480f-b640-d0363a59caac tempest-AttachVolumeNegativeTest-1281562092 None] Acquiring lock "cinder-quobyte-1cf4066e-5a5d-4fa4-8e06-c8527d35089a" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:34:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4f3c0dd7-f3f3-480f-b640-d0363a59caac tempest-AttachVolumeNegativeTest-1281562092 None] Lock "cinder-quobyte-1cf4066e-5a5d-4fa4-8e06-c8527d35089a" acquired by "delete_volume" :: waited 0.020s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:34:59 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c190e1f-d754-44b7-b5e0-3a28e7be1d70]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:34:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4f3c0dd7-f3f3-480f-b640-d0363a59caac tempest-AttachVolumeNegativeTest-1281562092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1cf4066e-5a5d-4fa4-8e06-c8527d35089a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:34:59 devstack sudo[100093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1cf4066e-5a5d-4fa4-8e06-c8527d35089a Nov 02 12:34:59 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:34:59 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root Nov 02 12:34:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4f3c0dd7-f3f3-480f-b640-d0363a59caac tempest-AttachVolumeNegativeTest-1281562092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1cf4066e-5a5d-4fa4-8e06-c8527d35089a" returned: 0 in 0.399s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:34:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4f3c0dd7-f3f3-480f-b640-d0363a59caac tempest-AttachVolumeNegativeTest-1281562092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1cf4066e-5a5d-4fa4-8e06-c8527d35089a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:34:59 devstack sudo[100098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1cf4066e-5a5d-4fa4-8e06-c8527d35089a Nov 02 12:34:59 devstack sudo[100098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:00 devstack sudo[100098]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4f3c0dd7-f3f3-480f-b640-d0363a59caac tempest-AttachVolumeNegativeTest-1281562092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1cf4066e-5a5d-4fa4-8e06-c8527d35089a" returned: 0 in 0.310s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:00 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4f3c0dd7-f3f3-480f-b640-d0363a59caac tempest-AttachVolumeNegativeTest-1281562092 None] Lock "cinder-quobyte-1cf4066e-5a5d-4fa4-8e06-c8527d35089a" released by "delete_volume" :: held 0.769s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:35:00 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-4f3c0dd7-f3f3-480f-b640-d0363a59caac tempest-AttachVolumeNegativeTest-1281562092 None] Created reservations ['b559c1e3-8b4d-4489-baa7-bffaa5e698c7', 'f6152c29-0472-4974-9231-68eb6172ed29', '07784b89-f3e2-4242-b8d3-04d062381012', '53ebbde7-8e0b-4d88-9054-a678bff777b8'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:35:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4f3c0dd7-f3f3-480f-b640-d0363a59caac tempest-AttachVolumeNegativeTest-1281562092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:35:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4f3c0dd7-f3f3-480f-b640-d0363a59caac tempest-AttachVolumeNegativeTest-1281562092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:35:00 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-4f3c0dd7-f3f3-480f-b640-d0363a59caac tempest-AttachVolumeNegativeTest-1281562092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:35:00 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-4f3c0dd7-f3f3-480f-b640-d0363a59caac tempest-AttachVolumeNegativeTest-1281562092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:35:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4f3c0dd7-f3f3-480f-b640-d0363a59caac tempest-AttachVolumeNegativeTest-1281562092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:35:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4f3c0dd7-f3f3-480f-b640-d0363a59caac tempest-AttachVolumeNegativeTest-1281562092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:00 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:35:00 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:00 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4f3c0dd7-f3f3-480f-b640-d0363a59caac tempest-AttachVolumeNegativeTest-1281562092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.286s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:00 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-4f3c0dd7-f3f3-480f-b640-d0363a59caac tempest-AttachVolumeNegativeTest-1281562092 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:35:00 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-4f3c0dd7-f3f3-480f-b640-d0363a59caac tempest-AttachVolumeNegativeTest-1281562092 None] Deleted volume successfully. Nov 02 12:35:00 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4f3c0dd7-f3f3-480f-b640-d0363a59caac tempest-AttachVolumeNegativeTest-1281562092 None] Lock "cinder-1cf4066e-5a5d-4fa4-8e06-c8527d35089a-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:35:00 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-53b4f31f-e72c-4466-ac67-b1a7d76b5304 tempest-AttachVolumeNegativeTest-1281562092 None] Acquiring lock "cinder-3765bb31-74da-4040-9e38-790e569bf7a9-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:35:00 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-53b4f31f-e72c-4466-ac67-b1a7d76b5304 tempest-AttachVolumeNegativeTest-1281562092 None] Lock "cinder-3765bb31-74da-4040-9e38-790e569bf7a9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:35:00 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-53b4f31f-e72c-4466-ac67-b1a7d76b5304 tempest-AttachVolumeNegativeTest-1281562092 None] Acquiring lock "cinder-quobyte-3765bb31-74da-4040-9e38-790e569bf7a9" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:35:00 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-53b4f31f-e72c-4466-ac67-b1a7d76b5304 tempest-AttachVolumeNegativeTest-1281562092 None] Lock "cinder-quobyte-3765bb31-74da-4040-9e38-790e569bf7a9" acquired by "delete_volume" :: waited 0.026s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:35:00 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ebd579-5aef-4781-857a-0ea08baaa8c9]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:35:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-53b4f31f-e72c-4466-ac67-b1a7d76b5304 tempest-AttachVolumeNegativeTest-1281562092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3765bb31-74da-4040-9e38-790e569bf7a9 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:01 devstack sudo[100104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3765bb31-74da-4040-9e38-790e569bf7a9 Nov 02 12:35:01 devstack sudo[100104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:01 devstack sudo[100104]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-53b4f31f-e72c-4466-ac67-b1a7d76b5304 tempest-AttachVolumeNegativeTest-1281562092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3765bb31-74da-4040-9e38-790e569bf7a9" returned: 0 in 0.469s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-53b4f31f-e72c-4466-ac67-b1a7d76b5304 tempest-AttachVolumeNegativeTest-1281562092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3765bb31-74da-4040-9e38-790e569bf7a9 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:01 devstack sudo[100110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3765bb31-74da-4040-9e38-790e569bf7a9 Nov 02 12:35:01 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:01 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-53b4f31f-e72c-4466-ac67-b1a7d76b5304 tempest-AttachVolumeNegativeTest-1281562092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3765bb31-74da-4040-9e38-790e569bf7a9" returned: 0 in 0.289s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-53b4f31f-e72c-4466-ac67-b1a7d76b5304 tempest-AttachVolumeNegativeTest-1281562092 None] Lock "cinder-quobyte-3765bb31-74da-4040-9e38-790e569bf7a9" released by "delete_volume" :: held 0.825s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:35:01 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-53b4f31f-e72c-4466-ac67-b1a7d76b5304 tempest-AttachVolumeNegativeTest-1281562092 None] Created reservations ['6e3e5656-a9be-4ef7-a001-b5520fa45514', 'cc9cf59c-ae0e-4e03-962c-cf17f2a55c29', 'ae29ddb1-7f0b-461f-844d-d50540266f72', '33ca0edf-c922-4344-b57e-5bb86501cd34'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:35:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-53b4f31f-e72c-4466-ac67-b1a7d76b5304 tempest-AttachVolumeNegativeTest-1281562092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:35:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-53b4f31f-e72c-4466-ac67-b1a7d76b5304 tempest-AttachVolumeNegativeTest-1281562092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:35:01 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-53b4f31f-e72c-4466-ac67-b1a7d76b5304 tempest-AttachVolumeNegativeTest-1281562092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:35:01 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-53b4f31f-e72c-4466-ac67-b1a7d76b5304 tempest-AttachVolumeNegativeTest-1281562092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:35:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-53b4f31f-e72c-4466-ac67-b1a7d76b5304 tempest-AttachVolumeNegativeTest-1281562092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:35:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-53b4f31f-e72c-4466-ac67-b1a7d76b5304 tempest-AttachVolumeNegativeTest-1281562092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:01 devstack sudo[100113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:35:01 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:02 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-53b4f31f-e72c-4466-ac67-b1a7d76b5304 tempest-AttachVolumeNegativeTest-1281562092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.300s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:02 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-53b4f31f-e72c-4466-ac67-b1a7d76b5304 tempest-AttachVolumeNegativeTest-1281562092 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:35:02 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-53b4f31f-e72c-4466-ac67-b1a7d76b5304 tempest-AttachVolumeNegativeTest-1281562092 None] Deleted volume successfully. Nov 02 12:35:02 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-53b4f31f-e72c-4466-ac67-b1a7d76b5304 tempest-AttachVolumeNegativeTest-1281562092 None] Lock "cinder-3765bb31-74da-4040-9e38-790e569bf7a9-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:35:11 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=66,cinder:UPDATE=77,cinder:INSERT=15,cinder:DELETE=5 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:35:12 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=13,cinder:INSERT=7,cinder:UPDATE=23,cinder:DELETE=2 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:35:19 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [req-dbc7fb79-384c-4c72-86b2-80f2f706b27c req-81b10782-af93-413b-b624-f29a7433b3f6 tempest-VolumesSnapshotsTestJSON-858802013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:35:19 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-dbc7fb79-384c-4c72-86b2-80f2f706b27c req-81b10782-af93-413b-b624-f29a7433b3f6 tempest-VolumesSnapshotsTestJSON-858802013 None] Flow 'volume_create_manager' (e2c52142-f9fa-4ac1-9ba1-15a697db451c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:35:19 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-dbc7fb79-384c-4c72-86b2-80f2f706b27c req-81b10782-af93-413b-b624-f29a7433b3f6 tempest-VolumesSnapshotsTestJSON-858802013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17caccc9-ee85-4e9a-8c90-849f9b89849b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:35:19 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-dbc7fb79-384c-4c72-86b2-80f2f706b27c req-81b10782-af93-413b-b624-f29a7433b3f6 tempest-VolumesSnapshotsTestJSON-858802013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17caccc9-ee85-4e9a-8c90-849f9b89849b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:35:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-477984935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f79a9a5-9fbd-45a1-85ec-9b7084fe3320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4507a652225a40188f24c151c79a1915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:35:20Z,use_quota=True,user_id='9667e349491d40a39849f1247404c65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:35:19 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-dbc7fb79-384c-4c72-86b2-80f2f706b27c req-81b10782-af93-413b-b624-f29a7433b3f6 tempest-VolumesSnapshotsTestJSON-858802013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de5bf12-45cb-40e9-bd2e-e412ee66dbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:35:19 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-dbc7fb79-384c-4c72-86b2-80f2f706b27c req-81b10782-af93-413b-b624-f29a7433b3f6 tempest-VolumesSnapshotsTestJSON-858802013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de5bf12-45cb-40e9-bd2e-e412ee66dbf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:35:19 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-dbc7fb79-384c-4c72-86b2-80f2f706b27c req-81b10782-af93-413b-b624-f29a7433b3f6 tempest-VolumesSnapshotsTestJSON-858802013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2461328-38e7-49b9-8365-b53767e05f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:35:19 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-dbc7fb79-384c-4c72-86b2-80f2f706b27c req-81b10782-af93-413b-b624-f29a7433b3f6 tempest-VolumesSnapshotsTestJSON-858802013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2461328-38e7-49b9-8365-b53767e05f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f79a9a5-9fbd-45a1-85ec-9b7084fe3320', 'volume_name': 'volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:35:19 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-dbc7fb79-384c-4c72-86b2-80f2f706b27c req-81b10782-af93-413b-b624-f29a7433b3f6 tempest-VolumesSnapshotsTestJSON-858802013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8932eccc-67e8-4daa-894c-757de94c9886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:35:19 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-dbc7fb79-384c-4c72-86b2-80f2f706b27c req-81b10782-af93-413b-b624-f29a7433b3f6 tempest-VolumesSnapshotsTestJSON-858802013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8932eccc-67e8-4daa-894c-757de94c9886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:35:19 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-dbc7fb79-384c-4c72-86b2-80f2f706b27c req-81b10782-af93-413b-b624-f29a7433b3f6 tempest-VolumesSnapshotsTestJSON-858802013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f203e6b8-2ad3-46cc-9538-d7578782e0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:35:19 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [req-dbc7fb79-384c-4c72-86b2-80f2f706b27c req-81b10782-af93-413b-b624-f29a7433b3f6 tempest-VolumesSnapshotsTestJSON-858802013 None] Volume 7f79a9a5-9fbd-45a1-85ec-9b7084fe3320: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320', 'volume_size': 1} Nov 02 12:35:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-dbc7fb79-384c-4c72-86b2-80f2f706b27c req-81b10782-af93-413b-b624-f29a7433b3f6 tempest-VolumesSnapshotsTestJSON-858802013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:35:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-dbc7fb79-384c-4c72-86b2-80f2f706b27c req-81b10782-af93-413b-b624-f29a7433b3f6 tempest-VolumesSnapshotsTestJSON-858802013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:35:19 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [req-dbc7fb79-384c-4c72-86b2-80f2f706b27c req-81b10782-af93-413b-b624-f29a7433b3f6 tempest-VolumesSnapshotsTestJSON-858802013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:35:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-477984935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f79a9a5-9fbd-45a1-85ec-9b7084fe3320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4507a652225a40188f24c151c79a1915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:35:20Z,use_quota=True,user_id='9667e349491d40a39849f1247404c65f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:35:19 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [req-dbc7fb79-384c-4c72-86b2-80f2f706b27c req-81b10782-af93-413b-b624-f29a7433b3f6 tempest-VolumesSnapshotsTestJSON-858802013 None] Creating volume 7f79a9a5-9fbd-45a1-85ec-9b7084fe3320 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:35:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-dbc7fb79-384c-4c72-86b2-80f2f706b27c req-81b10782-af93-413b-b624-f29a7433b3f6 tempest-VolumesSnapshotsTestJSON-858802013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:35:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-dbc7fb79-384c-4c72-86b2-80f2f706b27c req-81b10782-af93-413b-b624-f29a7433b3f6 tempest-VolumesSnapshotsTestJSON-858802013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:35:19 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [req-dbc7fb79-384c-4c72-86b2-80f2f706b27c req-81b10782-af93-413b-b624-f29a7433b3f6 tempest-VolumesSnapshotsTestJSON-858802013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:35:19 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [req-dbc7fb79-384c-4c72-86b2-80f2f706b27c req-81b10782-af93-413b-b624-f29a7433b3f6 tempest-VolumesSnapshotsTestJSON-858802013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:35:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-dbc7fb79-384c-4c72-86b2-80f2f706b27c req-81b10782-af93-413b-b624-f29a7433b3f6 tempest-VolumesSnapshotsTestJSON-858802013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:35:19 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [req-dbc7fb79-384c-4c72-86b2-80f2f706b27c req-81b10782-af93-413b-b624-f29a7433b3f6 tempest-VolumesSnapshotsTestJSON-858802013 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:35:19 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [req-dbc7fb79-384c-4c72-86b2-80f2f706b27c req-81b10782-af93-413b-b624-f29a7433b3f6 tempest-VolumesSnapshotsTestJSON-858802013 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:35:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-dbc7fb79-384c-4c72-86b2-80f2f706b27c req-81b10782-af93-413b-b624-f29a7433b3f6 tempest-VolumesSnapshotsTestJSON-858802013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:19 devstack sudo[100122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320 1073741824 Nov 02 12:35:19 devstack sudo[100122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:20 devstack sudo[100122]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-dbc7fb79-384c-4c72-86b2-80f2f706b27c req-81b10782-af93-413b-b624-f29a7433b3f6 tempest-VolumesSnapshotsTestJSON-858802013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320 1073741824" returned: 0 in 0.610s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-dbc7fb79-384c-4c72-86b2-80f2f706b27c req-81b10782-af93-413b-b624-f29a7433b3f6 tempest-VolumesSnapshotsTestJSON-858802013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:20 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320 Nov 02 12:35:20 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:20 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-dbc7fb79-384c-4c72-86b2-80f2f706b27c req-81b10782-af93-413b-b624-f29a7433b3f6 tempest-VolumesSnapshotsTestJSON-858802013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320" returned: 0 in 0.303s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [req-dbc7fb79-384c-4c72-86b2-80f2f706b27c req-81b10782-af93-413b-b624-f29a7433b3f6 tempest-VolumesSnapshotsTestJSON-858802013 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:35:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-dbc7fb79-384c-4c72-86b2-80f2f706b27c req-81b10782-af93-413b-b624-f29a7433b3f6 tempest-VolumesSnapshotsTestJSON-858802013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:35:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-dbc7fb79-384c-4c72-86b2-80f2f706b27c req-81b10782-af93-413b-b624-f29a7433b3f6 tempest-VolumesSnapshotsTestJSON-858802013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f203e6b8-2ad3-46cc-9538-d7578782e0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:35:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-dbc7fb79-384c-4c72-86b2-80f2f706b27c req-81b10782-af93-413b-b624-f29a7433b3f6 tempest-VolumesSnapshotsTestJSON-858802013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b9332b1-a82d-4225-899a-c41361558267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:35:20 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [req-dbc7fb79-384c-4c72-86b2-80f2f706b27c req-81b10782-af93-413b-b624-f29a7433b3f6 tempest-VolumesSnapshotsTestJSON-858802013 None] Volume volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320 (7f79a9a5-9fbd-45a1-85ec-9b7084fe3320): created successfully Nov 02 12:35:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-dbc7fb79-384c-4c72-86b2-80f2f706b27c req-81b10782-af93-413b-b624-f29a7433b3f6 tempest-VolumesSnapshotsTestJSON-858802013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b9332b1-a82d-4225-899a-c41361558267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:35:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-dbc7fb79-384c-4c72-86b2-80f2f706b27c req-81b10782-af93-413b-b624-f29a7433b3f6 tempest-VolumesSnapshotsTestJSON-858802013 None] Flow 'volume_create_manager' (e2c52142-f9fa-4ac1-9ba1-15a697db451c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:35:20 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-dbc7fb79-384c-4c72-86b2-80f2f706b27c req-81b10782-af93-413b-b624-f29a7433b3f6 tempest-VolumesSnapshotsTestJSON-858802013 None] Created volume successfully. Nov 02 12:35:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-f38632e3-00d5-40cb-8e4f-e50e6acfe5f2 req-32431040-13e7-40b1-88b2-88be0b1a9564 tempest-VolumesSnapshotsTestJSON-858802013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:35:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-f38632e3-00d5-40cb-8e4f-e50e6acfe5f2 req-32431040-13e7-40b1-88b2-88be0b1a9564 tempest-VolumesSnapshotsTestJSON-858802013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:35:22 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [req-f38632e3-00d5-40cb-8e4f-e50e6acfe5f2 req-32431040-13e7-40b1-88b2-88be0b1a9564 tempest-VolumesSnapshotsTestJSON-858802013 None] Creating offline snapshot 98fbab20-c1bf-4a60-a5a4-5359775c8e2b of volume 7f79a9a5-9fbd-45a1-85ec-9b7084fe3320 {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:35:22 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fd3f96-68f7-4184-8544-9ee71f469071]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:35:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-f38632e3-00d5-40cb-8e4f-e50e6acfe5f2 req-32431040-13e7-40b1-88b2-88be0b1a9564 tempest-VolumesSnapshotsTestJSON-858802013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:22 devstack sudo[100132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320 Nov 02 12:35:22 devstack sudo[100132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:22 devstack sudo[100132]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-f38632e3-00d5-40cb-8e4f-e50e6acfe5f2 req-32431040-13e7-40b1-88b2-88be0b1a9564 tempest-VolumesSnapshotsTestJSON-858802013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320" returned: 0 in 0.435s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-f38632e3-00d5-40cb-8e4f-e50e6acfe5f2 req-32431040-13e7-40b1-88b2-88be0b1a9564 tempest-VolumesSnapshotsTestJSON-858802013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320.98fbab20-c1bf-4a60-a5a4-5359775c8e2b 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:22 devstack sudo[100137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320.98fbab20-c1bf-4a60-a5a4-5359775c8e2b 1G Nov 02 12:35:22 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:23 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-f38632e3-00d5-40cb-8e4f-e50e6acfe5f2 req-32431040-13e7-40b1-88b2-88be0b1a9564 tempest-VolumesSnapshotsTestJSON-858802013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320.98fbab20-c1bf-4a60-a5a4-5359775c8e2b 1G" returned: 0 in 0.565s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-f38632e3-00d5-40cb-8e4f-e50e6acfe5f2 req-32431040-13e7-40b1-88b2-88be0b1a9564 tempest-VolumesSnapshotsTestJSON-858802013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320.98fbab20-c1bf-4a60-a5a4-5359775c8e2b {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:23 devstack sudo[100145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320.98fbab20-c1bf-4a60-a5a4-5359775c8e2b Nov 02 12:35:23 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:23 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-f38632e3-00d5-40cb-8e4f-e50e6acfe5f2 req-32431040-13e7-40b1-88b2-88be0b1a9564 tempest-VolumesSnapshotsTestJSON-858802013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320.98fbab20-c1bf-4a60-a5a4-5359775c8e2b" returned: 0 in 0.339s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:23 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [req-f38632e3-00d5-40cb-8e4f-e50e6acfe5f2 req-32431040-13e7-40b1-88b2-88be0b1a9564 tempest-VolumesSnapshotsTestJSON-858802013 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320.98fbab20-c1bf-4a60-a5a4-5359775c8e2b is being set with open permissions: ugo+rw Nov 02 12:35:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-f38632e3-00d5-40cb-8e4f-e50e6acfe5f2 req-32431040-13e7-40b1-88b2-88be0b1a9564 tempest-VolumesSnapshotsTestJSON-858802013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320.98fbab20-c1bf-4a60-a5a4-5359775c8e2b {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:23 devstack sudo[100150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320.98fbab20-c1bf-4a60-a5a4-5359775c8e2b Nov 02 12:35:23 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:24 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-f38632e3-00d5-40cb-8e4f-e50e6acfe5f2 req-32431040-13e7-40b1-88b2-88be0b1a9564 tempest-VolumesSnapshotsTestJSON-858802013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320.98fbab20-c1bf-4a60-a5a4-5359775c8e2b" returned: 0 in 0.360s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-f38632e3-00d5-40cb-8e4f-e50e6acfe5f2 req-32431040-13e7-40b1-88b2-88be0b1a9564 tempest-VolumesSnapshotsTestJSON-858802013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:24 devstack sudo[100153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320.info Nov 02 12:35:24 devstack sudo[100153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:24 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0e80226-e699-4b62-9242-29982a84f55e tempest-TestImageHashVerification-1730796337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:35:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e0e80226-e699-4b62-9242-29982a84f55e tempest-TestImageHashVerification-1730796337 None] Flow 'volume_create_manager' (f07d5c88-1de1-4aff-95c7-3c97a075db5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:35:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e0e80226-e699-4b62-9242-29982a84f55e tempest-TestImageHashVerification-1730796337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (352fe777-8b86-4e17-80f8-8bc67de35943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:35:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e0e80226-e699-4b62-9242-29982a84f55e tempest-TestImageHashVerification-1730796337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (352fe777-8b86-4e17-80f8-8bc67de35943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1054682923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d72f0c5b-0119-4b55-9a4f-90c4c076ed91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80aabb732170466796cf6ff6989ba0be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:35:24Z,use_quota=True,user_id='ba63d714e1bc4780b12ac40753525f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:35:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e0e80226-e699-4b62-9242-29982a84f55e tempest-TestImageHashVerification-1730796337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a19b17eb-a04b-4755-b929-4e47b1b18921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:35:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e0e80226-e699-4b62-9242-29982a84f55e tempest-TestImageHashVerification-1730796337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a19b17eb-a04b-4755-b929-4e47b1b18921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:35:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e0e80226-e699-4b62-9242-29982a84f55e tempest-TestImageHashVerification-1730796337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (732bc6a2-0a35-4b01-a34f-046db0f99ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:35:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e0e80226-e699-4b62-9242-29982a84f55e tempest-TestImageHashVerification-1730796337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (732bc6a2-0a35-4b01-a34f-046db0f99ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd72f0c5b-0119-4b55-9a4f-90c4c076ed91', 'volume_name': 'volume-d72f0c5b-0119-4b55-9a4f-90c4c076ed91', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:35:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e0e80226-e699-4b62-9242-29982a84f55e tempest-TestImageHashVerification-1730796337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b9a67ca-2c78-4000-9328-13377a10edfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:35:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e0e80226-e699-4b62-9242-29982a84f55e tempest-TestImageHashVerification-1730796337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b9a67ca-2c78-4000-9328-13377a10edfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:35:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e0e80226-e699-4b62-9242-29982a84f55e tempest-TestImageHashVerification-1730796337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a98d30f-f84f-4fc0-8c9d-30319966b1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:35:24 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-e0e80226-e699-4b62-9242-29982a84f55e tempest-TestImageHashVerification-1730796337 None] Volume d72f0c5b-0119-4b55-9a4f-90c4c076ed91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d72f0c5b-0119-4b55-9a4f-90c4c076ed91', 'volume_size': 1} Nov 02 12:35:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e0e80226-e699-4b62-9242-29982a84f55e tempest-TestImageHashVerification-1730796337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:35:24 devstack sudo[100153]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-f38632e3-00d5-40cb-8e4f-e50e6acfe5f2 req-32431040-13e7-40b1-88b2-88be0b1a9564 tempest-VolumesSnapshotsTestJSON-858802013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320.info" returned: 0 in 0.307s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:24 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [req-f38632e3-00d5-40cb-8e4f-e50e6acfe5f2 req-32431040-13e7-40b1-88b2-88be0b1a9564 tempest-VolumesSnapshotsTestJSON-858802013 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320.info is being set with open permissions: ugo+rw Nov 02 12:35:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-f38632e3-00d5-40cb-8e4f-e50e6acfe5f2 req-32431040-13e7-40b1-88b2-88be0b1a9564 tempest-VolumesSnapshotsTestJSON-858802013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:24 devstack sudo[100156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320.info Nov 02 12:35:24 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:24 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-f38632e3-00d5-40cb-8e4f-e50e6acfe5f2 req-32431040-13e7-40b1-88b2-88be0b1a9564 tempest-VolumesSnapshotsTestJSON-858802013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320.info" returned: 0 in 0.269s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-f38632e3-00d5-40cb-8e4f-e50e6acfe5f2 req-32431040-13e7-40b1-88b2-88be0b1a9564 tempest-VolumesSnapshotsTestJSON-858802013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.437s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:35:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e0e80226-e699-4b62-9242-29982a84f55e tempest-TestImageHashVerification-1730796337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.326s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:35:24 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e0e80226-e699-4b62-9242-29982a84f55e tempest-TestImageHashVerification-1730796337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1054682923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d72f0c5b-0119-4b55-9a4f-90c4c076ed91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80aabb732170466796cf6ff6989ba0be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:35:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:35:24Z,use_quota=True,user_id='ba63d714e1bc4780b12ac40753525f7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:35:24 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-e0e80226-e699-4b62-9242-29982a84f55e tempest-TestImageHashVerification-1730796337 None] Creating volume d72f0c5b-0119-4b55-9a4f-90c4c076ed91 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:35:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e0e80226-e699-4b62-9242-29982a84f55e tempest-TestImageHashVerification-1730796337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:35:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e0e80226-e699-4b62-9242-29982a84f55e tempest-TestImageHashVerification-1730796337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:35:24 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e0e80226-e699-4b62-9242-29982a84f55e tempest-TestImageHashVerification-1730796337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:35:24 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e0e80226-e699-4b62-9242-29982a84f55e tempest-TestImageHashVerification-1730796337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:35:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e0e80226-e699-4b62-9242-29982a84f55e tempest-TestImageHashVerification-1730796337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:35:24 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e0e80226-e699-4b62-9242-29982a84f55e tempest-TestImageHashVerification-1730796337 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:35:24 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-e0e80226-e699-4b62-9242-29982a84f55e tempest-TestImageHashVerification-1730796337 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:35:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e0e80226-e699-4b62-9242-29982a84f55e tempest-TestImageHashVerification-1730796337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d72f0c5b-0119-4b55-9a4f-90c4c076ed91 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:24 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d72f0c5b-0119-4b55-9a4f-90c4c076ed91 1073741824 Nov 02 12:35:24 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:24 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-f38632e3-00d5-40cb-8e4f-e50e6acfe5f2 req-32431040-13e7-40b1-88b2-88be0b1a9564 tempest-VolumesSnapshotsTestJSON-858802013 None] Create snapshot completed successfully Nov 02 12:35:25 devstack cinder-volume[86515]: DEBUG cinder.coordination [req-f5700a6c-69c6-4732-a1ac-568db376a7db req-bf71435b-8202-4366-9a86-bf3b8cda3925 tempest-VolumesSnapshotsTestJSON-858802013 None] Acquiring lock "cinder-98fbab20-c1bf-4a60-a5a4-5359775c8e2b-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:35:25 devstack cinder-volume[86515]: DEBUG cinder.coordination [req-f5700a6c-69c6-4732-a1ac-568db376a7db req-bf71435b-8202-4366-9a86-bf3b8cda3925 tempest-VolumesSnapshotsTestJSON-858802013 None] Lock "cinder-98fbab20-c1bf-4a60-a5a4-5359775c8e2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:35:25 devstack cinder-volume[86515]: DEBUG cinder.coordination [req-f5700a6c-69c6-4732-a1ac-568db376a7db req-bf71435b-8202-4366-9a86-bf3b8cda3925 tempest-VolumesSnapshotsTestJSON-858802013 None] Acquiring lock "cinder-quobyte-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:35:25 devstack cinder-volume[86515]: DEBUG cinder.coordination [req-f5700a6c-69c6-4732-a1ac-568db376a7db req-bf71435b-8202-4366-9a86-bf3b8cda3925 tempest-VolumesSnapshotsTestJSON-858802013 None] Lock "cinder-quobyte-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:35:25 devstack cinder-volume[86515]: DEBUG cinder.coordination [req-f5700a6c-69c6-4732-a1ac-568db376a7db req-bf71435b-8202-4366-9a86-bf3b8cda3925 tempest-VolumesSnapshotsTestJSON-858802013 None] Acquiring lock "cinder-quobyte-98fbab20-c1bf-4a60-a5a4-5359775c8e2b" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:35:25 devstack cinder-volume[86515]: DEBUG cinder.coordination [req-f5700a6c-69c6-4732-a1ac-568db376a7db req-bf71435b-8202-4366-9a86-bf3b8cda3925 tempest-VolumesSnapshotsTestJSON-858802013 None] Lock "cinder-quobyte-98fbab20-c1bf-4a60-a5a4-5359775c8e2b" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:35:25 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [req-f5700a6c-69c6-4732-a1ac-568db376a7db req-bf71435b-8202-4366-9a86-bf3b8cda3925 tempest-VolumesSnapshotsTestJSON-858802013 None] Deleting offline snapshot 98fbab20-c1bf-4a60-a5a4-5359775c8e2b of volume 7f79a9a5-9fbd-45a1-85ec-9b7084fe3320 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:35:25 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [req-f5700a6c-69c6-4732-a1ac-568db376a7db req-bf71435b-8202-4366-9a86-bf3b8cda3925 tempest-VolumesSnapshotsTestJSON-858802013 None] snapshot_file for this snap is: volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320.98fbab20-c1bf-4a60-a5a4-5359775c8e2b {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:35:25 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac05458-94df-47a8-9e89-c5253dd69da4]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:35:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-f5700a6c-69c6-4732-a1ac-568db376a7db req-bf71435b-8202-4366-9a86-bf3b8cda3925 tempest-VolumesSnapshotsTestJSON-858802013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320.98fbab20-c1bf-4a60-a5a4-5359775c8e2b {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:25 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e0e80226-e699-4b62-9242-29982a84f55e tempest-TestImageHashVerification-1730796337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d72f0c5b-0119-4b55-9a4f-90c4c076ed91 1073741824" returned: 0 in 0.640s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:25 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320.98fbab20-c1bf-4a60-a5a4-5359775c8e2b Nov 02 12:35:25 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e0e80226-e699-4b62-9242-29982a84f55e tempest-TestImageHashVerification-1730796337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d72f0c5b-0119-4b55-9a4f-90c4c076ed91 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:25 devstack sudo[100168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d72f0c5b-0119-4b55-9a4f-90c4c076ed91 Nov 02 12:35:25 devstack sudo[100168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:25 devstack sudo[100168]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e0e80226-e699-4b62-9242-29982a84f55e tempest-TestImageHashVerification-1730796337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d72f0c5b-0119-4b55-9a4f-90c4c076ed91" returned: 0 in 0.270s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:25 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e0e80226-e699-4b62-9242-29982a84f55e tempest-TestImageHashVerification-1730796337 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:35:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e0e80226-e699-4b62-9242-29982a84f55e tempest-TestImageHashVerification-1730796337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:35:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e0e80226-e699-4b62-9242-29982a84f55e tempest-TestImageHashVerification-1730796337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a98d30f-f84f-4fc0-8c9d-30319966b1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d72f0c5b-0119-4b55-9a4f-90c4c076ed91', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:35:25 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e0e80226-e699-4b62-9242-29982a84f55e tempest-TestImageHashVerification-1730796337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99495423-2c47-4704-9625-ec88402ff26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:35:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-f5700a6c-69c6-4732-a1ac-568db376a7db req-bf71435b-8202-4366-9a86-bf3b8cda3925 tempest-VolumesSnapshotsTestJSON-858802013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320.98fbab20-c1bf-4a60-a5a4-5359775c8e2b" returned: 0 in 0.459s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:25 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [req-f5700a6c-69c6-4732-a1ac-568db376a7db req-bf71435b-8202-4366-9a86-bf3b8cda3925 tempest-VolumesSnapshotsTestJSON-858802013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:35:25 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-e0e80226-e699-4b62-9242-29982a84f55e tempest-TestImageHashVerification-1730796337 None] Volume volume-d72f0c5b-0119-4b55-9a4f-90c4c076ed91 (d72f0c5b-0119-4b55-9a4f-90c4c076ed91): created successfully Nov 02 12:35:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e0e80226-e699-4b62-9242-29982a84f55e tempest-TestImageHashVerification-1730796337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99495423-2c47-4704-9625-ec88402ff26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:35:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e0e80226-e699-4b62-9242-29982a84f55e tempest-TestImageHashVerification-1730796337 None] Flow 'volume_create_manager' (f07d5c88-1de1-4aff-95c7-3c97a075db5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:35:25 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5531d1-289f-4f56-9a81-7ad8effde544]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:35:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-f5700a6c-69c6-4732-a1ac-568db376a7db req-bf71435b-8202-4366-9a86-bf3b8cda3925 tempest-VolumesSnapshotsTestJSON-858802013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:25 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-e0e80226-e699-4b62-9242-29982a84f55e tempest-TestImageHashVerification-1730796337 None] Created volume successfully. Nov 02 12:35:25 devstack sudo[100175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320 Nov 02 12:35:25 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:26 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-f5700a6c-69c6-4732-a1ac-568db376a7db req-bf71435b-8202-4366-9a86-bf3b8cda3925 tempest-VolumesSnapshotsTestJSON-858802013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320" returned: 0 in 0.412s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-f5700a6c-69c6-4732-a1ac-568db376a7db req-bf71435b-8202-4366-9a86-bf3b8cda3925 tempest-VolumesSnapshotsTestJSON-858802013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320.98fbab20-c1bf-4a60-a5a4-5359775c8e2b {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:26 devstack sudo[100180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320.98fbab20-c1bf-4a60-a5a4-5359775c8e2b Nov 02 12:35:26 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:26 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-f5700a6c-69c6-4732-a1ac-568db376a7db req-bf71435b-8202-4366-9a86-bf3b8cda3925 tempest-VolumesSnapshotsTestJSON-858802013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320.98fbab20-c1bf-4a60-a5a4-5359775c8e2b" returned: 0 in 0.467s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-f5700a6c-69c6-4732-a1ac-568db376a7db req-bf71435b-8202-4366-9a86-bf3b8cda3925 tempest-VolumesSnapshotsTestJSON-858802013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320.98fbab20-c1bf-4a60-a5a4-5359775c8e2b {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:26 devstack sudo[100185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320.98fbab20-c1bf-4a60-a5a4-5359775c8e2b Nov 02 12:35:26 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:26 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-f5700a6c-69c6-4732-a1ac-568db376a7db req-bf71435b-8202-4366-9a86-bf3b8cda3925 tempest-VolumesSnapshotsTestJSON-858802013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320.98fbab20-c1bf-4a60-a5a4-5359775c8e2b" returned: 0 in 0.284s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:27 devstack cinder-volume[86515]: DEBUG cinder.coordination [req-f5700a6c-69c6-4732-a1ac-568db376a7db req-bf71435b-8202-4366-9a86-bf3b8cda3925 tempest-VolumesSnapshotsTestJSON-858802013 None] Lock "cinder-quobyte-98fbab20-c1bf-4a60-a5a4-5359775c8e2b" released by "_delete_snapshot" :: held 1.770s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:35:27 devstack cinder-volume[86515]: DEBUG cinder.coordination [req-f5700a6c-69c6-4732-a1ac-568db376a7db req-bf71435b-8202-4366-9a86-bf3b8cda3925 tempest-VolumesSnapshotsTestJSON-858802013 None] Lock "cinder-quobyte-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320" released by "delete_snapshot" :: held 1.812s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:35:27 devstack cinder-volume[86515]: DEBUG cinder.quota [req-f5700a6c-69c6-4732-a1ac-568db376a7db req-bf71435b-8202-4366-9a86-bf3b8cda3925 tempest-VolumesSnapshotsTestJSON-858802013 None] Created reservations ['bee81602-08c9-45c9-b476-f27000889a04', '72316b20-ddd0-43e9-bc86-4924b3da95f6', '9dc994a8-21a4-40dd-a696-9aeb4a815326', '28b19adc-37a5-4a6b-a45d-e5d551b3a76e'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:35:27 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-f5700a6c-69c6-4732-a1ac-568db376a7db req-bf71435b-8202-4366-9a86-bf3b8cda3925 tempest-VolumesSnapshotsTestJSON-858802013 None] Delete snapshot completed successfully. Nov 02 12:35:27 devstack cinder-volume[86515]: DEBUG cinder.coordination [req-f5700a6c-69c6-4732-a1ac-568db376a7db req-bf71435b-8202-4366-9a86-bf3b8cda3925 tempest-VolumesSnapshotsTestJSON-858802013 None] Lock "cinder-98fbab20-c1bf-4a60-a5a4-5359775c8e2b-delete_snapshot" released by "delete_snapshot" :: held 2.029s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:35:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-69ee7e60-c12a-4920-9821-db71f1ec774d tempest-TestImageHashVerification-1730796337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:35:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-69ee7e60-c12a-4920-9821-db71f1ec774d tempest-TestImageHashVerification-1730796337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:35:27 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c95c7e-08af-4076-8ed1-61196af9f884]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:35:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-69ee7e60-c12a-4920-9821-db71f1ec774d tempest-TestImageHashVerification-1730796337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d72f0c5b-0119-4b55-9a4f-90c4c076ed91 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:27 devstack cinder-volume[86515]: DEBUG cinder.coordination [req-d7e484d2-75f8-42a4-9eae-66369555f39f req-e82028ba-221d-4355-891e-77f5ce7642f8 tempest-VolumesSnapshotsTestJSON-858802013 None] Acquiring lock "cinder-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:35:27 devstack cinder-volume[86515]: DEBUG cinder.coordination [req-d7e484d2-75f8-42a4-9eae-66369555f39f req-e82028ba-221d-4355-891e-77f5ce7642f8 tempest-VolumesSnapshotsTestJSON-858802013 None] Lock "cinder-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:35:27 devstack sudo[100188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d72f0c5b-0119-4b55-9a4f-90c4c076ed91 Nov 02 12:35:27 devstack sudo[100188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:27 devstack cinder-volume[86515]: DEBUG cinder.coordination [req-d7e484d2-75f8-42a4-9eae-66369555f39f req-e82028ba-221d-4355-891e-77f5ce7642f8 tempest-VolumesSnapshotsTestJSON-858802013 None] Acquiring lock "cinder-quobyte-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:35:27 devstack cinder-volume[86515]: DEBUG cinder.coordination [req-d7e484d2-75f8-42a4-9eae-66369555f39f req-e82028ba-221d-4355-891e-77f5ce7642f8 tempest-VolumesSnapshotsTestJSON-858802013 None] Lock "cinder-quobyte-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320" acquired by "delete_volume" :: waited 0.020s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:35:27 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[479179da-bff0-4ab7-a1f9-fddccbe5143f]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:35:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-d7e484d2-75f8-42a4-9eae-66369555f39f req-e82028ba-221d-4355-891e-77f5ce7642f8 tempest-VolumesSnapshotsTestJSON-858802013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:27 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320 Nov 02 12:35:27 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:27 devstack sudo[100188]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-69ee7e60-c12a-4920-9821-db71f1ec774d tempest-TestImageHashVerification-1730796337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d72f0c5b-0119-4b55-9a4f-90c4c076ed91" returned: 0 in 0.469s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:27 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de69e10-00d8-4a6e-a52e-5e39080fddec]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:35:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-69ee7e60-c12a-4920-9821-db71f1ec774d tempest-TestImageHashVerification-1730796337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d72f0c5b-0119-4b55-9a4f-90c4c076ed91 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:28 devstack sudo[100196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d72f0c5b-0119-4b55-9a4f-90c4c076ed91 Nov 02 12:35:28 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:28 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-d7e484d2-75f8-42a4-9eae-66369555f39f req-e82028ba-221d-4355-891e-77f5ce7642f8 tempest-VolumesSnapshotsTestJSON-858802013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320" returned: 0 in 0.421s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-d7e484d2-75f8-42a4-9eae-66369555f39f req-e82028ba-221d-4355-891e-77f5ce7642f8 tempest-VolumesSnapshotsTestJSON-858802013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:28 devstack sudo[100201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320 Nov 02 12:35:28 devstack sudo[100201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:28 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-69ee7e60-c12a-4920-9821-db71f1ec774d tempest-TestImageHashVerification-1730796337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d72f0c5b-0119-4b55-9a4f-90c4c076ed91" returned: 0 in 0.418s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-69ee7e60-c12a-4920-9821-db71f1ec774d tempest-TestImageHashVerification-1730796337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d72f0c5b-0119-4b55-9a4f-90c4c076ed91 /opt/stack/data/cinder/conversion/d72f0c5b-0119-4b55-9a4f-90c4c076ed91.temp_image.76e55506-fb1d-4cd9-9837-8e7306159b60vd715p41.img {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:28 devstack sudo[100206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d72f0c5b-0119-4b55-9a4f-90c4c076ed91 /opt/stack/data/cinder/conversion/d72f0c5b-0119-4b55-9a4f-90c4c076ed91.temp_image.76e55506-fb1d-4cd9-9837-8e7306159b60vd715p41.img Nov 02 12:35:28 devstack sudo[100206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:28 devstack sudo[100201]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-d7e484d2-75f8-42a4-9eae-66369555f39f req-e82028ba-221d-4355-891e-77f5ce7642f8 tempest-VolumesSnapshotsTestJSON-858802013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320" returned: 0 in 0.287s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [req-d7e484d2-75f8-42a4-9eae-66369555f39f req-e82028ba-221d-4355-891e-77f5ce7642f8 tempest-VolumesSnapshotsTestJSON-858802013 None] Lock "cinder-quobyte-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320" released by "delete_volume" :: held 0.813s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:35:28 devstack cinder-volume[86515]: DEBUG cinder.quota [req-d7e484d2-75f8-42a4-9eae-66369555f39f req-e82028ba-221d-4355-891e-77f5ce7642f8 tempest-VolumesSnapshotsTestJSON-858802013 None] Created reservations ['316ddd67-a482-4f15-b96b-47db49f86d81', 'd5f17615-17bf-4564-845d-9e54698eea89', '0e069605-10b6-41d4-a2a1-9180aa26620d', '35613a5f-e36c-4e0b-9777-8c1b191eab16'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:35:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-d7e484d2-75f8-42a4-9eae-66369555f39f req-e82028ba-221d-4355-891e-77f5ce7642f8 tempest-VolumesSnapshotsTestJSON-858802013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:35:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-d7e484d2-75f8-42a4-9eae-66369555f39f req-e82028ba-221d-4355-891e-77f5ce7642f8 tempest-VolumesSnapshotsTestJSON-858802013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:35:28 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [req-d7e484d2-75f8-42a4-9eae-66369555f39f req-e82028ba-221d-4355-891e-77f5ce7642f8 tempest-VolumesSnapshotsTestJSON-858802013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:35:28 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [req-d7e484d2-75f8-42a4-9eae-66369555f39f req-e82028ba-221d-4355-891e-77f5ce7642f8 tempest-VolumesSnapshotsTestJSON-858802013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:35:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-d7e484d2-75f8-42a4-9eae-66369555f39f req-e82028ba-221d-4355-891e-77f5ce7642f8 tempest-VolumesSnapshotsTestJSON-858802013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:35:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-d7e484d2-75f8-42a4-9eae-66369555f39f req-e82028ba-221d-4355-891e-77f5ce7642f8 tempest-VolumesSnapshotsTestJSON-858802013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:28 devstack sudo[100209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:35:28 devstack sudo[100209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:28 devstack sudo[100209]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-d7e484d2-75f8-42a4-9eae-66369555f39f req-e82028ba-221d-4355-891e-77f5ce7642f8 tempest-VolumesSnapshotsTestJSON-858802013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.301s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:28 devstack cinder-volume[86515]: DEBUG cinder.manager [req-d7e484d2-75f8-42a4-9eae-66369555f39f req-e82028ba-221d-4355-891e-77f5ce7642f8 tempest-VolumesSnapshotsTestJSON-858802013 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:35:28 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-d7e484d2-75f8-42a4-9eae-66369555f39f req-e82028ba-221d-4355-891e-77f5ce7642f8 tempest-VolumesSnapshotsTestJSON-858802013 None] Deleted volume successfully. Nov 02 12:35:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [req-d7e484d2-75f8-42a4-9eae-66369555f39f req-e82028ba-221d-4355-891e-77f5ce7642f8 tempest-VolumesSnapshotsTestJSON-858802013 None] Lock "cinder-7f79a9a5-9fbd-45a1-85ec-9b7084fe3320-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:35:37 devstack sudo[100206]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-69ee7e60-c12a-4920-9821-db71f1ec774d tempest-TestImageHashVerification-1730796337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d72f0c5b-0119-4b55-9a4f-90c4c076ed91 /opt/stack/data/cinder/conversion/d72f0c5b-0119-4b55-9a4f-90c4c076ed91.temp_image.76e55506-fb1d-4cd9-9837-8e7306159b60vd715p41.img" returned: 0 in 8.667s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:37 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6a7aa9-c13f-4305-a6eb-a37e34a0b838]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:35:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-69ee7e60-c12a-4920-9821-db71f1ec774d tempest-TestImageHashVerification-1730796337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d72f0c5b-0119-4b55-9a4f-90c4c076ed91 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:37 devstack sudo[100224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d72f0c5b-0119-4b55-9a4f-90c4c076ed91 Nov 02 12:35:37 devstack sudo[100224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:37 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [req-29905c68-106f-4f56-ab8b-a09b61732149 req-7bb6671c-de21-4f86-8eeb-c00c17845311 tempest-VolumesGetTestJSON-1147689214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:35:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-29905c68-106f-4f56-ab8b-a09b61732149 req-7bb6671c-de21-4f86-8eeb-c00c17845311 tempest-VolumesGetTestJSON-1147689214 None] Flow 'volume_create_manager' (3c320bfd-7e1f-450d-a9d6-24c76771c727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:35:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-29905c68-106f-4f56-ab8b-a09b61732149 req-7bb6671c-de21-4f86-8eeb-c00c17845311 tempest-VolumesGetTestJSON-1147689214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d868571-556d-4059-8bd6-3f21f212c973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:35:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-29905c68-106f-4f56-ab8b-a09b61732149 req-7bb6671c-de21-4f86-8eeb-c00c17845311 tempest-VolumesGetTestJSON-1147689214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d868571-556d-4059-8bd6-3f21f212c973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1368924969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8effd541-985d-4f95-a787-8ae038f0f5b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f08cb2952c84687b7e5fc46d44e6d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:35:37Z,use_quota=True,user_id='32e1683ed8524a20978c162fdef8558d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:35:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-29905c68-106f-4f56-ab8b-a09b61732149 req-7bb6671c-de21-4f86-8eeb-c00c17845311 tempest-VolumesGetTestJSON-1147689214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91b52b3d-bc8e-494b-8075-1199e0b20bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:35:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-29905c68-106f-4f56-ab8b-a09b61732149 req-7bb6671c-de21-4f86-8eeb-c00c17845311 tempest-VolumesGetTestJSON-1147689214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91b52b3d-bc8e-494b-8075-1199e0b20bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:35:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-29905c68-106f-4f56-ab8b-a09b61732149 req-7bb6671c-de21-4f86-8eeb-c00c17845311 tempest-VolumesGetTestJSON-1147689214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e181f80-3ec6-485c-b00d-8698f31d7e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:35:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-29905c68-106f-4f56-ab8b-a09b61732149 req-7bb6671c-de21-4f86-8eeb-c00c17845311 tempest-VolumesGetTestJSON-1147689214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e181f80-3ec6-485c-b00d-8698f31d7e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8effd541-985d-4f95-a787-8ae038f0f5b2', 'volume_name': 'volume-8effd541-985d-4f95-a787-8ae038f0f5b2', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:35:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-29905c68-106f-4f56-ab8b-a09b61732149 req-7bb6671c-de21-4f86-8eeb-c00c17845311 tempest-VolumesGetTestJSON-1147689214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7545da96-5038-40b9-b320-481aa1c81861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:35:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-29905c68-106f-4f56-ab8b-a09b61732149 req-7bb6671c-de21-4f86-8eeb-c00c17845311 tempest-VolumesGetTestJSON-1147689214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7545da96-5038-40b9-b320-481aa1c81861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:35:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-29905c68-106f-4f56-ab8b-a09b61732149 req-7bb6671c-de21-4f86-8eeb-c00c17845311 tempest-VolumesGetTestJSON-1147689214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1601829c-d9e5-4d03-b79a-0803662575b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:35:37 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [req-29905c68-106f-4f56-ab8b-a09b61732149 req-7bb6671c-de21-4f86-8eeb-c00c17845311 tempest-VolumesGetTestJSON-1147689214 None] Volume 8effd541-985d-4f95-a787-8ae038f0f5b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8effd541-985d-4f95-a787-8ae038f0f5b2', 'volume_size': 1} Nov 02 12:35:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-29905c68-106f-4f56-ab8b-a09b61732149 req-7bb6671c-de21-4f86-8eeb-c00c17845311 tempest-VolumesGetTestJSON-1147689214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:35:37 devstack sudo[100224]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-69ee7e60-c12a-4920-9821-db71f1ec774d tempest-TestImageHashVerification-1730796337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d72f0c5b-0119-4b55-9a4f-90c4c076ed91" returned: 0 in 0.694s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:37 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-69ee7e60-c12a-4920-9821-db71f1ec774d tempest-TestImageHashVerification-1730796337 None] Image conversion details: src /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d72f0c5b-0119-4b55-9a4f-90c4c076ed91, size 1024.00 MB, duration 8.67 sec, destination /opt/stack/data/cinder/conversion/d72f0c5b-0119-4b55-9a4f-90c4c076ed91.temp_image.76e55506-fb1d-4cd9-9837-8e7306159b60vd715p41.img {{(pid=86515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 12:35:37 devstack cinder-volume[86515]: INFO cinder.image.image_utils [None req-69ee7e60-c12a-4920-9821-db71f1ec774d tempest-TestImageHashVerification-1730796337 None] Converted 1024.00 MB image at 118.13 MB/s Nov 02 12:35:37 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-69ee7e60-c12a-4920-9821-db71f1ec774d tempest-TestImageHashVerification-1730796337 None] 76e55506-fb1d-4cd9-9837-8e7306159b60 was raw, no need to convert to raw {{(pid=86515) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 02 12:35:43 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:35:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:35:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:35:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:35:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:35:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:35:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:35:43 devstack sudo[100270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:35:43 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:35:44 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root Nov 02 12:35:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.432s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:35:44 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:35:44 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager._thread_info {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:35:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread count: 28 {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:35:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread info: [<_MainThread(MainThread, started 129944084402304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:35:47 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:UPDATE=22,cinder:SELECT=22,cinder:DELETE=3,cinder:INSERT=3 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:35:47 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=19,cinder:UPDATE=21,cinder:INSERT=8,cinder:DELETE=1 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:35:51 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-868f4bfa-8211-4f29-a942-cb3cd1866248 tempest-TestMinimumBasicScenario-762180589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:35:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-868f4bfa-8211-4f29-a942-cb3cd1866248 tempest-TestMinimumBasicScenario-762180589 None] Flow 'volume_create_manager' (a1a5eb2c-acf2-460e-b10a-790b34895ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:35:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-868f4bfa-8211-4f29-a942-cb3cd1866248 tempest-TestMinimumBasicScenario-762180589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce78f7f9-499e-4c1c-b421-9daf2c919d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:35:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-868f4bfa-8211-4f29-a942-cb3cd1866248 tempest-TestMinimumBasicScenario-762180589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce78f7f9-499e-4c1c-b421-9daf2c919d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1962215453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=793c1376-2743-4997-9149-d86dfac8c2ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be975fe1bd8649a8b7901cca4997ac9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:35:51Z,use_quota=True,user_id='d26fe5af2202410fb78ed905219f896e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:35:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-868f4bfa-8211-4f29-a942-cb3cd1866248 tempest-TestMinimumBasicScenario-762180589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf4c4b7-08f5-477b-8afb-cb799467ef90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:35:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-868f4bfa-8211-4f29-a942-cb3cd1866248 tempest-TestMinimumBasicScenario-762180589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf4c4b7-08f5-477b-8afb-cb799467ef90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:35:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-868f4bfa-8211-4f29-a942-cb3cd1866248 tempest-TestMinimumBasicScenario-762180589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c818f0c-5911-46cf-a6ca-087f520b8cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:35:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-868f4bfa-8211-4f29-a942-cb3cd1866248 tempest-TestMinimumBasicScenario-762180589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c818f0c-5911-46cf-a6ca-087f520b8cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '793c1376-2743-4997-9149-d86dfac8c2ef', 'volume_name': 'volume-793c1376-2743-4997-9149-d86dfac8c2ef', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:35:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-868f4bfa-8211-4f29-a942-cb3cd1866248 tempest-TestMinimumBasicScenario-762180589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be920ec-31d1-4074-9ef8-9768991c8c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:35:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-868f4bfa-8211-4f29-a942-cb3cd1866248 tempest-TestMinimumBasicScenario-762180589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be920ec-31d1-4074-9ef8-9768991c8c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:35:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-868f4bfa-8211-4f29-a942-cb3cd1866248 tempest-TestMinimumBasicScenario-762180589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59788f6b-2230-49f1-a8e8-65712f06b310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:35:51 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-868f4bfa-8211-4f29-a942-cb3cd1866248 tempest-TestMinimumBasicScenario-762180589 None] Volume 793c1376-2743-4997-9149-d86dfac8c2ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-793c1376-2743-4997-9149-d86dfac8c2ef', 'volume_size': 1} Nov 02 12:35:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-868f4bfa-8211-4f29-a942-cb3cd1866248 tempest-TestMinimumBasicScenario-762180589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-69ee7e60-c12a-4920-9821-db71f1ec774d tempest-TestImageHashVerification-1730796337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.173s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:00 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-69ee7e60-c12a-4920-9821-db71f1ec774d tempest-TestImageHashVerification-1730796337 None] Uploaded volume to glance image-id: 76e55506-fb1d-4cd9-9837-8e7306159b60. {{(pid=86515) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 12:36:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-29905c68-106f-4f56-ab8b-a09b61732149 req-7bb6671c-de21-4f86-8eeb-c00c17845311 tempest-VolumesGetTestJSON-1147689214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.091s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:00 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [req-29905c68-106f-4f56-ab8b-a09b61732149 req-7bb6671c-de21-4f86-8eeb-c00c17845311 tempest-VolumesGetTestJSON-1147689214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1368924969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8effd541-985d-4f95-a787-8ae038f0f5b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f08cb2952c84687b7e5fc46d44e6d2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:35:37Z,use_quota=True,user_id='32e1683ed8524a20978c162fdef8558d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:36:00 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [req-29905c68-106f-4f56-ab8b-a09b61732149 req-7bb6671c-de21-4f86-8eeb-c00c17845311 tempest-VolumesGetTestJSON-1147689214 None] Creating volume 8effd541-985d-4f95-a787-8ae038f0f5b2 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:36:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-29905c68-106f-4f56-ab8b-a09b61732149 req-7bb6671c-de21-4f86-8eeb-c00c17845311 tempest-VolumesGetTestJSON-1147689214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-29905c68-106f-4f56-ab8b-a09b61732149 req-7bb6671c-de21-4f86-8eeb-c00c17845311 tempest-VolumesGetTestJSON-1147689214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:00 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [req-29905c68-106f-4f56-ab8b-a09b61732149 req-7bb6671c-de21-4f86-8eeb-c00c17845311 tempest-VolumesGetTestJSON-1147689214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:00 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [req-29905c68-106f-4f56-ab8b-a09b61732149 req-7bb6671c-de21-4f86-8eeb-c00c17845311 tempest-VolumesGetTestJSON-1147689214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-29905c68-106f-4f56-ab8b-a09b61732149 req-7bb6671c-de21-4f86-8eeb-c00c17845311 tempest-VolumesGetTestJSON-1147689214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:00 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [req-29905c68-106f-4f56-ab8b-a09b61732149 req-7bb6671c-de21-4f86-8eeb-c00c17845311 tempest-VolumesGetTestJSON-1147689214 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:36:00 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [req-29905c68-106f-4f56-ab8b-a09b61732149 req-7bb6671c-de21-4f86-8eeb-c00c17845311 tempest-VolumesGetTestJSON-1147689214 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:36:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-29905c68-106f-4f56-ab8b-a09b61732149 req-7bb6671c-de21-4f86-8eeb-c00c17845311 tempest-VolumesGetTestJSON-1147689214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8effd541-985d-4f95-a787-8ae038f0f5b2 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:00 devstack sudo[100390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8effd541-985d-4f95-a787-8ae038f0f5b2 1073741824 Nov 02 12:36:00 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:00 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-69ee7e60-c12a-4920-9821-db71f1ec774d tempest-TestImageHashVerification-1730796337 None] Copy volume to image completed successfully. Nov 02 12:36:01 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-29905c68-106f-4f56-ab8b-a09b61732149 req-7bb6671c-de21-4f86-8eeb-c00c17845311 tempest-VolumesGetTestJSON-1147689214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8effd541-985d-4f95-a787-8ae038f0f5b2 1073741824" returned: 0 in 0.514s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-29905c68-106f-4f56-ab8b-a09b61732149 req-7bb6671c-de21-4f86-8eeb-c00c17845311 tempest-VolumesGetTestJSON-1147689214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8effd541-985d-4f95-a787-8ae038f0f5b2 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:01 devstack sudo[100396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8effd541-985d-4f95-a787-8ae038f0f5b2 Nov 02 12:36:01 devstack sudo[100396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:01 devstack sudo[100396]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-eb17cdf4-220d-4224-8f0c-8eb667c4d3f2 tempest-TestImageHashVerification-1730796337 None] Acquiring lock "cinder-d72f0c5b-0119-4b55-9a4f-90c4c076ed91-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-29905c68-106f-4f56-ab8b-a09b61732149 req-7bb6671c-de21-4f86-8eeb-c00c17845311 tempest-VolumesGetTestJSON-1147689214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8effd541-985d-4f95-a787-8ae038f0f5b2" returned: 0 in 0.391s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:01 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [req-29905c68-106f-4f56-ab8b-a09b61732149 req-7bb6671c-de21-4f86-8eeb-c00c17845311 tempest-VolumesGetTestJSON-1147689214 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:36:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-29905c68-106f-4f56-ab8b-a09b61732149 req-7bb6671c-de21-4f86-8eeb-c00c17845311 tempest-VolumesGetTestJSON-1147689214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-868f4bfa-8211-4f29-a942-cb3cd1866248 tempest-TestMinimumBasicScenario-762180589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.163s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:01 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-868f4bfa-8211-4f29-a942-cb3cd1866248 tempest-TestMinimumBasicScenario-762180589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1962215453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=793c1376-2743-4997-9149-d86dfac8c2ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be975fe1bd8649a8b7901cca4997ac9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:35:51Z,use_quota=True,user_id='d26fe5af2202410fb78ed905219f896e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:36:01 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-868f4bfa-8211-4f29-a942-cb3cd1866248 tempest-TestMinimumBasicScenario-762180589 None] Creating volume 793c1376-2743-4997-9149-d86dfac8c2ef {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:36:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-868f4bfa-8211-4f29-a942-cb3cd1866248 tempest-TestMinimumBasicScenario-762180589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-868f4bfa-8211-4f29-a942-cb3cd1866248 tempest-TestMinimumBasicScenario-762180589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:01 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-868f4bfa-8211-4f29-a942-cb3cd1866248 tempest-TestMinimumBasicScenario-762180589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:01 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-868f4bfa-8211-4f29-a942-cb3cd1866248 tempest-TestMinimumBasicScenario-762180589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-868f4bfa-8211-4f29-a942-cb3cd1866248 tempest-TestMinimumBasicScenario-762180589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:01 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-868f4bfa-8211-4f29-a942-cb3cd1866248 tempest-TestMinimumBasicScenario-762180589 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:36:01 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-868f4bfa-8211-4f29-a942-cb3cd1866248 tempest-TestMinimumBasicScenario-762180589 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:36:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-868f4bfa-8211-4f29-a942-cb3cd1866248 tempest-TestMinimumBasicScenario-762180589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-793c1376-2743-4997-9149-d86dfac8c2ef 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-29905c68-106f-4f56-ab8b-a09b61732149 req-7bb6671c-de21-4f86-8eeb-c00c17845311 tempest-VolumesGetTestJSON-1147689214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1601829c-d9e5-4d03-b79a-0803662575b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8effd541-985d-4f95-a787-8ae038f0f5b2', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-29905c68-106f-4f56-ab8b-a09b61732149 req-7bb6671c-de21-4f86-8eeb-c00c17845311 tempest-VolumesGetTestJSON-1147689214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1885500c-64d9-4c49-a1ca-5336e0d81d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:01 devstack sudo[100421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-793c1376-2743-4997-9149-d86dfac8c2ef 1073741824 Nov 02 12:36:01 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-eb17cdf4-220d-4224-8f0c-8eb667c4d3f2 tempest-TestImageHashVerification-1730796337 None] Lock "cinder-d72f0c5b-0119-4b55-9a4f-90c4c076ed91-delete_volume" acquired by "delete_volume" :: waited 0.124s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:01 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [req-29905c68-106f-4f56-ab8b-a09b61732149 req-7bb6671c-de21-4f86-8eeb-c00c17845311 tempest-VolumesGetTestJSON-1147689214 None] Volume volume-8effd541-985d-4f95-a787-8ae038f0f5b2 (8effd541-985d-4f95-a787-8ae038f0f5b2): created successfully Nov 02 12:36:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-29905c68-106f-4f56-ab8b-a09b61732149 req-7bb6671c-de21-4f86-8eeb-c00c17845311 tempest-VolumesGetTestJSON-1147689214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1885500c-64d9-4c49-a1ca-5336e0d81d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-29905c68-106f-4f56-ab8b-a09b61732149 req-7bb6671c-de21-4f86-8eeb-c00c17845311 tempest-VolumesGetTestJSON-1147689214 None] Flow 'volume_create_manager' (3c320bfd-7e1f-450d-a9d6-24c76771c727) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-eb17cdf4-220d-4224-8f0c-8eb667c4d3f2 tempest-TestImageHashVerification-1730796337 None] Acquiring lock "cinder-quobyte-d72f0c5b-0119-4b55-9a4f-90c4c076ed91" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:01 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-29905c68-106f-4f56-ab8b-a09b61732149 req-7bb6671c-de21-4f86-8eeb-c00c17845311 tempest-VolumesGetTestJSON-1147689214 None] Created volume successfully. Nov 02 12:36:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-eb17cdf4-220d-4224-8f0c-8eb667c4d3f2 tempest-TestImageHashVerification-1730796337 None] Lock "cinder-quobyte-d72f0c5b-0119-4b55-9a4f-90c4c076ed91" acquired by "delete_volume" :: waited 0.029s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:01 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe90ce0-b9dc-4a78-87bd-135c382d8948]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:36:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eb17cdf4-220d-4224-8f0c-8eb667c4d3f2 tempest-TestImageHashVerification-1730796337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d72f0c5b-0119-4b55-9a4f-90c4c076ed91 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:01 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d72f0c5b-0119-4b55-9a4f-90c4c076ed91 Nov 02 12:36:01 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:02 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-868f4bfa-8211-4f29-a942-cb3cd1866248 tempest-TestMinimumBasicScenario-762180589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-793c1376-2743-4997-9149-d86dfac8c2ef 1073741824" returned: 0 in 0.615s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:02 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eb17cdf4-220d-4224-8f0c-8eb667c4d3f2 tempest-TestImageHashVerification-1730796337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d72f0c5b-0119-4b55-9a4f-90c4c076ed91" returned: 0 in 0.432s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eb17cdf4-220d-4224-8f0c-8eb667c4d3f2 tempest-TestImageHashVerification-1730796337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d72f0c5b-0119-4b55-9a4f-90c4c076ed91 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-868f4bfa-8211-4f29-a942-cb3cd1866248 tempest-TestMinimumBasicScenario-762180589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-793c1376-2743-4997-9149-d86dfac8c2ef {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:02 devstack sudo[100431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d72f0c5b-0119-4b55-9a4f-90c4c076ed91 Nov 02 12:36:02 devstack sudo[100431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:02 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-793c1376-2743-4997-9149-d86dfac8c2ef Nov 02 12:36:02 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:02 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-868f4bfa-8211-4f29-a942-cb3cd1866248 tempest-TestMinimumBasicScenario-762180589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-793c1376-2743-4997-9149-d86dfac8c2ef" returned: 0 in 0.290s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-868f4bfa-8211-4f29-a942-cb3cd1866248 tempest-TestMinimumBasicScenario-762180589 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:36:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-868f4bfa-8211-4f29-a942-cb3cd1866248 tempest-TestMinimumBasicScenario-762180589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:02 devstack sudo[100431]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eb17cdf4-220d-4224-8f0c-8eb667c4d3f2 tempest-TestImageHashVerification-1730796337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-d72f0c5b-0119-4b55-9a4f-90c4c076ed91" returned: 0 in 0.320s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-868f4bfa-8211-4f29-a942-cb3cd1866248 tempest-TestMinimumBasicScenario-762180589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59788f6b-2230-49f1-a8e8-65712f06b310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-793c1376-2743-4997-9149-d86dfac8c2ef', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-868f4bfa-8211-4f29-a942-cb3cd1866248 tempest-TestMinimumBasicScenario-762180589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1868bc3-8623-43bb-8075-b36cec468e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:02 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-eb17cdf4-220d-4224-8f0c-8eb667c4d3f2 tempest-TestImageHashVerification-1730796337 None] Lock "cinder-quobyte-d72f0c5b-0119-4b55-9a4f-90c4c076ed91" released by "delete_volume" :: held 0.843s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:02 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-868f4bfa-8211-4f29-a942-cb3cd1866248 tempest-TestMinimumBasicScenario-762180589 None] Volume volume-793c1376-2743-4997-9149-d86dfac8c2ef (793c1376-2743-4997-9149-d86dfac8c2ef): created successfully Nov 02 12:36:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-868f4bfa-8211-4f29-a942-cb3cd1866248 tempest-TestMinimumBasicScenario-762180589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1868bc3-8623-43bb-8075-b36cec468e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-868f4bfa-8211-4f29-a942-cb3cd1866248 tempest-TestMinimumBasicScenario-762180589 None] Flow 'volume_create_manager' (a1a5eb2c-acf2-460e-b10a-790b34895ad9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:02 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-868f4bfa-8211-4f29-a942-cb3cd1866248 tempest-TestMinimumBasicScenario-762180589 None] Created volume successfully. Nov 02 12:36:02 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-eb17cdf4-220d-4224-8f0c-8eb667c4d3f2 tempest-TestImageHashVerification-1730796337 None] Created reservations ['1d8cdd89-d890-45bc-82f1-9c42d4397922', 'ed7cc4f9-8399-4150-afb5-1e536378cc60', '9c43e2be-6081-4050-ad6c-62fce9d67f2d', 'e4551c20-b1d6-48df-8f44-b65f790dac19'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:36:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-eb17cdf4-220d-4224-8f0c-8eb667c4d3f2 tempest-TestImageHashVerification-1730796337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-eb17cdf4-220d-4224-8f0c-8eb667c4d3f2 tempest-TestImageHashVerification-1730796337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-eb17cdf4-220d-4224-8f0c-8eb667c4d3f2 tempest-TestImageHashVerification-1730796337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-eb17cdf4-220d-4224-8f0c-8eb667c4d3f2 tempest-TestImageHashVerification-1730796337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-eb17cdf4-220d-4224-8f0c-8eb667c4d3f2 tempest-TestImageHashVerification-1730796337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eb17cdf4-220d-4224-8f0c-8eb667c4d3f2 tempest-TestImageHashVerification-1730796337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:02 devstack sudo[100437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:36:02 devstack sudo[100437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:03 devstack sudo[100437]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eb17cdf4-220d-4224-8f0c-8eb667c4d3f2 tempest-TestImageHashVerification-1730796337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.285s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:03 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-eb17cdf4-220d-4224-8f0c-8eb667c4d3f2 tempest-TestImageHashVerification-1730796337 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:36:03 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-eb17cdf4-220d-4224-8f0c-8eb667c4d3f2 tempest-TestImageHashVerification-1730796337 None] Deleted volume successfully. Nov 02 12:36:03 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-eb17cdf4-220d-4224-8f0c-8eb667c4d3f2 tempest-TestImageHashVerification-1730796337 None] Lock "cinder-d72f0c5b-0119-4b55-9a4f-90c4c076ed91-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:03 devstack cinder-volume[86515]: DEBUG cinder.coordination [req-e35b145b-ce2f-45af-8e77-a7aac5f426c0 req-fd9d8a45-9364-43e1-bf6b-b289b8d3fa02 tempest-VolumesGetTestJSON-1147689214 None] Acquiring lock "cinder-8effd541-985d-4f95-a787-8ae038f0f5b2-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:03 devstack cinder-volume[86515]: DEBUG cinder.coordination [req-e35b145b-ce2f-45af-8e77-a7aac5f426c0 req-fd9d8a45-9364-43e1-bf6b-b289b8d3fa02 tempest-VolumesGetTestJSON-1147689214 None] Lock "cinder-8effd541-985d-4f95-a787-8ae038f0f5b2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:03 devstack cinder-volume[86515]: DEBUG cinder.coordination [req-e35b145b-ce2f-45af-8e77-a7aac5f426c0 req-fd9d8a45-9364-43e1-bf6b-b289b8d3fa02 tempest-VolumesGetTestJSON-1147689214 None] Acquiring lock "cinder-quobyte-8effd541-985d-4f95-a787-8ae038f0f5b2" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:03 devstack cinder-volume[86515]: DEBUG cinder.coordination [req-e35b145b-ce2f-45af-8e77-a7aac5f426c0 req-fd9d8a45-9364-43e1-bf6b-b289b8d3fa02 tempest-VolumesGetTestJSON-1147689214 None] Lock "cinder-quobyte-8effd541-985d-4f95-a787-8ae038f0f5b2" acquired by "delete_volume" :: waited 0.026s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:03 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e434ef5-6848-40e9-9538-0fb9d9817ea4]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:36:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-e35b145b-ce2f-45af-8e77-a7aac5f426c0 req-fd9d8a45-9364-43e1-bf6b-b289b8d3fa02 tempest-VolumesGetTestJSON-1147689214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8effd541-985d-4f95-a787-8ae038f0f5b2 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:03 devstack sudo[100440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8effd541-985d-4f95-a787-8ae038f0f5b2 Nov 02 12:36:03 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:03 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-e35b145b-ce2f-45af-8e77-a7aac5f426c0 req-fd9d8a45-9364-43e1-bf6b-b289b8d3fa02 tempest-VolumesGetTestJSON-1147689214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8effd541-985d-4f95-a787-8ae038f0f5b2" returned: 0 in 0.424s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-e35b145b-ce2f-45af-8e77-a7aac5f426c0 req-fd9d8a45-9364-43e1-bf6b-b289b8d3fa02 tempest-VolumesGetTestJSON-1147689214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8effd541-985d-4f95-a787-8ae038f0f5b2 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:03 devstack sudo[100448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8effd541-985d-4f95-a787-8ae038f0f5b2 Nov 02 12:36:03 devstack sudo[100448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:04 devstack sudo[100448]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-e35b145b-ce2f-45af-8e77-a7aac5f426c0 req-fd9d8a45-9364-43e1-bf6b-b289b8d3fa02 tempest-VolumesGetTestJSON-1147689214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8effd541-985d-4f95-a787-8ae038f0f5b2" returned: 0 in 0.306s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:04 devstack cinder-volume[86515]: DEBUG cinder.coordination [req-e35b145b-ce2f-45af-8e77-a7aac5f426c0 req-fd9d8a45-9364-43e1-bf6b-b289b8d3fa02 tempest-VolumesGetTestJSON-1147689214 None] Lock "cinder-quobyte-8effd541-985d-4f95-a787-8ae038f0f5b2" released by "delete_volume" :: held 0.794s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:04 devstack cinder-volume[86515]: DEBUG cinder.quota [req-e35b145b-ce2f-45af-8e77-a7aac5f426c0 req-fd9d8a45-9364-43e1-bf6b-b289b8d3fa02 tempest-VolumesGetTestJSON-1147689214 None] Created reservations ['21938512-4e9a-414c-bf17-2e38b1ae7211', '23dc31d3-d7ba-423d-9ce1-90ad444a8f13', 'fdc40761-cf4e-45db-9571-90f87ed783a8', '2d95ab38-bef4-4328-9350-489fed4c3f00'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:36:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-e35b145b-ce2f-45af-8e77-a7aac5f426c0 req-fd9d8a45-9364-43e1-bf6b-b289b8d3fa02 tempest-VolumesGetTestJSON-1147689214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-e35b145b-ce2f-45af-8e77-a7aac5f426c0 req-fd9d8a45-9364-43e1-bf6b-b289b8d3fa02 tempest-VolumesGetTestJSON-1147689214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:04 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [req-e35b145b-ce2f-45af-8e77-a7aac5f426c0 req-fd9d8a45-9364-43e1-bf6b-b289b8d3fa02 tempest-VolumesGetTestJSON-1147689214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:04 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [req-e35b145b-ce2f-45af-8e77-a7aac5f426c0 req-fd9d8a45-9364-43e1-bf6b-b289b8d3fa02 tempest-VolumesGetTestJSON-1147689214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-e35b145b-ce2f-45af-8e77-a7aac5f426c0 req-fd9d8a45-9364-43e1-bf6b-b289b8d3fa02 tempest-VolumesGetTestJSON-1147689214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-e35b145b-ce2f-45af-8e77-a7aac5f426c0 req-fd9d8a45-9364-43e1-bf6b-b289b8d3fa02 tempest-VolumesGetTestJSON-1147689214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:04 devstack sudo[100459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:36:04 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-8ba4cce1-bac9-4267-b397-33f65f768150 req-9741ad19-6420-4736-ab51-cf995bde1d47 tempest-TestMinimumBasicScenario-762180589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-8ba4cce1-bac9-4267-b397-33f65f768150 req-9741ad19-6420-4736-ab51-cf995bde1d47 tempest-TestMinimumBasicScenario-762180589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-8ba4cce1-bac9-4267-b397-33f65f768150 req-9741ad19-6420-4736-ab51-cf995bde1d47 tempest-TestMinimumBasicScenario-762180589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:04 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-8ba4cce1-bac9-4267-b397-33f65f768150 req-9741ad19-6420-4736-ab51-cf995bde1d47 tempest-TestMinimumBasicScenario-762180589 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae', 'name': 'volume-793c1376-2743-4997-9149-d86dfac8c2ef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5b442741-0212-4766-a834-b98e247c1012', 'enforce_multipath': True} {{(pid=86515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:36:04 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-8ba4cce1-bac9-4267-b397-33f65f768150 req-9741ad19-6420-4736-ab51-cf995bde1d47 tempest-TestMinimumBasicScenario-762180589 None] attachment_update completed successfully. Nov 02 12:36:04 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-e35b145b-ce2f-45af-8e77-a7aac5f426c0 req-fd9d8a45-9364-43e1-bf6b-b289b8d3fa02 tempest-VolumesGetTestJSON-1147689214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.338s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:04 devstack cinder-volume[86515]: DEBUG cinder.manager [req-e35b145b-ce2f-45af-8e77-a7aac5f426c0 req-fd9d8a45-9364-43e1-bf6b-b289b8d3fa02 tempest-VolumesGetTestJSON-1147689214 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:36:04 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-e35b145b-ce2f-45af-8e77-a7aac5f426c0 req-fd9d8a45-9364-43e1-bf6b-b289b8d3fa02 tempest-VolumesGetTestJSON-1147689214 None] Deleted volume successfully. Nov 02 12:36:04 devstack cinder-volume[86515]: DEBUG cinder.coordination [req-e35b145b-ce2f-45af-8e77-a7aac5f426c0 req-fd9d8a45-9364-43e1-bf6b-b289b8d3fa02 tempest-VolumesGetTestJSON-1147689214 None] Lock "cinder-8effd541-985d-4f95-a787-8ae038f0f5b2-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:10 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-5ed9a2bb-c1cf-4f85-a970-46fc62fa5283 tempest-GroupSnapshotsV319Test-952127983 None] Group tempest-GroupSnapshotsV319Test-Group-1193832584: creating Nov 02 12:36:10 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-5ed9a2bb-c1cf-4f85-a970-46fc62fa5283 tempest-GroupSnapshotsV319Test-952127983 None] Group tempest-GroupSnapshotsV319Test-Group-1193832584: created successfully Nov 02 12:36:10 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-5ed9a2bb-c1cf-4f85-a970-46fc62fa5283 tempest-GroupSnapshotsV319Test-952127983 None] Create group completed successfully. Nov 02 12:36:12 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-21ba8ca4-ac5a-410b-bc7f-dcc72777aa6d tempest-GroupSnapshotsV319Test-952127983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:36:12 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-21ba8ca4-ac5a-410b-bc7f-dcc72777aa6d tempest-GroupSnapshotsV319Test-952127983 None] Flow 'volume_create_manager' (42c5564b-5586-4e1f-9c99-e7d6f267b40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:12 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-21ba8ca4-ac5a-410b-bc7f-dcc72777aa6d tempest-GroupSnapshotsV319Test-952127983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f31972f-a211-444c-9984-c119a19ef5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:12 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-21ba8ca4-ac5a-410b-bc7f-dcc72777aa6d tempest-GroupSnapshotsV319Test-952127983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f31972f-a211-444c-9984-c119a19ef5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1733283434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4a057810-1dda-43f5-ab21-c4077e6bd8c8,host='devstack@QuobyteHD#QuobyteHD',id=aaf79c45-663a-41a1-a806-332fd5ea364a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fa71e90c10f4bb2ab04e4466a6459d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:12Z,use_quota=True,user_id='2ebba9f4bfed4792abff02a0c7703696',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8120b864-0f0f-432a-b335-b9c3a8ed9984),volume_type_id=8120b864-0f0f-432a-b335-b9c3a8ed9984)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:12 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-21ba8ca4-ac5a-410b-bc7f-dcc72777aa6d tempest-GroupSnapshotsV319Test-952127983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76f87885-9d45-47ef-97c8-fd6966b0251e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:12 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-21ba8ca4-ac5a-410b-bc7f-dcc72777aa6d tempest-GroupSnapshotsV319Test-952127983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76f87885-9d45-47ef-97c8-fd6966b0251e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:12 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-21ba8ca4-ac5a-410b-bc7f-dcc72777aa6d tempest-GroupSnapshotsV319Test-952127983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed8526ac-e453-4080-a249-e9ca4bffa44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:12 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-21ba8ca4-ac5a-410b-bc7f-dcc72777aa6d tempest-GroupSnapshotsV319Test-952127983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed8526ac-e453-4080-a249-e9ca4bffa44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaf79c45-663a-41a1-a806-332fd5ea364a', 'volume_name': 'volume-aaf79c45-663a-41a1-a806-332fd5ea364a', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:12 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-21ba8ca4-ac5a-410b-bc7f-dcc72777aa6d tempest-GroupSnapshotsV319Test-952127983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5675e12a-4a5a-454f-afdf-e551ba67c818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:12 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-21ba8ca4-ac5a-410b-bc7f-dcc72777aa6d tempest-GroupSnapshotsV319Test-952127983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5675e12a-4a5a-454f-afdf-e551ba67c818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:12 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-21ba8ca4-ac5a-410b-bc7f-dcc72777aa6d tempest-GroupSnapshotsV319Test-952127983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99451929-e197-45e3-abcf-e5a5876c67ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:12 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-21ba8ca4-ac5a-410b-bc7f-dcc72777aa6d tempest-GroupSnapshotsV319Test-952127983 None] Volume aaf79c45-663a-41a1-a806-332fd5ea364a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaf79c45-663a-41a1-a806-332fd5ea364a', 'volume_size': 1} Nov 02 12:36:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-21ba8ca4-ac5a-410b-bc7f-dcc72777aa6d tempest-GroupSnapshotsV319Test-952127983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-21ba8ca4-ac5a-410b-bc7f-dcc72777aa6d tempest-GroupSnapshotsV319Test-952127983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:12 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-21ba8ca4-ac5a-410b-bc7f-dcc72777aa6d tempest-GroupSnapshotsV319Test-952127983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4a057810-1dda-43f5-ab21-c4077e6bd8c8,created_at=2026-11-02T11:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1733283434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4a057810-1dda-43f5-ab21-c4077e6bd8c8,host='devstack@QuobyteHD#QuobyteHD',id=aaf79c45-663a-41a1-a806-332fd5ea364a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fa71e90c10f4bb2ab04e4466a6459d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:12Z,use_quota=True,user_id='2ebba9f4bfed4792abff02a0c7703696',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8120b864-0f0f-432a-b335-b9c3a8ed9984),volume_type_id=8120b864-0f0f-432a-b335-b9c3a8ed9984)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:36:12 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-21ba8ca4-ac5a-410b-bc7f-dcc72777aa6d tempest-GroupSnapshotsV319Test-952127983 None] Creating volume aaf79c45-663a-41a1-a806-332fd5ea364a {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:36:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-21ba8ca4-ac5a-410b-bc7f-dcc72777aa6d tempest-GroupSnapshotsV319Test-952127983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-21ba8ca4-ac5a-410b-bc7f-dcc72777aa6d tempest-GroupSnapshotsV319Test-952127983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:12 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-21ba8ca4-ac5a-410b-bc7f-dcc72777aa6d tempest-GroupSnapshotsV319Test-952127983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:12 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-21ba8ca4-ac5a-410b-bc7f-dcc72777aa6d tempest-GroupSnapshotsV319Test-952127983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-21ba8ca4-ac5a-410b-bc7f-dcc72777aa6d tempest-GroupSnapshotsV319Test-952127983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:12 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-21ba8ca4-ac5a-410b-bc7f-dcc72777aa6d tempest-GroupSnapshotsV319Test-952127983 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:36:12 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-21ba8ca4-ac5a-410b-bc7f-dcc72777aa6d tempest-GroupSnapshotsV319Test-952127983 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:36:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-21ba8ca4-ac5a-410b-bc7f-dcc72777aa6d tempest-GroupSnapshotsV319Test-952127983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:12 devstack sudo[100889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a 1073741824 Nov 02 12:36:12 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:12 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-21ba8ca4-ac5a-410b-bc7f-dcc72777aa6d tempest-GroupSnapshotsV319Test-952127983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a 1073741824" returned: 0 in 0.490s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-21ba8ca4-ac5a-410b-bc7f-dcc72777aa6d tempest-GroupSnapshotsV319Test-952127983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:12 devstack sudo[100895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a Nov 02 12:36:12 devstack sudo[100895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:13 devstack sudo[100895]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-21ba8ca4-ac5a-410b-bc7f-dcc72777aa6d tempest-GroupSnapshotsV319Test-952127983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a" returned: 0 in 0.267s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:13 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-21ba8ca4-ac5a-410b-bc7f-dcc72777aa6d tempest-GroupSnapshotsV319Test-952127983 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:36:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-21ba8ca4-ac5a-410b-bc7f-dcc72777aa6d tempest-GroupSnapshotsV319Test-952127983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:13 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-21ba8ca4-ac5a-410b-bc7f-dcc72777aa6d tempest-GroupSnapshotsV319Test-952127983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99451929-e197-45e3-abcf-e5a5876c67ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaf79c45-663a-41a1-a806-332fd5ea364a', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:13 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-21ba8ca4-ac5a-410b-bc7f-dcc72777aa6d tempest-GroupSnapshotsV319Test-952127983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af3539e5-ab0c-4d48-875a-3282b705033b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:13 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-21ba8ca4-ac5a-410b-bc7f-dcc72777aa6d tempest-GroupSnapshotsV319Test-952127983 None] Volume volume-aaf79c45-663a-41a1-a806-332fd5ea364a (aaf79c45-663a-41a1-a806-332fd5ea364a): created successfully Nov 02 12:36:13 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-21ba8ca4-ac5a-410b-bc7f-dcc72777aa6d tempest-GroupSnapshotsV319Test-952127983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af3539e5-ab0c-4d48-875a-3282b705033b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:13 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-21ba8ca4-ac5a-410b-bc7f-dcc72777aa6d tempest-GroupSnapshotsV319Test-952127983 None] Flow 'volume_create_manager' (42c5564b-5586-4e1f-9c99-e7d6f267b40e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:13 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-21ba8ca4-ac5a-410b-bc7f-dcc72777aa6d tempest-GroupSnapshotsV319Test-952127983 None] Created volume successfully. Nov 02 12:36:13 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-e8adfbb2-b6c8-4b71-9346-1c0b54efcc80 tempest-GroupSnapshotsV319Test-952127983 None] GroupSnapshot 08c7d0f7-d0a2-4277-a3d1-90e397a0dd65: creating. Nov 02 12:36:13 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e8adfbb2-b6c8-4b71-9346-1c0b54efcc80 tempest-GroupSnapshotsV319Test-952127983 None] Group snapshot 08c7d0f7-d0a2-4277-a3d1-90e397a0dd65: creating. {{(pid=86515) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 12:36:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e8adfbb2-b6c8-4b71-9346-1c0b54efcc80 tempest-GroupSnapshotsV319Test-952127983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e8adfbb2-b6c8-4b71-9346-1c0b54efcc80 tempest-GroupSnapshotsV319Test-952127983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:13 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-e8adfbb2-b6c8-4b71-9346-1c0b54efcc80 tempest-GroupSnapshotsV319Test-952127983 None] Creating offline snapshot 57bbea5b-c35c-4eb9-9d31-07fb7a42473a of volume aaf79c45-663a-41a1-a806-332fd5ea364a {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:36:13 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1891cc-f8f8-4780-85b6-26fade0f593d]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:36:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e8adfbb2-b6c8-4b71-9346-1c0b54efcc80 tempest-GroupSnapshotsV319Test-952127983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:13 devstack sudo[100898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a Nov 02 12:36:13 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:14 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e8adfbb2-b6c8-4b71-9346-1c0b54efcc80 tempest-GroupSnapshotsV319Test-952127983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a" returned: 0 in 0.444s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e8adfbb2-b6c8-4b71-9346-1c0b54efcc80 tempest-GroupSnapshotsV319Test-952127983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a.57bbea5b-c35c-4eb9-9d31-07fb7a42473a 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:14 devstack sudo[100903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a.57bbea5b-c35c-4eb9-9d31-07fb7a42473a 1G Nov 02 12:36:14 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:14 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e8adfbb2-b6c8-4b71-9346-1c0b54efcc80 tempest-GroupSnapshotsV319Test-952127983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a.57bbea5b-c35c-4eb9-9d31-07fb7a42473a 1G" returned: 0 in 0.643s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e8adfbb2-b6c8-4b71-9346-1c0b54efcc80 tempest-GroupSnapshotsV319Test-952127983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aaf79c45-663a-41a1-a806-332fd5ea364a -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a.57bbea5b-c35c-4eb9-9d31-07fb7a42473a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:14 devstack sudo[100912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aaf79c45-663a-41a1-a806-332fd5ea364a -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a.57bbea5b-c35c-4eb9-9d31-07fb7a42473a Nov 02 12:36:14 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:15 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e8adfbb2-b6c8-4b71-9346-1c0b54efcc80 tempest-GroupSnapshotsV319Test-952127983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aaf79c45-663a-41a1-a806-332fd5ea364a -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a.57bbea5b-c35c-4eb9-9d31-07fb7a42473a" returned: 0 in 0.415s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:15 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-e8adfbb2-b6c8-4b71-9346-1c0b54efcc80 tempest-GroupSnapshotsV319Test-952127983 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a.57bbea5b-c35c-4eb9-9d31-07fb7a42473a is being set with open permissions: ugo+rw: NotImplementedError Nov 02 12:36:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e8adfbb2-b6c8-4b71-9346-1c0b54efcc80 tempest-GroupSnapshotsV319Test-952127983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a.57bbea5b-c35c-4eb9-9d31-07fb7a42473a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:15 devstack sudo[100918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a.57bbea5b-c35c-4eb9-9d31-07fb7a42473a Nov 02 12:36:15 devstack sudo[100918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:15 devstack sudo[100918]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e8adfbb2-b6c8-4b71-9346-1c0b54efcc80 tempest-GroupSnapshotsV319Test-952127983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a.57bbea5b-c35c-4eb9-9d31-07fb7a42473a" returned: 0 in 0.354s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e8adfbb2-b6c8-4b71-9346-1c0b54efcc80 tempest-GroupSnapshotsV319Test-952127983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:15 devstack sudo[100921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a.info Nov 02 12:36:15 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:15 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e8adfbb2-b6c8-4b71-9346-1c0b54efcc80 tempest-GroupSnapshotsV319Test-952127983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a.info" returned: 0 in 0.324s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:15 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-e8adfbb2-b6c8-4b71-9346-1c0b54efcc80 tempest-GroupSnapshotsV319Test-952127983 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 12:36:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e8adfbb2-b6c8-4b71-9346-1c0b54efcc80 tempest-GroupSnapshotsV319Test-952127983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:15 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a.info Nov 02 12:36:15 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:16 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e8adfbb2-b6c8-4b71-9346-1c0b54efcc80 tempest-GroupSnapshotsV319Test-952127983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a.info" returned: 0 in 0.319s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e8adfbb2-b6c8-4b71-9346-1c0b54efcc80 tempest-GroupSnapshotsV319Test-952127983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.623s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:16 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-e8adfbb2-b6c8-4b71-9346-1c0b54efcc80 tempest-GroupSnapshotsV319Test-952127983 None] group_snapshot 08c7d0f7-d0a2-4277-a3d1-90e397a0dd65: created successfully Nov 02 12:36:17 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-aa037fff-7986-4a19-b67e-2c311895edf7 tempest-GroupSnapshotsV319Test-952127983 None] group_snapshot 08c7d0f7-d0a2-4277-a3d1-90e397a0dd65: deleting Nov 02 12:36:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-aa037fff-7986-4a19-b67e-2c311895edf7 tempest-GroupSnapshotsV319Test-952127983 None] group_snapshot 08c7d0f7-d0a2-4277-a3d1-90e397a0dd65: deleting {{(pid=86515) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 12:36:17 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-aa037fff-7986-4a19-b67e-2c311895edf7 tempest-GroupSnapshotsV319Test-952127983 None] Acquiring lock "cinder-quobyte-aaf79c45-663a-41a1-a806-332fd5ea364a" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:17 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-aa037fff-7986-4a19-b67e-2c311895edf7 tempest-GroupSnapshotsV319Test-952127983 None] Lock "cinder-quobyte-aaf79c45-663a-41a1-a806-332fd5ea364a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:17 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-aa037fff-7986-4a19-b67e-2c311895edf7 tempest-GroupSnapshotsV319Test-952127983 None] Acquiring lock "cinder-quobyte-57bbea5b-c35c-4eb9-9d31-07fb7a42473a" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:17 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-aa037fff-7986-4a19-b67e-2c311895edf7 tempest-GroupSnapshotsV319Test-952127983 None] Lock "cinder-quobyte-57bbea5b-c35c-4eb9-9d31-07fb7a42473a" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-aa037fff-7986-4a19-b67e-2c311895edf7 tempest-GroupSnapshotsV319Test-952127983 None] Deleting offline snapshot 57bbea5b-c35c-4eb9-9d31-07fb7a42473a of volume aaf79c45-663a-41a1-a806-332fd5ea364a {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:36:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-aa037fff-7986-4a19-b67e-2c311895edf7 tempest-GroupSnapshotsV319Test-952127983 None] snapshot_file for this snap is: volume-aaf79c45-663a-41a1-a806-332fd5ea364a.57bbea5b-c35c-4eb9-9d31-07fb7a42473a {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:36:17 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de865da-bddb-4aff-a70f-43474e448f42]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:36:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-aa037fff-7986-4a19-b67e-2c311895edf7 tempest-GroupSnapshotsV319Test-952127983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a.57bbea5b-c35c-4eb9-9d31-07fb7a42473a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:17 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a.57bbea5b-c35c-4eb9-9d31-07fb7a42473a Nov 02 12:36:17 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:18 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-aa037fff-7986-4a19-b67e-2c311895edf7 tempest-GroupSnapshotsV319Test-952127983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a.57bbea5b-c35c-4eb9-9d31-07fb7a42473a" returned: 0 in 0.436s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:18 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-aa037fff-7986-4a19-b67e-2c311895edf7 tempest-GroupSnapshotsV319Test-952127983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aaf79c45-663a-41a1-a806-332fd5ea364a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:36:18 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36471e4-f756-4f3e-bc74-83a38a8df36e]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:36:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-aa037fff-7986-4a19-b67e-2c311895edf7 tempest-GroupSnapshotsV319Test-952127983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:18 devstack sudo[100933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a Nov 02 12:36:18 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:18 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-aa037fff-7986-4a19-b67e-2c311895edf7 tempest-GroupSnapshotsV319Test-952127983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a" returned: 0 in 0.385s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-aa037fff-7986-4a19-b67e-2c311895edf7 tempest-GroupSnapshotsV319Test-952127983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a.57bbea5b-c35c-4eb9-9d31-07fb7a42473a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:18 devstack sudo[100938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a.57bbea5b-c35c-4eb9-9d31-07fb7a42473a Nov 02 12:36:18 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:18 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-aa037fff-7986-4a19-b67e-2c311895edf7 tempest-GroupSnapshotsV319Test-952127983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a.57bbea5b-c35c-4eb9-9d31-07fb7a42473a" returned: 0 in 0.386s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-aa037fff-7986-4a19-b67e-2c311895edf7 tempest-GroupSnapshotsV319Test-952127983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a.57bbea5b-c35c-4eb9-9d31-07fb7a42473a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:19 devstack sudo[100944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a.57bbea5b-c35c-4eb9-9d31-07fb7a42473a Nov 02 12:36:19 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:19 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-aa037fff-7986-4a19-b67e-2c311895edf7 tempest-GroupSnapshotsV319Test-952127983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a.57bbea5b-c35c-4eb9-9d31-07fb7a42473a" returned: 0 in 0.259s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:19 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-aa037fff-7986-4a19-b67e-2c311895edf7 tempest-GroupSnapshotsV319Test-952127983 None] Lock "cinder-quobyte-57bbea5b-c35c-4eb9-9d31-07fb7a42473a" released by "_delete_snapshot" :: held 1.608s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:19 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-aa037fff-7986-4a19-b67e-2c311895edf7 tempest-GroupSnapshotsV319Test-952127983 None] Lock "cinder-quobyte-aaf79c45-663a-41a1-a806-332fd5ea364a" released by "delete_snapshot" :: held 1.645s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:19 devstack cinder-volume[86515]: WARNING cinder.quota [None req-aa037fff-7986-4a19-b67e-2c311895edf7 tempest-GroupSnapshotsV319Test-952127983 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1907360556 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1907360556, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:36:19 devstack cinder-volume[86515]: WARNING cinder.quota [None req-aa037fff-7986-4a19-b67e-2c311895edf7 tempest-GroupSnapshotsV319Test-952127983 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1907360556 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1907360556, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:36:19 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-aa037fff-7986-4a19-b67e-2c311895edf7 tempest-GroupSnapshotsV319Test-952127983 None] Created reservations ['418927e6-52f4-4ac5-ab2e-c36ebc123238', 'ac9f25d5-041e-4574-858d-c294eac03bc4', '5bf127ce-3517-4ad0-a30a-c28ad3517f75', 'cb340834-6f09-4f79-b7b2-28bab890866a'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:36:19 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-aa037fff-7986-4a19-b67e-2c311895edf7 tempest-GroupSnapshotsV319Test-952127983 None] group_snapshot 08c7d0f7-d0a2-4277-a3d1-90e397a0dd65: deleted successfully Nov 02 12:36:19 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-29936eb9-abed-47b6-b9ac-a0d204a795e4 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:36:19 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-29936eb9-abed-47b6-b9ac-a0d204a795e4 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Flow 'volume_create_manager' (f21610d9-2fce-47da-8cba-5ca16f794dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:19 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-29936eb9-abed-47b6-b9ac-a0d204a795e4 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c004d3b3-0191-4885-8c95-86416f6f8b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:19 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-29936eb9-abed-47b6-b9ac-a0d204a795e4 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c004d3b3-0191-4885-8c95-86416f6f8b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-51706029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=780181da-3edd-4274-a881-0b104181876c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='376904a861894f2b80453b430f1f050e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:20Z,use_quota=True,user_id='aa2d8f8e28db4c56b73d792bc590b981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:19 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-29936eb9-abed-47b6-b9ac-a0d204a795e4 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f255ebf3-b8c8-45dd-86c8-e49603331fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:19 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-29936eb9-abed-47b6-b9ac-a0d204a795e4 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f255ebf3-b8c8-45dd-86c8-e49603331fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:19 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-29936eb9-abed-47b6-b9ac-a0d204a795e4 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98835706-eece-4b16-9b8d-5e69e7ead727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:19 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-29936eb9-abed-47b6-b9ac-a0d204a795e4 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98835706-eece-4b16-9b8d-5e69e7ead727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '780181da-3edd-4274-a881-0b104181876c', 'volume_name': 'volume-780181da-3edd-4274-a881-0b104181876c', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:19 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-29936eb9-abed-47b6-b9ac-a0d204a795e4 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f466f54-cb57-4178-84fd-ef7346eb1a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:19 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-29936eb9-abed-47b6-b9ac-a0d204a795e4 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f466f54-cb57-4178-84fd-ef7346eb1a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:19 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-29936eb9-abed-47b6-b9ac-a0d204a795e4 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b82734f4-1b13-4a8c-bfd4-036d90a3a388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:19 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-29936eb9-abed-47b6-b9ac-a0d204a795e4 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Volume 780181da-3edd-4274-a881-0b104181876c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-780181da-3edd-4274-a881-0b104181876c', 'volume_size': 1} Nov 02 12:36:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-29936eb9-abed-47b6-b9ac-a0d204a795e4 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-29936eb9-abed-47b6-b9ac-a0d204a795e4 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:19 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-29936eb9-abed-47b6-b9ac-a0d204a795e4 tempest-CreateVolumesFromSnapshotTest-1676715326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-51706029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=780181da-3edd-4274-a881-0b104181876c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='376904a861894f2b80453b430f1f050e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:20Z,use_quota=True,user_id='aa2d8f8e28db4c56b73d792bc590b981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:36:19 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-29936eb9-abed-47b6-b9ac-a0d204a795e4 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Creating volume 780181da-3edd-4274-a881-0b104181876c {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:36:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-29936eb9-abed-47b6-b9ac-a0d204a795e4 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-29936eb9-abed-47b6-b9ac-a0d204a795e4 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:19 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-29936eb9-abed-47b6-b9ac-a0d204a795e4 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:19 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-29936eb9-abed-47b6-b9ac-a0d204a795e4 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-29936eb9-abed-47b6-b9ac-a0d204a795e4 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:19 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-29936eb9-abed-47b6-b9ac-a0d204a795e4 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:36:19 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-29936eb9-abed-47b6-b9ac-a0d204a795e4 tempest-CreateVolumesFromSnapshotTest-1676715326 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:36:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-29936eb9-abed-47b6-b9ac-a0d204a795e4 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:19 devstack sudo[100947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c 1073741824 Nov 02 12:36:19 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:20 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-29936eb9-abed-47b6-b9ac-a0d204a795e4 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c 1073741824" returned: 0 in 0.436s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-29936eb9-abed-47b6-b9ac-a0d204a795e4 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:20 devstack sudo[100952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c Nov 02 12:36:20 devstack sudo[100952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:20 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-df6bdf4c-1559-4246-b1fa-dd7b190ca930 tempest-GroupSnapshotsV319Test-952127983 None] Acquiring lock "cinder-quobyte-aaf79c45-663a-41a1-a806-332fd5ea364a" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:20 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-df6bdf4c-1559-4246-b1fa-dd7b190ca930 tempest-GroupSnapshotsV319Test-952127983 None] Lock "cinder-quobyte-aaf79c45-663a-41a1-a806-332fd5ea364a" acquired by "delete_volume" :: waited 0.026s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:20 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f3dd24-63b6-40fd-8110-a9224a84c71b]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:36:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-df6bdf4c-1559-4246-b1fa-dd7b190ca930 tempest-GroupSnapshotsV319Test-952127983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:20 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a Nov 02 12:36:20 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:20 devstack sudo[100952]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-29936eb9-abed-47b6-b9ac-a0d204a795e4 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c" returned: 0 in 0.282s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-29936eb9-abed-47b6-b9ac-a0d204a795e4 tempest-CreateVolumesFromSnapshotTest-1676715326 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:36:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-29936eb9-abed-47b6-b9ac-a0d204a795e4 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-29936eb9-abed-47b6-b9ac-a0d204a795e4 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b82734f4-1b13-4a8c-bfd4-036d90a3a388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-780181da-3edd-4274-a881-0b104181876c', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-29936eb9-abed-47b6-b9ac-a0d204a795e4 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece967d8-190f-476e-ba39-da830f92780b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:20 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-29936eb9-abed-47b6-b9ac-a0d204a795e4 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Volume volume-780181da-3edd-4274-a881-0b104181876c (780181da-3edd-4274-a881-0b104181876c): created successfully Nov 02 12:36:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-29936eb9-abed-47b6-b9ac-a0d204a795e4 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece967d8-190f-476e-ba39-da830f92780b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-29936eb9-abed-47b6-b9ac-a0d204a795e4 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Flow 'volume_create_manager' (f21610d9-2fce-47da-8cba-5ca16f794dd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:20 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-29936eb9-abed-47b6-b9ac-a0d204a795e4 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Created volume successfully. Nov 02 12:36:20 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-df6bdf4c-1559-4246-b1fa-dd7b190ca930 tempest-GroupSnapshotsV319Test-952127983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a" returned: 0 in 0.453s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-df6bdf4c-1559-4246-b1fa-dd7b190ca930 tempest-GroupSnapshotsV319Test-952127983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:20 devstack sudo[100960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a Nov 02 12:36:20 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2ed77431-c1f9-47ff-945e-a9c4f6041154 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2ed77431-c1f9-47ff-945e-a9c4f6041154 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-2ed77431-c1f9-47ff-945e-a9c4f6041154 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Creating offline snapshot 99ca459c-a696-42be-9ff6-6ae2031f05f2 of volume 780181da-3edd-4274-a881-0b104181876c {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:36:20 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e86319f-39b0-4901-9eb9-e453e8893a65]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:36:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2ed77431-c1f9-47ff-945e-a9c4f6041154 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:20 devstack sudo[100962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c Nov 02 12:36:20 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:21 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-df6bdf4c-1559-4246-b1fa-dd7b190ca930 tempest-GroupSnapshotsV319Test-952127983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-aaf79c45-663a-41a1-a806-332fd5ea364a" returned: 0 in 0.274s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:21 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-df6bdf4c-1559-4246-b1fa-dd7b190ca930 tempest-GroupSnapshotsV319Test-952127983 None] Lock "cinder-quobyte-aaf79c45-663a-41a1-a806-332fd5ea364a" released by "delete_volume" :: held 0.828s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:21 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-df6bdf4c-1559-4246-b1fa-dd7b190ca930 tempest-GroupSnapshotsV319Test-952127983 None] Created reservations ['849a0a6d-bf1f-413c-9546-5692d10a3413'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:36:21 devstack cinder-volume[86515]: WARNING cinder.quota [None req-df6bdf4c-1559-4246-b1fa-dd7b190ca930 tempest-GroupSnapshotsV319Test-952127983 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1907360556 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1907360556, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:36:21 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-df6bdf4c-1559-4246-b1fa-dd7b190ca930 tempest-GroupSnapshotsV319Test-952127983 None] Created reservations ['a4c6267d-128d-4738-977d-d99ef858db88', '121f8f70-39e1-449f-bcaa-0c47d3468b88', '7f80e4a6-8855-48b0-b633-f86958b6df81', '6579013f-91fe-42e9-965e-e1eec441fbe6'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:36:21 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-df6bdf4c-1559-4246-b1fa-dd7b190ca930 tempest-GroupSnapshotsV319Test-952127983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-df6bdf4c-1559-4246-b1fa-dd7b190ca930 tempest-GroupSnapshotsV319Test-952127983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:21 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-df6bdf4c-1559-4246-b1fa-dd7b190ca930 tempest-GroupSnapshotsV319Test-952127983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:21 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-df6bdf4c-1559-4246-b1fa-dd7b190ca930 tempest-GroupSnapshotsV319Test-952127983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-df6bdf4c-1559-4246-b1fa-dd7b190ca930 tempest-GroupSnapshotsV319Test-952127983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-df6bdf4c-1559-4246-b1fa-dd7b190ca930 tempest-GroupSnapshotsV319Test-952127983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2ed77431-c1f9-47ff-945e-a9c4f6041154 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c" returned: 0 in 0.410s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2ed77431-c1f9-47ff-945e-a9c4f6041154 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c.99ca459c-a696-42be-9ff6-6ae2031f05f2 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:21 devstack sudo[100969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:36:21 devstack sudo[100969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:21 devstack sudo[100970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c.99ca459c-a696-42be-9ff6-6ae2031f05f2 1G Nov 02 12:36:21 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:21 devstack sudo[100969]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-df6bdf4c-1559-4246-b1fa-dd7b190ca930 tempest-GroupSnapshotsV319Test-952127983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.281s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:21 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-df6bdf4c-1559-4246-b1fa-dd7b190ca930 tempest-GroupSnapshotsV319Test-952127983 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:36:21 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-df6bdf4c-1559-4246-b1fa-dd7b190ca930 tempest-GroupSnapshotsV319Test-952127983 None] Delete group completed successfully. Nov 02 12:36:21 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2ed77431-c1f9-47ff-945e-a9c4f6041154 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c.99ca459c-a696-42be-9ff6-6ae2031f05f2 1G" returned: 0 in 0.509s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2ed77431-c1f9-47ff-945e-a9c4f6041154 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-780181da-3edd-4274-a881-0b104181876c -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c.99ca459c-a696-42be-9ff6-6ae2031f05f2 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:21 devstack sudo[100978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-780181da-3edd-4274-a881-0b104181876c -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c.99ca459c-a696-42be-9ff6-6ae2031f05f2 Nov 02 12:36:21 devstack sudo[100978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:22 devstack sudo[100978]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2ed77431-c1f9-47ff-945e-a9c4f6041154 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-780181da-3edd-4274-a881-0b104181876c -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c.99ca459c-a696-42be-9ff6-6ae2031f05f2" returned: 0 in 0.320s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:22 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-2ed77431-c1f9-47ff-945e-a9c4f6041154 tempest-CreateVolumesFromSnapshotTest-1676715326 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c.99ca459c-a696-42be-9ff6-6ae2031f05f2 is being set with open permissions: ugo+rw Nov 02 12:36:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2ed77431-c1f9-47ff-945e-a9c4f6041154 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c.99ca459c-a696-42be-9ff6-6ae2031f05f2 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:22 devstack sudo[100983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c.99ca459c-a696-42be-9ff6-6ae2031f05f2 Nov 02 12:36:22 devstack sudo[100983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:22 devstack sudo[100983]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2ed77431-c1f9-47ff-945e-a9c4f6041154 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c.99ca459c-a696-42be-9ff6-6ae2031f05f2" returned: 0 in 0.256s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2ed77431-c1f9-47ff-945e-a9c4f6041154 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:22 devstack sudo[100986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c.info Nov 02 12:36:22 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:22 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2ed77431-c1f9-47ff-945e-a9c4f6041154 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c.info" returned: 0 in 0.253s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:22 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-2ed77431-c1f9-47ff-945e-a9c4f6041154 tempest-CreateVolumesFromSnapshotTest-1676715326 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c.info is being set with open permissions: ugo+rw Nov 02 12:36:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2ed77431-c1f9-47ff-945e-a9c4f6041154 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:22 devstack sudo[100989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c.info Nov 02 12:36:22 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:22 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2ed77431-c1f9-47ff-945e-a9c4f6041154 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c.info" returned: 0 in 0.301s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2ed77431-c1f9-47ff-945e-a9c4f6041154 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.158s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:23 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-2ed77431-c1f9-47ff-945e-a9c4f6041154 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Create snapshot completed successfully Nov 02 12:36:24 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-add94f2e-7b54-42ba-aa03-c5d87380d603 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:36:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-add94f2e-7b54-42ba-aa03-c5d87380d603 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Flow 'volume_create_manager' (fe7e24d6-27d5-45e7-9ddc-ce99dfcb10bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-add94f2e-7b54-42ba-aa03-c5d87380d603 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b44c6a4-370f-4317-96d8-90f821291ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-add94f2e-7b54-42ba-aa03-c5d87380d603 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b44c6a4-370f-4317-96d8-90f821291ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-832215795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d5ab965-32ed-41db-8f8d-81d89388666a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='376904a861894f2b80453b430f1f050e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:25Z,use_quota=True,user_id='aa2d8f8e28db4c56b73d792bc590b981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-add94f2e-7b54-42ba-aa03-c5d87380d603 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c3c7f92-a00c-4407-a488-845ed0386cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-add94f2e-7b54-42ba-aa03-c5d87380d603 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c3c7f92-a00c-4407-a488-845ed0386cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-add94f2e-7b54-42ba-aa03-c5d87380d603 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b95d5e22-27a2-40c2-beea-7f9cdebcce26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-add94f2e-7b54-42ba-aa03-c5d87380d603 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b95d5e22-27a2-40c2-beea-7f9cdebcce26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d5ab965-32ed-41db-8f8d-81d89388666a', 'volume_name': 'volume-5d5ab965-32ed-41db-8f8d-81d89388666a', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-add94f2e-7b54-42ba-aa03-c5d87380d603 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c062485f-2bc2-4ccf-bb37-8d87caf5f0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-add94f2e-7b54-42ba-aa03-c5d87380d603 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c062485f-2bc2-4ccf-bb37-8d87caf5f0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-add94f2e-7b54-42ba-aa03-c5d87380d603 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b10a86-8eee-4647-b381-2e0b3d72b33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:24 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-add94f2e-7b54-42ba-aa03-c5d87380d603 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Volume 5d5ab965-32ed-41db-8f8d-81d89388666a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d5ab965-32ed-41db-8f8d-81d89388666a', 'volume_size': 1} Nov 02 12:36:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-add94f2e-7b54-42ba-aa03-c5d87380d603 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-add94f2e-7b54-42ba-aa03-c5d87380d603 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:24 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-add94f2e-7b54-42ba-aa03-c5d87380d603 tempest-CreateVolumesFromSnapshotTest-1676715326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-832215795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d5ab965-32ed-41db-8f8d-81d89388666a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='376904a861894f2b80453b430f1f050e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:25Z,use_quota=True,user_id='aa2d8f8e28db4c56b73d792bc590b981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:36:24 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-add94f2e-7b54-42ba-aa03-c5d87380d603 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Creating volume 5d5ab965-32ed-41db-8f8d-81d89388666a {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:36:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-add94f2e-7b54-42ba-aa03-c5d87380d603 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-add94f2e-7b54-42ba-aa03-c5d87380d603 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:24 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-add94f2e-7b54-42ba-aa03-c5d87380d603 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:24 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-add94f2e-7b54-42ba-aa03-c5d87380d603 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-add94f2e-7b54-42ba-aa03-c5d87380d603 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:24 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-add94f2e-7b54-42ba-aa03-c5d87380d603 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:36:24 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-add94f2e-7b54-42ba-aa03-c5d87380d603 tempest-CreateVolumesFromSnapshotTest-1676715326 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:36:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-add94f2e-7b54-42ba-aa03-c5d87380d603 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5d5ab965-32ed-41db-8f8d-81d89388666a 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:24 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5d5ab965-32ed-41db-8f8d-81d89388666a 1073741824 Nov 02 12:36:24 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:25 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-0905441e-0ba4-421a-b06d-4196b3653723 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:36:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0905441e-0ba4-421a-b06d-4196b3653723 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Flow 'volume_create_manager' (9a5e8149-2bd0-4a7e-bd89-2b90b8d6e628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0905441e-0ba4-421a-b06d-4196b3653723 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ae15d89-45e8-4577-b32e-2927f5d2eb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0905441e-0ba4-421a-b06d-4196b3653723 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ae15d89-45e8-4577-b32e-2927f5d2eb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1912725876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91286485-a448-466e-b0ec-cb1aa5457019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='376904a861894f2b80453b430f1f050e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:25Z,use_quota=True,user_id='aa2d8f8e28db4c56b73d792bc590b981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0905441e-0ba4-421a-b06d-4196b3653723 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58b8bd05-03c1-444d-87f9-3082394380cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0905441e-0ba4-421a-b06d-4196b3653723 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58b8bd05-03c1-444d-87f9-3082394380cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0905441e-0ba4-421a-b06d-4196b3653723 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79fabc2f-3d86-44bd-9215-b39083556458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0905441e-0ba4-421a-b06d-4196b3653723 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79fabc2f-3d86-44bd-9215-b39083556458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91286485-a448-466e-b0ec-cb1aa5457019', 'volume_name': 'volume-91286485-a448-466e-b0ec-cb1aa5457019', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0905441e-0ba4-421a-b06d-4196b3653723 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84e01666-8c3e-4a14-8ffc-44f6a24853f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0905441e-0ba4-421a-b06d-4196b3653723 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84e01666-8c3e-4a14-8ffc-44f6a24853f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0905441e-0ba4-421a-b06d-4196b3653723 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7432fd0d-3ed1-49fe-9a01-28781d2e9ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:25 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-0905441e-0ba4-421a-b06d-4196b3653723 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Volume 91286485-a448-466e-b0ec-cb1aa5457019: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91286485-a448-466e-b0ec-cb1aa5457019', 'volume_size': 1} Nov 02 12:36:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0905441e-0ba4-421a-b06d-4196b3653723 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:25 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-add94f2e-7b54-42ba-aa03-c5d87380d603 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5d5ab965-32ed-41db-8f8d-81d89388666a 1073741824" returned: 0 in 0.583s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-add94f2e-7b54-42ba-aa03-c5d87380d603 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5d5ab965-32ed-41db-8f8d-81d89388666a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:25 devstack sudo[101022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5d5ab965-32ed-41db-8f8d-81d89388666a Nov 02 12:36:25 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:25 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-add94f2e-7b54-42ba-aa03-c5d87380d603 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5d5ab965-32ed-41db-8f8d-81d89388666a" returned: 0 in 0.317s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:25 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-add94f2e-7b54-42ba-aa03-c5d87380d603 tempest-CreateVolumesFromSnapshotTest-1676715326 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:36:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-add94f2e-7b54-42ba-aa03-c5d87380d603 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0905441e-0ba4-421a-b06d-4196b3653723 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.416s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:25 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0905441e-0ba4-421a-b06d-4196b3653723 tempest-CreateVolumesFromSnapshotTest-1676715326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1912725876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91286485-a448-466e-b0ec-cb1aa5457019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='376904a861894f2b80453b430f1f050e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:25Z,use_quota=True,user_id='aa2d8f8e28db4c56b73d792bc590b981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:36:25 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-0905441e-0ba4-421a-b06d-4196b3653723 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Creating volume 91286485-a448-466e-b0ec-cb1aa5457019 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:36:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0905441e-0ba4-421a-b06d-4196b3653723 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0905441e-0ba4-421a-b06d-4196b3653723 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:25 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0905441e-0ba4-421a-b06d-4196b3653723 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:25 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0905441e-0ba4-421a-b06d-4196b3653723 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0905441e-0ba4-421a-b06d-4196b3653723 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:25 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0905441e-0ba4-421a-b06d-4196b3653723 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:36:25 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-0905441e-0ba4-421a-b06d-4196b3653723 tempest-CreateVolumesFromSnapshotTest-1676715326 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:36:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0905441e-0ba4-421a-b06d-4196b3653723 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-91286485-a448-466e-b0ec-cb1aa5457019 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-add94f2e-7b54-42ba-aa03-c5d87380d603 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b10a86-8eee-4647-b381-2e0b3d72b33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d5ab965-32ed-41db-8f8d-81d89388666a', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:25 devstack sudo[101028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-91286485-a448-466e-b0ec-cb1aa5457019 1073741824 Nov 02 12:36:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-add94f2e-7b54-42ba-aa03-c5d87380d603 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b276fa49-6f1c-4d51-98d3-cec9e1f70b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:25 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:25 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-add94f2e-7b54-42ba-aa03-c5d87380d603 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Volume volume-5d5ab965-32ed-41db-8f8d-81d89388666a (5d5ab965-32ed-41db-8f8d-81d89388666a): created successfully Nov 02 12:36:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-add94f2e-7b54-42ba-aa03-c5d87380d603 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b276fa49-6f1c-4d51-98d3-cec9e1f70b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-add94f2e-7b54-42ba-aa03-c5d87380d603 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Flow 'volume_create_manager' (fe7e24d6-27d5-45e7-9ddc-ce99dfcb10bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:25 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-add94f2e-7b54-42ba-aa03-c5d87380d603 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Created volume successfully. Nov 02 12:36:25 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-08d6fea0-63ed-4221-a8fc-7babf28a79d2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:36:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-08d6fea0-63ed-4221-a8fc-7babf28a79d2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Flow 'volume_create_manager' (df3740b4-68ef-4255-aa81-8102ce4692a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-08d6fea0-63ed-4221-a8fc-7babf28a79d2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f38e7989-ec3a-4932-8820-65c98a0e7ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-08d6fea0-63ed-4221-a8fc-7babf28a79d2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f38e7989-ec3a-4932-8820-65c98a0e7ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1465870771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef7e268-db33-4d18-9b6c-bb25a6717c31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='376904a861894f2b80453b430f1f050e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:26Z,use_quota=True,user_id='aa2d8f8e28db4c56b73d792bc590b981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-08d6fea0-63ed-4221-a8fc-7babf28a79d2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ea2e4ac-f1ac-4d47-b2bc-ae24f4ab57e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-08d6fea0-63ed-4221-a8fc-7babf28a79d2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ea2e4ac-f1ac-4d47-b2bc-ae24f4ab57e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-08d6fea0-63ed-4221-a8fc-7babf28a79d2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45755310-1653-4749-8630-9846cc0b0264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-08d6fea0-63ed-4221-a8fc-7babf28a79d2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45755310-1653-4749-8630-9846cc0b0264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ef7e268-db33-4d18-9b6c-bb25a6717c31', 'volume_name': 'volume-0ef7e268-db33-4d18-9b6c-bb25a6717c31', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-08d6fea0-63ed-4221-a8fc-7babf28a79d2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec0fe533-831d-46a3-bf8a-5ce4c4af82da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-08d6fea0-63ed-4221-a8fc-7babf28a79d2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec0fe533-831d-46a3-bf8a-5ce4c4af82da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-08d6fea0-63ed-4221-a8fc-7babf28a79d2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d961f320-fb38-4d2e-ab7a-1cffde445aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:26 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-08d6fea0-63ed-4221-a8fc-7babf28a79d2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Volume 0ef7e268-db33-4d18-9b6c-bb25a6717c31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ef7e268-db33-4d18-9b6c-bb25a6717c31', 'volume_size': 1} Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-08d6fea0-63ed-4221-a8fc-7babf28a79d2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:26 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0905441e-0ba4-421a-b06d-4196b3653723 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-91286485-a448-466e-b0ec-cb1aa5457019 1073741824" returned: 0 in 0.714s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0905441e-0ba4-421a-b06d-4196b3653723 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-91286485-a448-466e-b0ec-cb1aa5457019 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:26 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-91286485-a448-466e-b0ec-cb1aa5457019 Nov 02 12:36:26 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6bcd684-e7df-4df0-ba03-e6b3fd7ce6a1 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d6bcd684-e7df-4df0-ba03-e6b3fd7ce6a1 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Flow 'volume_create_manager' (f6464173-9418-4c61-996c-307f4515845a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d6bcd684-e7df-4df0-ba03-e6b3fd7ce6a1 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1bd2804-c528-4504-8933-14dc553baec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d6bcd684-e7df-4df0-ba03-e6b3fd7ce6a1 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1bd2804-c528-4504-8933-14dc553baec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1219803204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6de9b5f3-77ea-42e0-99dc-dce2827d0ddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='376904a861894f2b80453b430f1f050e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:26Z,use_quota=True,user_id='aa2d8f8e28db4c56b73d792bc590b981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d6bcd684-e7df-4df0-ba03-e6b3fd7ce6a1 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3046e150-5a64-40be-9040-30b18feac04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d6bcd684-e7df-4df0-ba03-e6b3fd7ce6a1 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3046e150-5a64-40be-9040-30b18feac04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d6bcd684-e7df-4df0-ba03-e6b3fd7ce6a1 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461dbab3-7c69-4911-a840-d7c23741c443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d6bcd684-e7df-4df0-ba03-e6b3fd7ce6a1 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461dbab3-7c69-4911-a840-d7c23741c443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6de9b5f3-77ea-42e0-99dc-dce2827d0ddc', 'volume_name': 'volume-6de9b5f3-77ea-42e0-99dc-dce2827d0ddc', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d6bcd684-e7df-4df0-ba03-e6b3fd7ce6a1 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624ac41f-c6d5-495f-939c-e96d8cec83bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d6bcd684-e7df-4df0-ba03-e6b3fd7ce6a1 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624ac41f-c6d5-495f-939c-e96d8cec83bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d6bcd684-e7df-4df0-ba03-e6b3fd7ce6a1 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17c6ede3-0779-4774-a81d-531ff3eb33f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:26 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-d6bcd684-e7df-4df0-ba03-e6b3fd7ce6a1 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Volume 6de9b5f3-77ea-42e0-99dc-dce2827d0ddc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6de9b5f3-77ea-42e0-99dc-dce2827d0ddc', 'volume_size': 1} Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d6bcd684-e7df-4df0-ba03-e6b3fd7ce6a1 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:26 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0905441e-0ba4-421a-b06d-4196b3653723 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-91286485-a448-466e-b0ec-cb1aa5457019" returned: 0 in 0.406s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0905441e-0ba4-421a-b06d-4196b3653723 tempest-CreateVolumesFromSnapshotTest-1676715326 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0905441e-0ba4-421a-b06d-4196b3653723 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-08d6fea0-63ed-4221-a8fc-7babf28a79d2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.759s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-08d6fea0-63ed-4221-a8fc-7babf28a79d2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1465870771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef7e268-db33-4d18-9b6c-bb25a6717c31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='376904a861894f2b80453b430f1f050e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:26Z,use_quota=True,user_id='aa2d8f8e28db4c56b73d792bc590b981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-08d6fea0-63ed-4221-a8fc-7babf28a79d2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Creating volume 0ef7e268-db33-4d18-9b6c-bb25a6717c31 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-08d6fea0-63ed-4221-a8fc-7babf28a79d2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-08d6fea0-63ed-4221-a8fc-7babf28a79d2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-08d6fea0-63ed-4221-a8fc-7babf28a79d2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-08d6fea0-63ed-4221-a8fc-7babf28a79d2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-08d6fea0-63ed-4221-a8fc-7babf28a79d2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-08d6fea0-63ed-4221-a8fc-7babf28a79d2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:36:26 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-08d6fea0-63ed-4221-a8fc-7babf28a79d2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-08d6fea0-63ed-4221-a8fc-7babf28a79d2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ef7e268-db33-4d18-9b6c-bb25a6717c31 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:26 devstack sudo[101057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ef7e268-db33-4d18-9b6c-bb25a6717c31 1073741824 Nov 02 12:36:26 devstack sudo[101057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0905441e-0ba4-421a-b06d-4196b3653723 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7432fd0d-3ed1-49fe-9a01-28781d2e9ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91286485-a448-466e-b0ec-cb1aa5457019', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0905441e-0ba4-421a-b06d-4196b3653723 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a30290-359a-4fa1-8edf-952b3314718c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:27 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-0905441e-0ba4-421a-b06d-4196b3653723 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Volume volume-91286485-a448-466e-b0ec-cb1aa5457019 (91286485-a448-466e-b0ec-cb1aa5457019): created successfully Nov 02 12:36:27 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0905441e-0ba4-421a-b06d-4196b3653723 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a30290-359a-4fa1-8edf-952b3314718c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:27 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0905441e-0ba4-421a-b06d-4196b3653723 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Flow 'volume_create_manager' (9a5e8149-2bd0-4a7e-bd89-2b90b8d6e628) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:27 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-0905441e-0ba4-421a-b06d-4196b3653723 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Created volume successfully. Nov 02 12:36:27 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b189d0e-0c73-41ef-835c-5f7d2838c217 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:36:27 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3b189d0e-0c73-41ef-835c-5f7d2838c217 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Flow 'volume_create_manager' (86d9c5eb-3de3-4966-83f4-76ebbc995beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:27 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3b189d0e-0c73-41ef-835c-5f7d2838c217 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d862882-ee45-4802-bf13-49a9028ffa36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:27 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3b189d0e-0c73-41ef-835c-5f7d2838c217 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d862882-ee45-4802-bf13-49a9028ffa36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-363653479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1a7e6ef-ae3e-4768-8a61-f530db5401d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='376904a861894f2b80453b430f1f050e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:27Z,use_quota=True,user_id='aa2d8f8e28db4c56b73d792bc590b981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:27 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3b189d0e-0c73-41ef-835c-5f7d2838c217 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e6f0c3e-380d-4759-b785-25cce6e4ee86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:27 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3b189d0e-0c73-41ef-835c-5f7d2838c217 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e6f0c3e-380d-4759-b785-25cce6e4ee86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:27 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3b189d0e-0c73-41ef-835c-5f7d2838c217 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0daaa81-cb97-4a7f-886f-16b2778117be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:27 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3b189d0e-0c73-41ef-835c-5f7d2838c217 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0daaa81-cb97-4a7f-886f-16b2778117be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1a7e6ef-ae3e-4768-8a61-f530db5401d7', 'volume_name': 'volume-e1a7e6ef-ae3e-4768-8a61-f530db5401d7', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:27 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3b189d0e-0c73-41ef-835c-5f7d2838c217 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93904d61-04b1-4145-81eb-02e0fb50187a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:27 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3b189d0e-0c73-41ef-835c-5f7d2838c217 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93904d61-04b1-4145-81eb-02e0fb50187a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:27 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3b189d0e-0c73-41ef-835c-5f7d2838c217 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e9b682-0d42-4444-a517-e1b220ec9665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:27 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-3b189d0e-0c73-41ef-835c-5f7d2838c217 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Volume e1a7e6ef-ae3e-4768-8a61-f530db5401d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1a7e6ef-ae3e-4768-8a61-f530db5401d7', 'volume_size': 1} Nov 02 12:36:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3b189d0e-0c73-41ef-835c-5f7d2838c217 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:27 devstack sudo[101057]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-08d6fea0-63ed-4221-a8fc-7babf28a79d2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ef7e268-db33-4d18-9b6c-bb25a6717c31 1073741824" returned: 0 in 0.738s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-08d6fea0-63ed-4221-a8fc-7babf28a79d2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ef7e268-db33-4d18-9b6c-bb25a6717c31 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:27 devstack sudo[101069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ef7e268-db33-4d18-9b6c-bb25a6717c31 Nov 02 12:36:27 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:27 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-08d6fea0-63ed-4221-a8fc-7babf28a79d2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ef7e268-db33-4d18-9b6c-bb25a6717c31" returned: 0 in 0.279s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:27 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-08d6fea0-63ed-4221-a8fc-7babf28a79d2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:36:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-08d6fea0-63ed-4221-a8fc-7babf28a79d2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d6bcd684-e7df-4df0-ba03-e6b3fd7ce6a1 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.179s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:27 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d6bcd684-e7df-4df0-ba03-e6b3fd7ce6a1 tempest-CreateVolumesFromSnapshotTest-1676715326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1219803204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6de9b5f3-77ea-42e0-99dc-dce2827d0ddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='376904a861894f2b80453b430f1f050e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:26Z,use_quota=True,user_id='aa2d8f8e28db4c56b73d792bc590b981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:36:27 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-d6bcd684-e7df-4df0-ba03-e6b3fd7ce6a1 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Creating volume 6de9b5f3-77ea-42e0-99dc-dce2827d0ddc {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:36:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d6bcd684-e7df-4df0-ba03-e6b3fd7ce6a1 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d6bcd684-e7df-4df0-ba03-e6b3fd7ce6a1 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:27 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d6bcd684-e7df-4df0-ba03-e6b3fd7ce6a1 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:27 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d6bcd684-e7df-4df0-ba03-e6b3fd7ce6a1 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d6bcd684-e7df-4df0-ba03-e6b3fd7ce6a1 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:27 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d6bcd684-e7df-4df0-ba03-e6b3fd7ce6a1 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:36:27 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-d6bcd684-e7df-4df0-ba03-e6b3fd7ce6a1 tempest-CreateVolumesFromSnapshotTest-1676715326 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:36:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d6bcd684-e7df-4df0-ba03-e6b3fd7ce6a1 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6de9b5f3-77ea-42e0-99dc-dce2827d0ddc 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:28 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-08d6fea0-63ed-4221-a8fc-7babf28a79d2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d961f320-fb38-4d2e-ab7a-1cffde445aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ef7e268-db33-4d18-9b6c-bb25a6717c31', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:28 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-08d6fea0-63ed-4221-a8fc-7babf28a79d2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b199cc5-78a2-4995-a7dc-ed5e7ea444d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:28 devstack sudo[101072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6de9b5f3-77ea-42e0-99dc-dce2827d0ddc 1073741824 Nov 02 12:36:28 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:28 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-08d6fea0-63ed-4221-a8fc-7babf28a79d2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Volume volume-0ef7e268-db33-4d18-9b6c-bb25a6717c31 (0ef7e268-db33-4d18-9b6c-bb25a6717c31): created successfully Nov 02 12:36:28 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-08d6fea0-63ed-4221-a8fc-7babf28a79d2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b199cc5-78a2-4995-a7dc-ed5e7ea444d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:28 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-08d6fea0-63ed-4221-a8fc-7babf28a79d2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Flow 'volume_create_manager' (df3740b4-68ef-4255-aa81-8102ce4692a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:28 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-08d6fea0-63ed-4221-a8fc-7babf28a79d2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Created volume successfully. Nov 02 12:36:28 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d6bcd684-e7df-4df0-ba03-e6b3fd7ce6a1 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6de9b5f3-77ea-42e0-99dc-dce2827d0ddc 1073741824" returned: 0 in 0.730s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d6bcd684-e7df-4df0-ba03-e6b3fd7ce6a1 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6de9b5f3-77ea-42e0-99dc-dce2827d0ddc {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:28 devstack sudo[101080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6de9b5f3-77ea-42e0-99dc-dce2827d0ddc Nov 02 12:36:28 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:29 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d6bcd684-e7df-4df0-ba03-e6b3fd7ce6a1 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6de9b5f3-77ea-42e0-99dc-dce2827d0ddc" returned: 0 in 0.304s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:29 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d6bcd684-e7df-4df0-ba03-e6b3fd7ce6a1 tempest-CreateVolumesFromSnapshotTest-1676715326 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:36:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d6bcd684-e7df-4df0-ba03-e6b3fd7ce6a1 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3b189d0e-0c73-41ef-835c-5f7d2838c217 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.736s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:29 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3b189d0e-0c73-41ef-835c-5f7d2838c217 tempest-CreateVolumesFromSnapshotTest-1676715326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-363653479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1a7e6ef-ae3e-4768-8a61-f530db5401d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='376904a861894f2b80453b430f1f050e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:27Z,use_quota=True,user_id='aa2d8f8e28db4c56b73d792bc590b981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:36:29 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-3b189d0e-0c73-41ef-835c-5f7d2838c217 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Creating volume e1a7e6ef-ae3e-4768-8a61-f530db5401d7 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:36:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3b189d0e-0c73-41ef-835c-5f7d2838c217 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3b189d0e-0c73-41ef-835c-5f7d2838c217 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:29 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3b189d0e-0c73-41ef-835c-5f7d2838c217 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:29 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3b189d0e-0c73-41ef-835c-5f7d2838c217 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3b189d0e-0c73-41ef-835c-5f7d2838c217 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:29 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3b189d0e-0c73-41ef-835c-5f7d2838c217 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:36:29 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-3b189d0e-0c73-41ef-835c-5f7d2838c217 tempest-CreateVolumesFromSnapshotTest-1676715326 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:36:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3b189d0e-0c73-41ef-835c-5f7d2838c217 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e1a7e6ef-ae3e-4768-8a61-f530db5401d7 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d6bcd684-e7df-4df0-ba03-e6b3fd7ce6a1 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17c6ede3-0779-4774-a81d-531ff3eb33f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6de9b5f3-77ea-42e0-99dc-dce2827d0ddc', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:29 devstack sudo[101083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e1a7e6ef-ae3e-4768-8a61-f530db5401d7 1073741824 Nov 02 12:36:29 devstack sudo[101083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d6bcd684-e7df-4df0-ba03-e6b3fd7ce6a1 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5a5c2ca-4ffa-4587-92d4-5c2c50242a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:29 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-d6bcd684-e7df-4df0-ba03-e6b3fd7ce6a1 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Volume volume-6de9b5f3-77ea-42e0-99dc-dce2827d0ddc (6de9b5f3-77ea-42e0-99dc-dce2827d0ddc): created successfully Nov 02 12:36:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d6bcd684-e7df-4df0-ba03-e6b3fd7ce6a1 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5a5c2ca-4ffa-4587-92d4-5c2c50242a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d6bcd684-e7df-4df0-ba03-e6b3fd7ce6a1 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Flow 'volume_create_manager' (f6464173-9418-4c61-996c-307f4515845a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:29 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-d6bcd684-e7df-4df0-ba03-e6b3fd7ce6a1 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Created volume successfully. Nov 02 12:36:29 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-934ee391-2e13-4f46-bfc2-f014dabb60a1 tempest-VolumeTypesAccessTest-1449960442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:36:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-934ee391-2e13-4f46-bfc2-f014dabb60a1 tempest-VolumeTypesAccessTest-1449960442 None] Flow 'volume_create_manager' (9fc151d5-1b1b-4de6-8fe6-b425b7afc7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-934ee391-2e13-4f46-bfc2-f014dabb60a1 tempest-VolumeTypesAccessTest-1449960442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb3f7a54-3989-4304-861e-d0996a72a547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-934ee391-2e13-4f46-bfc2-f014dabb60a1 tempest-VolumeTypesAccessTest-1449960442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb3f7a54-3989-4304-861e-d0996a72a547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-355115745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63118445-f3f2-49e5-a4f2-114b6113d9ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c344b176b80a4fad9a1aab206d7a7f09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:30Z,use_quota=True,user_id='0d4454802b2648189d17c428687ce333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(032f6e38-e6ea-4fcf-b166-1cd075674301),volume_type_id=032f6e38-e6ea-4fcf-b166-1cd075674301)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-934ee391-2e13-4f46-bfc2-f014dabb60a1 tempest-VolumeTypesAccessTest-1449960442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6360bfa4-ea4e-4f93-b0c1-3f7e65c148af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-934ee391-2e13-4f46-bfc2-f014dabb60a1 tempest-VolumeTypesAccessTest-1449960442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6360bfa4-ea4e-4f93-b0c1-3f7e65c148af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-934ee391-2e13-4f46-bfc2-f014dabb60a1 tempest-VolumeTypesAccessTest-1449960442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d721b84a-a761-4c32-84d7-ca6d9be1586f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-934ee391-2e13-4f46-bfc2-f014dabb60a1 tempest-VolumeTypesAccessTest-1449960442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d721b84a-a761-4c32-84d7-ca6d9be1586f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63118445-f3f2-49e5-a4f2-114b6113d9ca', 'volume_name': 'volume-63118445-f3f2-49e5-a4f2-114b6113d9ca', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-934ee391-2e13-4f46-bfc2-f014dabb60a1 tempest-VolumeTypesAccessTest-1449960442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44756412-7430-4538-bf03-fcadb1d27218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-934ee391-2e13-4f46-bfc2-f014dabb60a1 tempest-VolumeTypesAccessTest-1449960442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44756412-7430-4538-bf03-fcadb1d27218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-934ee391-2e13-4f46-bfc2-f014dabb60a1 tempest-VolumeTypesAccessTest-1449960442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2f5b7e-f64a-4436-9e66-bdfeb6ccc01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:29 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-934ee391-2e13-4f46-bfc2-f014dabb60a1 tempest-VolumeTypesAccessTest-1449960442 None] Volume 63118445-f3f2-49e5-a4f2-114b6113d9ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63118445-f3f2-49e5-a4f2-114b6113d9ca', 'volume_size': 1} Nov 02 12:36:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-934ee391-2e13-4f46-bfc2-f014dabb60a1 tempest-VolumeTypesAccessTest-1449960442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:29 devstack sudo[101083]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3b189d0e-0c73-41ef-835c-5f7d2838c217 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e1a7e6ef-ae3e-4768-8a61-f530db5401d7 1073741824" returned: 0 in 0.661s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3b189d0e-0c73-41ef-835c-5f7d2838c217 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e1a7e6ef-ae3e-4768-8a61-f530db5401d7 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:29 devstack sudo[101089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e1a7e6ef-ae3e-4768-8a61-f530db5401d7 Nov 02 12:36:29 devstack sudo[101089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:30 devstack sudo[101089]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3b189d0e-0c73-41ef-835c-5f7d2838c217 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e1a7e6ef-ae3e-4768-8a61-f530db5401d7" returned: 0 in 0.257s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3b189d0e-0c73-41ef-835c-5f7d2838c217 tempest-CreateVolumesFromSnapshotTest-1676715326 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:36:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3b189d0e-0c73-41ef-835c-5f7d2838c217 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-934ee391-2e13-4f46-bfc2-f014dabb60a1 tempest-VolumeTypesAccessTest-1449960442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.314s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-934ee391-2e13-4f46-bfc2-f014dabb60a1 tempest-VolumeTypesAccessTest-1449960442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-355115745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63118445-f3f2-49e5-a4f2-114b6113d9ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c344b176b80a4fad9a1aab206d7a7f09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:30Z,use_quota=True,user_id='0d4454802b2648189d17c428687ce333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(032f6e38-e6ea-4fcf-b166-1cd075674301),volume_type_id=032f6e38-e6ea-4fcf-b166-1cd075674301)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:36:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-934ee391-2e13-4f46-bfc2-f014dabb60a1 tempest-VolumeTypesAccessTest-1449960442 None] Creating volume 63118445-f3f2-49e5-a4f2-114b6113d9ca {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:36:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-934ee391-2e13-4f46-bfc2-f014dabb60a1 tempest-VolumeTypesAccessTest-1449960442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-934ee391-2e13-4f46-bfc2-f014dabb60a1 tempest-VolumeTypesAccessTest-1449960442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-934ee391-2e13-4f46-bfc2-f014dabb60a1 tempest-VolumeTypesAccessTest-1449960442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-934ee391-2e13-4f46-bfc2-f014dabb60a1 tempest-VolumeTypesAccessTest-1449960442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-934ee391-2e13-4f46-bfc2-f014dabb60a1 tempest-VolumeTypesAccessTest-1449960442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-934ee391-2e13-4f46-bfc2-f014dabb60a1 tempest-VolumeTypesAccessTest-1449960442 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:36:30 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-934ee391-2e13-4f46-bfc2-f014dabb60a1 tempest-VolumeTypesAccessTest-1449960442 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:36:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-934ee391-2e13-4f46-bfc2-f014dabb60a1 tempest-VolumeTypesAccessTest-1449960442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-63118445-f3f2-49e5-a4f2-114b6113d9ca 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3b189d0e-0c73-41ef-835c-5f7d2838c217 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e9b682-0d42-4444-a517-e1b220ec9665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1a7e6ef-ae3e-4768-8a61-f530db5401d7', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:30 devstack sudo[101092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-63118445-f3f2-49e5-a4f2-114b6113d9ca 1073741824 Nov 02 12:36:30 devstack sudo[101092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3b189d0e-0c73-41ef-835c-5f7d2838c217 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2dd083c-b9ce-4c01-9bd0-e48237b8510d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:30 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-3b189d0e-0c73-41ef-835c-5f7d2838c217 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Volume volume-e1a7e6ef-ae3e-4768-8a61-f530db5401d7 (e1a7e6ef-ae3e-4768-8a61-f530db5401d7): created successfully Nov 02 12:36:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3b189d0e-0c73-41ef-835c-5f7d2838c217 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2dd083c-b9ce-4c01-9bd0-e48237b8510d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3b189d0e-0c73-41ef-835c-5f7d2838c217 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Flow 'volume_create_manager' (86d9c5eb-3de3-4966-83f4-76ebbc995beb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:30 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-3b189d0e-0c73-41ef-835c-5f7d2838c217 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Created volume successfully. Nov 02 12:36:30 devstack sudo[101092]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-934ee391-2e13-4f46-bfc2-f014dabb60a1 tempest-VolumeTypesAccessTest-1449960442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-63118445-f3f2-49e5-a4f2-114b6113d9ca 1073741824" returned: 0 in 0.473s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-934ee391-2e13-4f46-bfc2-f014dabb60a1 tempest-VolumeTypesAccessTest-1449960442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-63118445-f3f2-49e5-a4f2-114b6113d9ca {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:30 devstack sudo[101098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-63118445-f3f2-49e5-a4f2-114b6113d9ca Nov 02 12:36:30 devstack sudo[101098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:30 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4636789a-9748-4a1e-9eee-4b29ee0aa098 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Acquiring lock "cinder-e1a7e6ef-ae3e-4768-8a61-f530db5401d7-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:30 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4636789a-9748-4a1e-9eee-4b29ee0aa098 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "cinder-e1a7e6ef-ae3e-4768-8a61-f530db5401d7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:30 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4636789a-9748-4a1e-9eee-4b29ee0aa098 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Acquiring lock "cinder-quobyte-e1a7e6ef-ae3e-4768-8a61-f530db5401d7" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:30 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4636789a-9748-4a1e-9eee-4b29ee0aa098 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "cinder-quobyte-e1a7e6ef-ae3e-4768-8a61-f530db5401d7" acquired by "delete_volume" :: waited 0.016s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:30 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83f2acd-f952-4e90-a03e-e67f8e55ad4b]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:36:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4636789a-9748-4a1e-9eee-4b29ee0aa098 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e1a7e6ef-ae3e-4768-8a61-f530db5401d7 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:30 devstack sudo[101098]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-934ee391-2e13-4f46-bfc2-f014dabb60a1 tempest-VolumeTypesAccessTest-1449960442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-63118445-f3f2-49e5-a4f2-114b6113d9ca" returned: 0 in 0.327s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-934ee391-2e13-4f46-bfc2-f014dabb60a1 tempest-VolumeTypesAccessTest-1449960442 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:36:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-934ee391-2e13-4f46-bfc2-f014dabb60a1 tempest-VolumeTypesAccessTest-1449960442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-934ee391-2e13-4f46-bfc2-f014dabb60a1 tempest-VolumeTypesAccessTest-1449960442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2f5b7e-f64a-4436-9e66-bdfeb6ccc01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63118445-f3f2-49e5-a4f2-114b6113d9ca', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-934ee391-2e13-4f46-bfc2-f014dabb60a1 tempest-VolumeTypesAccessTest-1449960442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c924b468-804c-4cd0-99e8-8b5c2e12cd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:30 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-934ee391-2e13-4f46-bfc2-f014dabb60a1 tempest-VolumeTypesAccessTest-1449960442 None] Volume volume-63118445-f3f2-49e5-a4f2-114b6113d9ca (63118445-f3f2-49e5-a4f2-114b6113d9ca): created successfully Nov 02 12:36:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-934ee391-2e13-4f46-bfc2-f014dabb60a1 tempest-VolumeTypesAccessTest-1449960442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c924b468-804c-4cd0-99e8-8b5c2e12cd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-934ee391-2e13-4f46-bfc2-f014dabb60a1 tempest-VolumeTypesAccessTest-1449960442 None] Flow 'volume_create_manager' (9fc151d5-1b1b-4de6-8fe6-b425b7afc7c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:30 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-934ee391-2e13-4f46-bfc2-f014dabb60a1 tempest-VolumeTypesAccessTest-1449960442 None] Created volume successfully. Nov 02 12:36:30 devstack sudo[101101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e1a7e6ef-ae3e-4768-8a61-f530db5401d7 Nov 02 12:36:30 devstack sudo[101101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:31 devstack sudo[101101]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4636789a-9748-4a1e-9eee-4b29ee0aa098 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e1a7e6ef-ae3e-4768-8a61-f530db5401d7" returned: 0 in 0.422s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4636789a-9748-4a1e-9eee-4b29ee0aa098 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e1a7e6ef-ae3e-4768-8a61-f530db5401d7 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:31 devstack sudo[101107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e1a7e6ef-ae3e-4768-8a61-f530db5401d7 Nov 02 12:36:31 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:31 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4636789a-9748-4a1e-9eee-4b29ee0aa098 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e1a7e6ef-ae3e-4768-8a61-f530db5401d7" returned: 0 in 0.251s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:31 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4636789a-9748-4a1e-9eee-4b29ee0aa098 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "cinder-quobyte-e1a7e6ef-ae3e-4768-8a61-f530db5401d7" released by "delete_volume" :: held 0.733s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:31 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-4636789a-9748-4a1e-9eee-4b29ee0aa098 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Created reservations ['4e2b6392-5b34-4adb-9f2c-4687bf7f621e', 'f1705f46-f465-410f-84d7-cb52dab8c645', '06b107d6-e622-4593-afc6-477745f7bd28', '2ab3f3c1-4b9a-4ab0-97ce-795e955ba22f'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:36:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4636789a-9748-4a1e-9eee-4b29ee0aa098 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4636789a-9748-4a1e-9eee-4b29ee0aa098 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:31 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-4636789a-9748-4a1e-9eee-4b29ee0aa098 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:31 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-4636789a-9748-4a1e-9eee-4b29ee0aa098 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4636789a-9748-4a1e-9eee-4b29ee0aa098 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4636789a-9748-4a1e-9eee-4b29ee0aa098 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:31 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-42e98b81-fd5d-4e93-ba7b-db7749d41b25 tempest-VolumeTypesAccessTest-1449960442 None] Acquiring lock "cinder-63118445-f3f2-49e5-a4f2-114b6113d9ca-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:31 devstack sudo[101110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:36:31 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:31 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-42e98b81-fd5d-4e93-ba7b-db7749d41b25 tempest-VolumeTypesAccessTest-1449960442 None] Lock "cinder-63118445-f3f2-49e5-a4f2-114b6113d9ca-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:31 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-42e98b81-fd5d-4e93-ba7b-db7749d41b25 tempest-VolumeTypesAccessTest-1449960442 None] Acquiring lock "cinder-quobyte-63118445-f3f2-49e5-a4f2-114b6113d9ca" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:31 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-42e98b81-fd5d-4e93-ba7b-db7749d41b25 tempest-VolumeTypesAccessTest-1449960442 None] Lock "cinder-quobyte-63118445-f3f2-49e5-a4f2-114b6113d9ca" acquired by "delete_volume" :: waited 0.014s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:31 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5728997-bc31-425d-9425-4d99da6117b9]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:36:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-42e98b81-fd5d-4e93-ba7b-db7749d41b25 tempest-VolumeTypesAccessTest-1449960442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-63118445-f3f2-49e5-a4f2-114b6113d9ca {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:31 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-245036bf-c922-4530-9e95-0ea534b22632 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Acquiring lock "cinder-6de9b5f3-77ea-42e0-99dc-dce2827d0ddc-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:31 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-245036bf-c922-4530-9e95-0ea534b22632 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "cinder-6de9b5f3-77ea-42e0-99dc-dce2827d0ddc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-245036bf-c922-4530-9e95-0ea534b22632 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Acquiring lock "cinder-quobyte-6de9b5f3-77ea-42e0-99dc-dce2827d0ddc" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:32 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-245036bf-c922-4530-9e95-0ea534b22632 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "cinder-quobyte-6de9b5f3-77ea-42e0-99dc-dce2827d0ddc" acquired by "delete_volume" :: waited 0.023s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:32 devstack sudo[101112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-63118445-f3f2-49e5-a4f2-114b6113d9ca Nov 02 12:36:32 devstack sudo[101112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4636789a-9748-4a1e-9eee-4b29ee0aa098 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.346s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:32 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-4636789a-9748-4a1e-9eee-4b29ee0aa098 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:36:32 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-4636789a-9748-4a1e-9eee-4b29ee0aa098 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Deleted volume successfully. Nov 02 12:36:32 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[c656b4fa-8794-43e3-a408-f2befcf2c785]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:36:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-245036bf-c922-4530-9e95-0ea534b22632 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6de9b5f3-77ea-42e0-99dc-dce2827d0ddc {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4636789a-9748-4a1e-9eee-4b29ee0aa098 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "cinder-e1a7e6ef-ae3e-4768-8a61-f530db5401d7-delete_volume" released by "delete_volume" :: held 1.334s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:32 devstack sudo[101115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6de9b5f3-77ea-42e0-99dc-dce2827d0ddc Nov 02 12:36:32 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:32 devstack sudo[101112]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-42e98b81-fd5d-4e93-ba7b-db7749d41b25 tempest-VolumeTypesAccessTest-1449960442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-63118445-f3f2-49e5-a4f2-114b6113d9ca" returned: 0 in 0.454s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-42e98b81-fd5d-4e93-ba7b-db7749d41b25 tempest-VolumeTypesAccessTest-1449960442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-63118445-f3f2-49e5-a4f2-114b6113d9ca {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:32 devstack sudo[101120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-63118445-f3f2-49e5-a4f2-114b6113d9ca Nov 02 12:36:32 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:32 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-245036bf-c922-4530-9e95-0ea534b22632 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6de9b5f3-77ea-42e0-99dc-dce2827d0ddc" returned: 0 in 0.433s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-245036bf-c922-4530-9e95-0ea534b22632 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6de9b5f3-77ea-42e0-99dc-dce2827d0ddc {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:32 devstack sudo[101125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6de9b5f3-77ea-42e0-99dc-dce2827d0ddc Nov 02 12:36:32 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:32 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-42e98b81-fd5d-4e93-ba7b-db7749d41b25 tempest-VolumeTypesAccessTest-1449960442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-63118445-f3f2-49e5-a4f2-114b6113d9ca" returned: 0 in 0.296s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-42e98b81-fd5d-4e93-ba7b-db7749d41b25 tempest-VolumeTypesAccessTest-1449960442 None] Lock "cinder-quobyte-63118445-f3f2-49e5-a4f2-114b6113d9ca" released by "delete_volume" :: held 0.814s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:32 devstack cinder-volume[86515]: WARNING cinder.quota [None req-42e98b81-fd5d-4e93-ba7b-db7749d41b25 tempest-VolumeTypesAccessTest-1449960442 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2066974170 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2066974170, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:36:32 devstack cinder-volume[86515]: WARNING cinder.quota [None req-42e98b81-fd5d-4e93-ba7b-db7749d41b25 tempest-VolumeTypesAccessTest-1449960442 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2066974170 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2066974170, it is now deprecated. Please use the default quota class for default quota. Nov 02 12:36:32 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-42e98b81-fd5d-4e93-ba7b-db7749d41b25 tempest-VolumeTypesAccessTest-1449960442 None] Created reservations ['a15cd526-f643-4cb5-86c4-7697b595bb21', '43cd2403-c4a1-4504-858e-b5e76d1f4850', '1237a855-3d75-4c2d-a354-b19ca9385537', 'bfda79e0-0536-4549-9d2d-df5503d44272'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:36:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-42e98b81-fd5d-4e93-ba7b-db7749d41b25 tempest-VolumeTypesAccessTest-1449960442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-42e98b81-fd5d-4e93-ba7b-db7749d41b25 tempest-VolumeTypesAccessTest-1449960442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:32 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-42e98b81-fd5d-4e93-ba7b-db7749d41b25 tempest-VolumeTypesAccessTest-1449960442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:32 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-42e98b81-fd5d-4e93-ba7b-db7749d41b25 tempest-VolumeTypesAccessTest-1449960442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-42e98b81-fd5d-4e93-ba7b-db7749d41b25 tempest-VolumeTypesAccessTest-1449960442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-42e98b81-fd5d-4e93-ba7b-db7749d41b25 tempest-VolumeTypesAccessTest-1449960442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:32 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:36:32 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:32 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-245036bf-c922-4530-9e95-0ea534b22632 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6de9b5f3-77ea-42e0-99dc-dce2827d0ddc" returned: 0 in 0.301s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-245036bf-c922-4530-9e95-0ea534b22632 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "cinder-quobyte-6de9b5f3-77ea-42e0-99dc-dce2827d0ddc" released by "delete_volume" :: held 0.786s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:32 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-245036bf-c922-4530-9e95-0ea534b22632 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Created reservations ['ed6a5581-010e-420a-bdcb-5696393976e4', 'ae33dd89-1e32-4de9-9e40-e1365ef77df1', 'c41fd57c-fb27-4808-a6a4-6aea6dd7743c', 'aaba5aee-697e-4626-add5-35acc44eedaf'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:36:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-245036bf-c922-4530-9e95-0ea534b22632 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-245036bf-c922-4530-9e95-0ea534b22632 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:32 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-245036bf-c922-4530-9e95-0ea534b22632 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-245036bf-c922-4530-9e95-0ea534b22632 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-245036bf-c922-4530-9e95-0ea534b22632 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-245036bf-c922-4530-9e95-0ea534b22632 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:33 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-42e98b81-fd5d-4e93-ba7b-db7749d41b25 tempest-VolumeTypesAccessTest-1449960442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.335s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:33 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-42e98b81-fd5d-4e93-ba7b-db7749d41b25 tempest-VolumeTypesAccessTest-1449960442 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:36:33 devstack sudo[101132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:36:33 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-42e98b81-fd5d-4e93-ba7b-db7749d41b25 tempest-VolumeTypesAccessTest-1449960442 None] Deleted volume successfully. Nov 02 12:36:33 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-42e98b81-fd5d-4e93-ba7b-db7749d41b25 tempest-VolumeTypesAccessTest-1449960442 None] Lock "cinder-63118445-f3f2-49e5-a4f2-114b6113d9ca-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-2a497a47-0925-4daa-b14e-83d02d452ed2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Acquiring lock "cinder-0ef7e268-db33-4d18-9b6c-bb25a6717c31-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-2a497a47-0925-4daa-b14e-83d02d452ed2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "cinder-0ef7e268-db33-4d18-9b6c-bb25a6717c31-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-2a497a47-0925-4daa-b14e-83d02d452ed2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Acquiring lock "cinder-quobyte-0ef7e268-db33-4d18-9b6c-bb25a6717c31" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-2a497a47-0925-4daa-b14e-83d02d452ed2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "cinder-quobyte-0ef7e268-db33-4d18-9b6c-bb25a6717c31" acquired by "delete_volume" :: waited 0.036s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:33 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[5122e1d4-6b12-481d-863f-4a50fcaffa3a]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:36:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2a497a47-0925-4daa-b14e-83d02d452ed2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ef7e268-db33-4d18-9b6c-bb25a6717c31 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:33 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-245036bf-c922-4530-9e95-0ea534b22632 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.372s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:33 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-245036bf-c922-4530-9e95-0ea534b22632 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:36:33 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-245036bf-c922-4530-9e95-0ea534b22632 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Deleted volume successfully. Nov 02 12:36:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-245036bf-c922-4530-9e95-0ea534b22632 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "cinder-6de9b5f3-77ea-42e0-99dc-dce2827d0ddc-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:33 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ef7e268-db33-4d18-9b6c-bb25a6717c31 Nov 02 12:36:33 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:33 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2a497a47-0925-4daa-b14e-83d02d452ed2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ef7e268-db33-4d18-9b6c-bb25a6717c31" returned: 0 in 0.433s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2a497a47-0925-4daa-b14e-83d02d452ed2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ef7e268-db33-4d18-9b6c-bb25a6717c31 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:33 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ef7e268-db33-4d18-9b6c-bb25a6717c31 Nov 02 12:36:33 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:34 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2a497a47-0925-4daa-b14e-83d02d452ed2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0ef7e268-db33-4d18-9b6c-bb25a6717c31" returned: 0 in 0.269s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:34 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-2a497a47-0925-4daa-b14e-83d02d452ed2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "cinder-quobyte-0ef7e268-db33-4d18-9b6c-bb25a6717c31" released by "delete_volume" :: held 0.751s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:34 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-2a497a47-0925-4daa-b14e-83d02d452ed2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Created reservations ['cff9db3f-b054-4940-ab8f-5553448a2040', '0293d9e6-89bf-4635-bfc3-0a32f4a7c671', 'eed55e70-d032-48de-a056-3de3702ece60', '9d022b37-ebfa-4276-b74c-bdc74bd92248'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:36:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2a497a47-0925-4daa-b14e-83d02d452ed2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2a497a47-0925-4daa-b14e-83d02d452ed2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-2a497a47-0925-4daa-b14e-83d02d452ed2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-2a497a47-0925-4daa-b14e-83d02d452ed2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2a497a47-0925-4daa-b14e-83d02d452ed2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2a497a47-0925-4daa-b14e-83d02d452ed2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:34 devstack sudo[101143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:36:34 devstack sudo[101143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:34 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9dfdb737-da20-4835-b481-311572c9bb99 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Acquiring lock "cinder-91286485-a448-466e-b0ec-cb1aa5457019-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:34 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9dfdb737-da20-4835-b481-311572c9bb99 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "cinder-91286485-a448-466e-b0ec-cb1aa5457019-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:34 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9dfdb737-da20-4835-b481-311572c9bb99 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Acquiring lock "cinder-quobyte-91286485-a448-466e-b0ec-cb1aa5457019" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:34 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9dfdb737-da20-4835-b481-311572c9bb99 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "cinder-quobyte-91286485-a448-466e-b0ec-cb1aa5457019" acquired by "delete_volume" :: waited 0.017s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:34 devstack sudo[101143]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2a497a47-0925-4daa-b14e-83d02d452ed2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.372s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:34 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-2a497a47-0925-4daa-b14e-83d02d452ed2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:36:34 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8d867e-b698-42ea-af4c-f1ae5f7eec78]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:36:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9dfdb737-da20-4835-b481-311572c9bb99 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-91286485-a448-466e-b0ec-cb1aa5457019 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:34 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-2a497a47-0925-4daa-b14e-83d02d452ed2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Deleted volume successfully. Nov 02 12:36:34 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-2a497a47-0925-4daa-b14e-83d02d452ed2 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "cinder-0ef7e268-db33-4d18-9b6c-bb25a6717c31-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:34 devstack sudo[101146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-91286485-a448-466e-b0ec-cb1aa5457019 Nov 02 12:36:34 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:34 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9dfdb737-da20-4835-b481-311572c9bb99 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-91286485-a448-466e-b0ec-cb1aa5457019" returned: 0 in 0.405s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9dfdb737-da20-4835-b481-311572c9bb99 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-91286485-a448-466e-b0ec-cb1aa5457019 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:34 devstack sudo[101151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-91286485-a448-466e-b0ec-cb1aa5457019 Nov 02 12:36:34 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:35 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9dfdb737-da20-4835-b481-311572c9bb99 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-91286485-a448-466e-b0ec-cb1aa5457019" returned: 0 in 0.305s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:35 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9dfdb737-da20-4835-b481-311572c9bb99 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "cinder-quobyte-91286485-a448-466e-b0ec-cb1aa5457019" released by "delete_volume" :: held 0.771s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:35 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-9dfdb737-da20-4835-b481-311572c9bb99 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Created reservations ['8ed67f5f-c688-44f2-bbd1-59a6915c11c0', 'b83a14d7-98f4-4f06-8f99-5387e253eacb', '1355c3b6-8f72-4585-85e2-49e34114d68d', '81b681ae-50ee-4dbd-b917-6aba5bc0c412'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:36:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-9dfdb737-da20-4835-b481-311572c9bb99 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-9dfdb737-da20-4835-b481-311572c9bb99 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:35 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-9dfdb737-da20-4835-b481-311572c9bb99 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:35 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-9dfdb737-da20-4835-b481-311572c9bb99 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-9dfdb737-da20-4835-b481-311572c9bb99 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9dfdb737-da20-4835-b481-311572c9bb99 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:35 devstack sudo[101154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:36:35 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:35 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-596c3aad-06ce-4602-bea7-8169fc554a7b tempest-CreateVolumesFromSnapshotTest-1676715326 None] Acquiring lock "cinder-5d5ab965-32ed-41db-8f8d-81d89388666a-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:35 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-596c3aad-06ce-4602-bea7-8169fc554a7b tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "cinder-5d5ab965-32ed-41db-8f8d-81d89388666a-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:35 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-596c3aad-06ce-4602-bea7-8169fc554a7b tempest-CreateVolumesFromSnapshotTest-1676715326 None] Acquiring lock "cinder-quobyte-5d5ab965-32ed-41db-8f8d-81d89388666a" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:35 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-596c3aad-06ce-4602-bea7-8169fc554a7b tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "cinder-quobyte-5d5ab965-32ed-41db-8f8d-81d89388666a" acquired by "delete_volume" :: waited 0.031s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:35 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[23070584-f449-4608-b2b8-6d39636fe1f9]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:36:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-596c3aad-06ce-4602-bea7-8169fc554a7b tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5d5ab965-32ed-41db-8f8d-81d89388666a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:35 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9dfdb737-da20-4835-b481-311572c9bb99 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.382s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:35 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-9dfdb737-da20-4835-b481-311572c9bb99 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:36:35 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-9dfdb737-da20-4835-b481-311572c9bb99 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Deleted volume successfully. Nov 02 12:36:35 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9dfdb737-da20-4835-b481-311572c9bb99 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "cinder-91286485-a448-466e-b0ec-cb1aa5457019-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:35 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5d5ab965-32ed-41db-8f8d-81d89388666a Nov 02 12:36:35 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:36 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-596c3aad-06ce-4602-bea7-8169fc554a7b tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5d5ab965-32ed-41db-8f8d-81d89388666a" returned: 0 in 0.452s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-596c3aad-06ce-4602-bea7-8169fc554a7b tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5d5ab965-32ed-41db-8f8d-81d89388666a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:36 devstack sudo[101162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5d5ab965-32ed-41db-8f8d-81d89388666a Nov 02 12:36:36 devstack sudo[101162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:36 devstack sudo[101162]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-596c3aad-06ce-4602-bea7-8169fc554a7b tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5d5ab965-32ed-41db-8f8d-81d89388666a" returned: 0 in 0.336s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:36 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-596c3aad-06ce-4602-bea7-8169fc554a7b tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "cinder-quobyte-5d5ab965-32ed-41db-8f8d-81d89388666a" released by "delete_volume" :: held 0.838s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:36 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-596c3aad-06ce-4602-bea7-8169fc554a7b tempest-CreateVolumesFromSnapshotTest-1676715326 None] Created reservations ['78bf804e-1196-4400-8bec-4e04ca31dbc8', 'b3530d5b-8b52-48df-98d2-72cfece1c9bb', '897c8e78-74a9-4c2d-b634-38acc0b94290', '499fd3c2-831a-484e-8c22-b13e19b62ece'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:36:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-596c3aad-06ce-4602-bea7-8169fc554a7b tempest-CreateVolumesFromSnapshotTest-1676715326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-596c3aad-06ce-4602-bea7-8169fc554a7b tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-596c3aad-06ce-4602-bea7-8169fc554a7b tempest-CreateVolumesFromSnapshotTest-1676715326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-596c3aad-06ce-4602-bea7-8169fc554a7b tempest-CreateVolumesFromSnapshotTest-1676715326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-596c3aad-06ce-4602-bea7-8169fc554a7b tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-596c3aad-06ce-4602-bea7-8169fc554a7b tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:36 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:36:36 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:36 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4ca45467-dc98-4259-940a-b71fd6d4f1f9 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Acquiring lock "cinder-99ca459c-a696-42be-9ff6-6ae2031f05f2-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:36 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4ca45467-dc98-4259-940a-b71fd6d4f1f9 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "cinder-99ca459c-a696-42be-9ff6-6ae2031f05f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:36 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4ca45467-dc98-4259-940a-b71fd6d4f1f9 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Acquiring lock "cinder-quobyte-780181da-3edd-4274-a881-0b104181876c" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:36 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4ca45467-dc98-4259-940a-b71fd6d4f1f9 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "cinder-quobyte-780181da-3edd-4274-a881-0b104181876c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:36 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4ca45467-dc98-4259-940a-b71fd6d4f1f9 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Acquiring lock "cinder-quobyte-99ca459c-a696-42be-9ff6-6ae2031f05f2" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:36 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4ca45467-dc98-4259-940a-b71fd6d4f1f9 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "cinder-quobyte-99ca459c-a696-42be-9ff6-6ae2031f05f2" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-4ca45467-dc98-4259-940a-b71fd6d4f1f9 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Deleting offline snapshot 99ca459c-a696-42be-9ff6-6ae2031f05f2 of volume 780181da-3edd-4274-a881-0b104181876c {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:36:37 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-4ca45467-dc98-4259-940a-b71fd6d4f1f9 tempest-CreateVolumesFromSnapshotTest-1676715326 None] snapshot_file for this snap is: volume-780181da-3edd-4274-a881-0b104181876c.99ca459c-a696-42be-9ff6-6ae2031f05f2 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:36:37 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[317421eb-9b6f-4180-b2ae-4c94869bfcee]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:36:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4ca45467-dc98-4259-940a-b71fd6d4f1f9 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c.99ca459c-a696-42be-9ff6-6ae2031f05f2 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:37 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-596c3aad-06ce-4602-bea7-8169fc554a7b tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.416s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:37 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-596c3aad-06ce-4602-bea7-8169fc554a7b tempest-CreateVolumesFromSnapshotTest-1676715326 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:36:37 devstack sudo[101167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c.99ca459c-a696-42be-9ff6-6ae2031f05f2 Nov 02 12:36:37 devstack sudo[101167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:37 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-596c3aad-06ce-4602-bea7-8169fc554a7b tempest-CreateVolumesFromSnapshotTest-1676715326 None] Deleted volume successfully. Nov 02 12:36:37 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-596c3aad-06ce-4602-bea7-8169fc554a7b tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "cinder-5d5ab965-32ed-41db-8f8d-81d89388666a-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:37 devstack sudo[101167]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4ca45467-dc98-4259-940a-b71fd6d4f1f9 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c.99ca459c-a696-42be-9ff6-6ae2031f05f2" returned: 0 in 0.504s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:37 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-4ca45467-dc98-4259-940a-b71fd6d4f1f9 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-780181da-3edd-4274-a881-0b104181876c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:36:37 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eddf8a7-3948-4ce8-bdf0-3e69ed128333]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:36:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4ca45467-dc98-4259-940a-b71fd6d4f1f9 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:37 devstack sudo[101174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c Nov 02 12:36:37 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:38 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4ca45467-dc98-4259-940a-b71fd6d4f1f9 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c" returned: 0 in 0.479s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4ca45467-dc98-4259-940a-b71fd6d4f1f9 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c.99ca459c-a696-42be-9ff6-6ae2031f05f2 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:38 devstack sudo[101179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c.99ca459c-a696-42be-9ff6-6ae2031f05f2 Nov 02 12:36:38 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:38 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4ca45467-dc98-4259-940a-b71fd6d4f1f9 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c.99ca459c-a696-42be-9ff6-6ae2031f05f2" returned: 0 in 0.408s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4ca45467-dc98-4259-940a-b71fd6d4f1f9 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c.99ca459c-a696-42be-9ff6-6ae2031f05f2 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:38 devstack sudo[101184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c.99ca459c-a696-42be-9ff6-6ae2031f05f2 Nov 02 12:36:38 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:38 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4ca45467-dc98-4259-940a-b71fd6d4f1f9 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c.99ca459c-a696-42be-9ff6-6ae2031f05f2" returned: 0 in 0.274s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:38 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4ca45467-dc98-4259-940a-b71fd6d4f1f9 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "cinder-quobyte-99ca459c-a696-42be-9ff6-6ae2031f05f2" released by "_delete_snapshot" :: held 1.800s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:38 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4ca45467-dc98-4259-940a-b71fd6d4f1f9 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "cinder-quobyte-780181da-3edd-4274-a881-0b104181876c" released by "delete_snapshot" :: held 1.850s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:38 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-4ca45467-dc98-4259-940a-b71fd6d4f1f9 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Created reservations ['ed184c66-7383-4baf-aeb3-8f3a32d6a49d', 'ad9ae0c1-c211-478e-bdb8-d18ed4dfbce8', 'b558089d-bef9-4353-96ff-94510c470206', '7d3b7dd1-2c9e-41cd-a99f-f386efc0bd73'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:36:38 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-4ca45467-dc98-4259-940a-b71fd6d4f1f9 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Delete snapshot completed successfully. Nov 02 12:36:38 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4ca45467-dc98-4259-940a-b71fd6d4f1f9 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "cinder-99ca459c-a696-42be-9ff6-6ae2031f05f2-delete_snapshot" released by "delete_snapshot" :: held 2.045s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:39 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-fd62fe3c-4357-4522-8a0c-2958345b39d7 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Acquiring lock "cinder-780181da-3edd-4274-a881-0b104181876c-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:39 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-fd62fe3c-4357-4522-8a0c-2958345b39d7 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "cinder-780181da-3edd-4274-a881-0b104181876c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:39 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-fd62fe3c-4357-4522-8a0c-2958345b39d7 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Acquiring lock "cinder-quobyte-780181da-3edd-4274-a881-0b104181876c" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:39 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-fd62fe3c-4357-4522-8a0c-2958345b39d7 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "cinder-quobyte-780181da-3edd-4274-a881-0b104181876c" acquired by "delete_volume" :: waited 0.025s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:39 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5ef667-d777-4650-887f-ee7b1d93344c]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:36:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fd62fe3c-4357-4522-8a0c-2958345b39d7 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:39 devstack sudo[101187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c Nov 02 12:36:39 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:39 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fd62fe3c-4357-4522-8a0c-2958345b39d7 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c" returned: 0 in 0.401s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fd62fe3c-4357-4522-8a0c-2958345b39d7 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:39 devstack sudo[101192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c Nov 02 12:36:39 devstack sudo[101192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:39 devstack sudo[101192]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fd62fe3c-4357-4522-8a0c-2958345b39d7 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-780181da-3edd-4274-a881-0b104181876c" returned: 0 in 0.264s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:39 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-fd62fe3c-4357-4522-8a0c-2958345b39d7 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "cinder-quobyte-780181da-3edd-4274-a881-0b104181876c" released by "delete_volume" :: held 0.747s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:39 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-fd62fe3c-4357-4522-8a0c-2958345b39d7 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Created reservations ['099807ed-cc8e-46a5-a272-7cb8dbfe69e9', 'dac8d64a-88c1-4454-abbd-844aaa770027', '18a4f19c-6533-413a-87ab-95982c45615f', 'b490aab2-25be-4fc6-be32-896dfb59c161'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:36:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fd62fe3c-4357-4522-8a0c-2958345b39d7 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fd62fe3c-4357-4522-8a0c-2958345b39d7 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:40 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-fd62fe3c-4357-4522-8a0c-2958345b39d7 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:40 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-fd62fe3c-4357-4522-8a0c-2958345b39d7 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fd62fe3c-4357-4522-8a0c-2958345b39d7 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fd62fe3c-4357-4522-8a0c-2958345b39d7 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:40 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:36:40 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:40 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fd62fe3c-4357-4522-8a0c-2958345b39d7 tempest-CreateVolumesFromSnapshotTest-1676715326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.353s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:40 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-fd62fe3c-4357-4522-8a0c-2958345b39d7 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:36:40 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-fd62fe3c-4357-4522-8a0c-2958345b39d7 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Deleted volume successfully. Nov 02 12:36:40 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-fd62fe3c-4357-4522-8a0c-2958345b39d7 tempest-CreateVolumesFromSnapshotTest-1676715326 None] Lock "cinder-780181da-3edd-4274-a881-0b104181876c-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:43 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:36:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:43 devstack sudo[101238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:36:43 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:44 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.319s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:44 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:36:44 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager._thread_info {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:36:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread count: 28 {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:36:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread info: [<_MainThread(MainThread, started 129944084402304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:36:44 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf3a72c0-40e7-405d-8552-628af58e84e4 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:36:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-cf3a72c0-40e7-405d-8552-628af58e84e4 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Flow 'volume_create_manager' (26d6fb28-f5aa-4780-beea-6141cc19024b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-cf3a72c0-40e7-405d-8552-628af58e84e4 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c671df72-2db0-4152-b2ce-bc18624465e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-cf3a72c0-40e7-405d-8552-628af58e84e4 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c671df72-2db0-4152-b2ce-bc18624465e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-353367748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=049a5375-b07e-476b-812a-8af80b707218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='792a0dcbfdc24276b2e36bfd9d381dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:44Z,use_quota=True,user_id='62d1e4de29284a2c9a2337759ea9e611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-cf3a72c0-40e7-405d-8552-628af58e84e4 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fae57534-d735-41e3-ab93-a6fc5382e341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-cf3a72c0-40e7-405d-8552-628af58e84e4 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fae57534-d735-41e3-ab93-a6fc5382e341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-cf3a72c0-40e7-405d-8552-628af58e84e4 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a7cf5a-0002-4639-96eb-70b7ea6def14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-cf3a72c0-40e7-405d-8552-628af58e84e4 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a7cf5a-0002-4639-96eb-70b7ea6def14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '049a5375-b07e-476b-812a-8af80b707218', 'volume_name': 'volume-049a5375-b07e-476b-812a-8af80b707218', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-cf3a72c0-40e7-405d-8552-628af58e84e4 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e42b375-b9fb-44dd-8145-31c4a8e7996d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-cf3a72c0-40e7-405d-8552-628af58e84e4 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e42b375-b9fb-44dd-8145-31c4a8e7996d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-cf3a72c0-40e7-405d-8552-628af58e84e4 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33945cdf-e13f-457f-865a-81c91f9e6ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:44 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-cf3a72c0-40e7-405d-8552-628af58e84e4 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Volume 049a5375-b07e-476b-812a-8af80b707218: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-049a5375-b07e-476b-812a-8af80b707218', 'volume_size': 1} Nov 02 12:36:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-cf3a72c0-40e7-405d-8552-628af58e84e4 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-cf3a72c0-40e7-405d-8552-628af58e84e4 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:44 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-cf3a72c0-40e7-405d-8552-628af58e84e4 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-353367748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=049a5375-b07e-476b-812a-8af80b707218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='792a0dcbfdc24276b2e36bfd9d381dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:44Z,use_quota=True,user_id='62d1e4de29284a2c9a2337759ea9e611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:36:44 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-cf3a72c0-40e7-405d-8552-628af58e84e4 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Creating volume 049a5375-b07e-476b-812a-8af80b707218 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:36:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-cf3a72c0-40e7-405d-8552-628af58e84e4 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-cf3a72c0-40e7-405d-8552-628af58e84e4 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:44 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-cf3a72c0-40e7-405d-8552-628af58e84e4 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:44 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-cf3a72c0-40e7-405d-8552-628af58e84e4 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-cf3a72c0-40e7-405d-8552-628af58e84e4 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:44 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-cf3a72c0-40e7-405d-8552-628af58e84e4 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:36:44 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-cf3a72c0-40e7-405d-8552-628af58e84e4 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:36:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cf3a72c0-40e7-405d-8552-628af58e84e4 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-049a5375-b07e-476b-812a-8af80b707218 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:44 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-049a5375-b07e-476b-812a-8af80b707218 1073741824 Nov 02 12:36:44 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:44 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cf3a72c0-40e7-405d-8552-628af58e84e4 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-049a5375-b07e-476b-812a-8af80b707218 1073741824" returned: 0 in 0.479s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cf3a72c0-40e7-405d-8552-628af58e84e4 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-049a5375-b07e-476b-812a-8af80b707218 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:44 devstack sudo[101248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-049a5375-b07e-476b-812a-8af80b707218 Nov 02 12:36:44 devstack sudo[101248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:45 devstack sudo[101248]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cf3a72c0-40e7-405d-8552-628af58e84e4 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-049a5375-b07e-476b-812a-8af80b707218" returned: 0 in 0.295s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:45 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-cf3a72c0-40e7-405d-8552-628af58e84e4 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:36:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-cf3a72c0-40e7-405d-8552-628af58e84e4 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-cf3a72c0-40e7-405d-8552-628af58e84e4 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33945cdf-e13f-457f-865a-81c91f9e6ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-049a5375-b07e-476b-812a-8af80b707218', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-cf3a72c0-40e7-405d-8552-628af58e84e4 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (226b3eb9-9ce1-4c8f-a68c-15726f3bd07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:45 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-cf3a72c0-40e7-405d-8552-628af58e84e4 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Volume volume-049a5375-b07e-476b-812a-8af80b707218 (049a5375-b07e-476b-812a-8af80b707218): created successfully Nov 02 12:36:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-cf3a72c0-40e7-405d-8552-628af58e84e4 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (226b3eb9-9ce1-4c8f-a68c-15726f3bd07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-cf3a72c0-40e7-405d-8552-628af58e84e4 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Flow 'volume_create_manager' (26d6fb28-f5aa-4780-beea-6141cc19024b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:45 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-cf3a72c0-40e7-405d-8552-628af58e84e4 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Created volume successfully. Nov 02 12:36:46 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7788ecf-d8a7-49e8-8867-dd7669d6e9cc tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:36:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f7788ecf-d8a7-49e8-8867-dd7669d6e9cc tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Flow 'volume_create_manager' (a22ce068-83ee-4bdf-88be-abec85070669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f7788ecf-d8a7-49e8-8867-dd7669d6e9cc tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4a949a3-d82c-4d18-85f1-7a79e5fb4174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f7788ecf-d8a7-49e8-8867-dd7669d6e9cc tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4a949a3-d82c-4d18-85f1-7a79e5fb4174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1031783046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=073bcc4a-b6fe-4b36-9dce-1fa9cf5c14cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='792a0dcbfdc24276b2e36bfd9d381dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:47Z,use_quota=True,user_id='62d1e4de29284a2c9a2337759ea9e611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f7788ecf-d8a7-49e8-8867-dd7669d6e9cc tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce38799-46c1-441c-a6c0-512ca505def8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f7788ecf-d8a7-49e8-8867-dd7669d6e9cc tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce38799-46c1-441c-a6c0-512ca505def8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f7788ecf-d8a7-49e8-8867-dd7669d6e9cc tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0612299a-60de-4df4-b60a-11bf755e2239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f7788ecf-d8a7-49e8-8867-dd7669d6e9cc tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0612299a-60de-4df4-b60a-11bf755e2239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '073bcc4a-b6fe-4b36-9dce-1fa9cf5c14cd', 'volume_name': 'volume-073bcc4a-b6fe-4b36-9dce-1fa9cf5c14cd', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f7788ecf-d8a7-49e8-8867-dd7669d6e9cc tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce7b8aad-d9e2-42ac-9568-e987b5b60d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f7788ecf-d8a7-49e8-8867-dd7669d6e9cc tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce7b8aad-d9e2-42ac-9568-e987b5b60d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f7788ecf-d8a7-49e8-8867-dd7669d6e9cc tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (212a8e1b-2315-41ec-ba9e-3dd1b2b83857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:47 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-f7788ecf-d8a7-49e8-8867-dd7669d6e9cc tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Volume 073bcc4a-b6fe-4b36-9dce-1fa9cf5c14cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-073bcc4a-b6fe-4b36-9dce-1fa9cf5c14cd', 'volume_size': 1} Nov 02 12:36:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f7788ecf-d8a7-49e8-8867-dd7669d6e9cc tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f7788ecf-d8a7-49e8-8867-dd7669d6e9cc tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:47 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f7788ecf-d8a7-49e8-8867-dd7669d6e9cc tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1031783046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=073bcc4a-b6fe-4b36-9dce-1fa9cf5c14cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='792a0dcbfdc24276b2e36bfd9d381dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:47Z,use_quota=True,user_id='62d1e4de29284a2c9a2337759ea9e611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:36:47 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-f7788ecf-d8a7-49e8-8867-dd7669d6e9cc tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Creating volume 073bcc4a-b6fe-4b36-9dce-1fa9cf5c14cd {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:36:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f7788ecf-d8a7-49e8-8867-dd7669d6e9cc tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f7788ecf-d8a7-49e8-8867-dd7669d6e9cc tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:47 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f7788ecf-d8a7-49e8-8867-dd7669d6e9cc tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:47 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f7788ecf-d8a7-49e8-8867-dd7669d6e9cc tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f7788ecf-d8a7-49e8-8867-dd7669d6e9cc tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:47 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f7788ecf-d8a7-49e8-8867-dd7669d6e9cc tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:36:47 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-f7788ecf-d8a7-49e8-8867-dd7669d6e9cc tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:36:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f7788ecf-d8a7-49e8-8867-dd7669d6e9cc tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-073bcc4a-b6fe-4b36-9dce-1fa9cf5c14cd 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:47 devstack sudo[101260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-073bcc4a-b6fe-4b36-9dce-1fa9cf5c14cd 1073741824 Nov 02 12:36:47 devstack sudo[101260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:47 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f6b750f-275e-4a33-80eb-65496b57802b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:36:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2f6b750f-275e-4a33-80eb-65496b57802b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Flow 'volume_create_manager' (ef7b1bfc-f482-4fd4-910d-f43c244a2f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2f6b750f-275e-4a33-80eb-65496b57802b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba49f1b3-2d2a-42c6-bfcb-9455948b556b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2f6b750f-275e-4a33-80eb-65496b57802b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba49f1b3-2d2a-42c6-bfcb-9455948b556b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-3103143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcf7edac-a544-4b25-906c-0ff5b5f5dade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='792a0dcbfdc24276b2e36bfd9d381dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:48Z,use_quota=True,user_id='62d1e4de29284a2c9a2337759ea9e611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2f6b750f-275e-4a33-80eb-65496b57802b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed792d5c-6f5a-4cf9-b2e1-072b55ef9f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2f6b750f-275e-4a33-80eb-65496b57802b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed792d5c-6f5a-4cf9-b2e1-072b55ef9f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2f6b750f-275e-4a33-80eb-65496b57802b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a306d149-5a82-441d-b759-1519371e04ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2f6b750f-275e-4a33-80eb-65496b57802b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a306d149-5a82-441d-b759-1519371e04ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcf7edac-a544-4b25-906c-0ff5b5f5dade', 'volume_name': 'volume-fcf7edac-a544-4b25-906c-0ff5b5f5dade', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2f6b750f-275e-4a33-80eb-65496b57802b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2d14bb0-3636-4f4f-abf4-8e64b61425a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2f6b750f-275e-4a33-80eb-65496b57802b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2d14bb0-3636-4f4f-abf4-8e64b61425a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2f6b750f-275e-4a33-80eb-65496b57802b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4889e10-4ea4-4632-8346-03ecc93c5ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:47 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-2f6b750f-275e-4a33-80eb-65496b57802b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Volume fcf7edac-a544-4b25-906c-0ff5b5f5dade: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcf7edac-a544-4b25-906c-0ff5b5f5dade', 'volume_size': 1} Nov 02 12:36:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2f6b750f-275e-4a33-80eb-65496b57802b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:47 devstack sudo[101260]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f7788ecf-d8a7-49e8-8867-dd7669d6e9cc tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-073bcc4a-b6fe-4b36-9dce-1fa9cf5c14cd 1073741824" returned: 0 in 0.840s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:47 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=109,cinder:UPDATE=123,cinder:INSERT=33,cinder:DELETE=12 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:36:47 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=106,cinder:UPDATE=148,cinder:DELETE=9,cinder:INSERT=29 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:36:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f7788ecf-d8a7-49e8-8867-dd7669d6e9cc tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-073bcc4a-b6fe-4b36-9dce-1fa9cf5c14cd {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:48 devstack sudo[101266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-073bcc4a-b6fe-4b36-9dce-1fa9cf5c14cd Nov 02 12:36:48 devstack sudo[101266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:48 devstack sudo[101266]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f7788ecf-d8a7-49e8-8867-dd7669d6e9cc tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-073bcc4a-b6fe-4b36-9dce-1fa9cf5c14cd" returned: 0 in 0.315s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f7788ecf-d8a7-49e8-8867-dd7669d6e9cc tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:36:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f7788ecf-d8a7-49e8-8867-dd7669d6e9cc tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2f6b750f-275e-4a33-80eb-65496b57802b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.428s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-2f6b750f-275e-4a33-80eb-65496b57802b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-3103143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcf7edac-a544-4b25-906c-0ff5b5f5dade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='792a0dcbfdc24276b2e36bfd9d381dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:48Z,use_quota=True,user_id='62d1e4de29284a2c9a2337759ea9e611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:36:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-2f6b750f-275e-4a33-80eb-65496b57802b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Creating volume fcf7edac-a544-4b25-906c-0ff5b5f5dade {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:36:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2f6b750f-275e-4a33-80eb-65496b57802b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2f6b750f-275e-4a33-80eb-65496b57802b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-2f6b750f-275e-4a33-80eb-65496b57802b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-2f6b750f-275e-4a33-80eb-65496b57802b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2f6b750f-275e-4a33-80eb-65496b57802b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-2f6b750f-275e-4a33-80eb-65496b57802b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:36:48 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-2f6b750f-275e-4a33-80eb-65496b57802b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:36:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2f6b750f-275e-4a33-80eb-65496b57802b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-fcf7edac-a544-4b25-906c-0ff5b5f5dade 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f7788ecf-d8a7-49e8-8867-dd7669d6e9cc tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (212a8e1b-2315-41ec-ba9e-3dd1b2b83857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-073bcc4a-b6fe-4b36-9dce-1fa9cf5c14cd', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:48 devstack sudo[101273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-fcf7edac-a544-4b25-906c-0ff5b5f5dade 1073741824 Nov 02 12:36:48 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f7788ecf-d8a7-49e8-8867-dd7669d6e9cc tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0afb768c-0f4d-4d8d-a19b-3b2a52574110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:48 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-f7788ecf-d8a7-49e8-8867-dd7669d6e9cc tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Volume volume-073bcc4a-b6fe-4b36-9dce-1fa9cf5c14cd (073bcc4a-b6fe-4b36-9dce-1fa9cf5c14cd): created successfully Nov 02 12:36:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f7788ecf-d8a7-49e8-8867-dd7669d6e9cc tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0afb768c-0f4d-4d8d-a19b-3b2a52574110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f7788ecf-d8a7-49e8-8867-dd7669d6e9cc tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Flow 'volume_create_manager' (a22ce068-83ee-4bdf-88be-abec85070669) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:48 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ba1647b-172c-442e-8678-6c5c2c3458ff tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:36:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8ba1647b-172c-442e-8678-6c5c2c3458ff tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Flow 'volume_create_manager' (c922321e-497c-4b2d-9b77-a57872b9e4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8ba1647b-172c-442e-8678-6c5c2c3458ff tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1660d4db-89ff-4375-a2e9-2dbf9d02eeee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:48 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-f7788ecf-d8a7-49e8-8867-dd7669d6e9cc tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Created volume successfully. Nov 02 12:36:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8ba1647b-172c-442e-8678-6c5c2c3458ff tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1660d4db-89ff-4375-a2e9-2dbf9d02eeee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-626121115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=319191ee-82b4-4319-ac6e-081310555764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='792a0dcbfdc24276b2e36bfd9d381dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:48Z,use_quota=True,user_id='62d1e4de29284a2c9a2337759ea9e611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8ba1647b-172c-442e-8678-6c5c2c3458ff tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de40cd10-d4af-48cd-a4a3-996b46d8df5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8ba1647b-172c-442e-8678-6c5c2c3458ff tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de40cd10-d4af-48cd-a4a3-996b46d8df5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8ba1647b-172c-442e-8678-6c5c2c3458ff tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bda0a830-a839-4183-97df-8c0b9fd3fdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8ba1647b-172c-442e-8678-6c5c2c3458ff tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bda0a830-a839-4183-97df-8c0b9fd3fdfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '319191ee-82b4-4319-ac6e-081310555764', 'volume_name': 'volume-319191ee-82b4-4319-ac6e-081310555764', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8ba1647b-172c-442e-8678-6c5c2c3458ff tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e9640d8-f621-4bf1-9bd2-1cd2867f857c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8ba1647b-172c-442e-8678-6c5c2c3458ff tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e9640d8-f621-4bf1-9bd2-1cd2867f857c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8ba1647b-172c-442e-8678-6c5c2c3458ff tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07e50bd9-84c9-4881-a721-d551f92f79e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:48 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-8ba1647b-172c-442e-8678-6c5c2c3458ff tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Volume 319191ee-82b4-4319-ac6e-081310555764: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-319191ee-82b4-4319-ac6e-081310555764', 'volume_size': 1} Nov 02 12:36:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8ba1647b-172c-442e-8678-6c5c2c3458ff tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:49 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2f6b750f-275e-4a33-80eb-65496b57802b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-fcf7edac-a544-4b25-906c-0ff5b5f5dade 1073741824" returned: 0 in 0.742s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:49 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc5e07bd-e232-46a8-a06a-5f9ecb8d860f tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:36:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bc5e07bd-e232-46a8-a06a-5f9ecb8d860f tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Flow 'volume_create_manager' (d3ff9d3d-52d9-4ed8-8620-bb71a78af088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bc5e07bd-e232-46a8-a06a-5f9ecb8d860f tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c5a7734-95b1-4ad8-a3e6-7afe7caaf8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2f6b750f-275e-4a33-80eb-65496b57802b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-fcf7edac-a544-4b25-906c-0ff5b5f5dade {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bc5e07bd-e232-46a8-a06a-5f9ecb8d860f tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c5a7734-95b1-4ad8-a3e6-7afe7caaf8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-314575616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57175706-32de-4711-b112-e178b7803ed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='792a0dcbfdc24276b2e36bfd9d381dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:49Z,use_quota=True,user_id='62d1e4de29284a2c9a2337759ea9e611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bc5e07bd-e232-46a8-a06a-5f9ecb8d860f tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc3420e-5808-40f7-ab12-93df9fa6232e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bc5e07bd-e232-46a8-a06a-5f9ecb8d860f tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc3420e-5808-40f7-ab12-93df9fa6232e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bc5e07bd-e232-46a8-a06a-5f9ecb8d860f tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f99ac95-83b4-434e-be81-6719dfaf267a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bc5e07bd-e232-46a8-a06a-5f9ecb8d860f tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f99ac95-83b4-434e-be81-6719dfaf267a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57175706-32de-4711-b112-e178b7803ed8', 'volume_name': 'volume-57175706-32de-4711-b112-e178b7803ed8', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bc5e07bd-e232-46a8-a06a-5f9ecb8d860f tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10661a7c-f816-47b4-aa89-0b4d02457fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:49 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-fcf7edac-a544-4b25-906c-0ff5b5f5dade Nov 02 12:36:49 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bc5e07bd-e232-46a8-a06a-5f9ecb8d860f tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10661a7c-f816-47b4-aa89-0b4d02457fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bc5e07bd-e232-46a8-a06a-5f9ecb8d860f tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43a9b905-8904-4f97-bf74-64e2e65cf814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:49 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-bc5e07bd-e232-46a8-a06a-5f9ecb8d860f tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Volume 57175706-32de-4711-b112-e178b7803ed8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57175706-32de-4711-b112-e178b7803ed8', 'volume_size': 1} Nov 02 12:36:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-bc5e07bd-e232-46a8-a06a-5f9ecb8d860f tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:49 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2f6b750f-275e-4a33-80eb-65496b57802b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-fcf7edac-a544-4b25-906c-0ff5b5f5dade" returned: 0 in 0.445s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:49 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-2f6b750f-275e-4a33-80eb-65496b57802b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] <== create_volume: return (1355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:36:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2f6b750f-275e-4a33-80eb-65496b57802b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.360s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8ba1647b-172c-442e-8678-6c5c2c3458ff tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.039s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:49 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8ba1647b-172c-442e-8678-6c5c2c3458ff tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-626121115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=319191ee-82b4-4319-ac6e-081310555764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='792a0dcbfdc24276b2e36bfd9d381dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:48Z,use_quota=True,user_id='62d1e4de29284a2c9a2337759ea9e611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:36:49 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-8ba1647b-172c-442e-8678-6c5c2c3458ff tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Creating volume 319191ee-82b4-4319-ac6e-081310555764 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:36:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8ba1647b-172c-442e-8678-6c5c2c3458ff tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8ba1647b-172c-442e-8678-6c5c2c3458ff tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:49 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8ba1647b-172c-442e-8678-6c5c2c3458ff tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:49 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8ba1647b-172c-442e-8678-6c5c2c3458ff tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8ba1647b-172c-442e-8678-6c5c2c3458ff tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:49 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8ba1647b-172c-442e-8678-6c5c2c3458ff tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:36:49 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-8ba1647b-172c-442e-8678-6c5c2c3458ff tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:36:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8ba1647b-172c-442e-8678-6c5c2c3458ff tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-319191ee-82b4-4319-ac6e-081310555764 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2f6b750f-275e-4a33-80eb-65496b57802b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4889e10-4ea4-4632-8346-03ecc93c5ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcf7edac-a544-4b25-906c-0ff5b5f5dade', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:49 devstack sudo[101282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-319191ee-82b4-4319-ac6e-081310555764 1073741824 Nov 02 12:36:49 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2f6b750f-275e-4a33-80eb-65496b57802b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9765560-4dc8-4586-b3a6-003822aa2099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:49 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-2f6b750f-275e-4a33-80eb-65496b57802b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Volume volume-fcf7edac-a544-4b25-906c-0ff5b5f5dade (fcf7edac-a544-4b25-906c-0ff5b5f5dade): created successfully Nov 02 12:36:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2f6b750f-275e-4a33-80eb-65496b57802b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9765560-4dc8-4586-b3a6-003822aa2099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2f6b750f-275e-4a33-80eb-65496b57802b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Flow 'volume_create_manager' (ef7b1bfc-f482-4fd4-910d-f43c244a2f8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:49 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-2f6b750f-275e-4a33-80eb-65496b57802b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Created volume successfully. Nov 02 12:36:49 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5feff43-9a93-4b20-857d-d677b0eb5b80 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:36:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e5feff43-9a93-4b20-857d-d677b0eb5b80 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Flow 'volume_create_manager' (4e0b819e-def2-4548-98c0-158b3fe53cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e5feff43-9a93-4b20-857d-d677b0eb5b80 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec3c3d0-9c75-4512-bbd1-d94c4ac91ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e5feff43-9a93-4b20-857d-d677b0eb5b80 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec3c3d0-9c75-4512-bbd1-d94c4ac91ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2130417422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9fb7043-a8e3-41eb-9a28-86ecaa2807ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='792a0dcbfdc24276b2e36bfd9d381dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:50Z,use_quota=True,user_id='62d1e4de29284a2c9a2337759ea9e611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e5feff43-9a93-4b20-857d-d677b0eb5b80 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61c4cf57-4d0c-4d76-9149-6ea69f80d6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:50 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e5feff43-9a93-4b20-857d-d677b0eb5b80 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61c4cf57-4d0c-4d76-9149-6ea69f80d6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:50 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e5feff43-9a93-4b20-857d-d677b0eb5b80 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d38c6a67-31c8-4d9f-8e70-9aa0cd45a95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:50 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e5feff43-9a93-4b20-857d-d677b0eb5b80 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d38c6a67-31c8-4d9f-8e70-9aa0cd45a95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9fb7043-a8e3-41eb-9a28-86ecaa2807ae', 'volume_name': 'volume-a9fb7043-a8e3-41eb-9a28-86ecaa2807ae', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:50 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e5feff43-9a93-4b20-857d-d677b0eb5b80 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9876f4d-7c41-4bb3-a165-5326c3a2b4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:50 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e5feff43-9a93-4b20-857d-d677b0eb5b80 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9876f4d-7c41-4bb3-a165-5326c3a2b4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:50 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e5feff43-9a93-4b20-857d-d677b0eb5b80 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fcdbefa-2258-489a-bb84-8edbfdac0466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:50 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-e5feff43-9a93-4b20-857d-d677b0eb5b80 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Volume a9fb7043-a8e3-41eb-9a28-86ecaa2807ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9fb7043-a8e3-41eb-9a28-86ecaa2807ae', 'volume_size': 1} Nov 02 12:36:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e5feff43-9a93-4b20-857d-d677b0eb5b80 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:50 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8ba1647b-172c-442e-8678-6c5c2c3458ff tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-319191ee-82b4-4319-ac6e-081310555764 1073741824" returned: 0 in 0.728s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8ba1647b-172c-442e-8678-6c5c2c3458ff tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-319191ee-82b4-4319-ac6e-081310555764 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:50 devstack sudo[101289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-319191ee-82b4-4319-ac6e-081310555764 Nov 02 12:36:50 devstack sudo[101289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:50 devstack sudo[101289]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8ba1647b-172c-442e-8678-6c5c2c3458ff tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-319191ee-82b4-4319-ac6e-081310555764" returned: 0 in 0.300s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:50 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8ba1647b-172c-442e-8678-6c5c2c3458ff tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:36:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8ba1647b-172c-442e-8678-6c5c2c3458ff tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-bc5e07bd-e232-46a8-a06a-5f9ecb8d860f tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.449s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:50 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-bc5e07bd-e232-46a8-a06a-5f9ecb8d860f tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-314575616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57175706-32de-4711-b112-e178b7803ed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='792a0dcbfdc24276b2e36bfd9d381dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:49Z,use_quota=True,user_id='62d1e4de29284a2c9a2337759ea9e611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:36:50 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-bc5e07bd-e232-46a8-a06a-5f9ecb8d860f tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Creating volume 57175706-32de-4711-b112-e178b7803ed8 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:36:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-bc5e07bd-e232-46a8-a06a-5f9ecb8d860f tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-bc5e07bd-e232-46a8-a06a-5f9ecb8d860f tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:50 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-bc5e07bd-e232-46a8-a06a-5f9ecb8d860f tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:50 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-bc5e07bd-e232-46a8-a06a-5f9ecb8d860f tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-bc5e07bd-e232-46a8-a06a-5f9ecb8d860f tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:50 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-bc5e07bd-e232-46a8-a06a-5f9ecb8d860f tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:36:50 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-bc5e07bd-e232-46a8-a06a-5f9ecb8d860f tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:36:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bc5e07bd-e232-46a8-a06a-5f9ecb8d860f tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-57175706-32de-4711-b112-e178b7803ed8 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:50 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8ba1647b-172c-442e-8678-6c5c2c3458ff tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07e50bd9-84c9-4881-a721-d551f92f79e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-319191ee-82b4-4319-ac6e-081310555764', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:50 devstack sudo[101292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-57175706-32de-4711-b112-e178b7803ed8 1073741824 Nov 02 12:36:50 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8ba1647b-172c-442e-8678-6c5c2c3458ff tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257f953c-ec36-4a59-9876-a4f37f6ff75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:50 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:50 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-8ba1647b-172c-442e-8678-6c5c2c3458ff tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Volume volume-319191ee-82b4-4319-ac6e-081310555764 (319191ee-82b4-4319-ac6e-081310555764): created successfully Nov 02 12:36:50 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8ba1647b-172c-442e-8678-6c5c2c3458ff tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257f953c-ec36-4a59-9876-a4f37f6ff75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:50 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8ba1647b-172c-442e-8678-6c5c2c3458ff tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Flow 'volume_create_manager' (c922321e-497c-4b2d-9b77-a57872b9e4cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:50 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-8ba1647b-172c-442e-8678-6c5c2c3458ff tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Created volume successfully. Nov 02 12:36:51 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bc5e07bd-e232-46a8-a06a-5f9ecb8d860f tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-57175706-32de-4711-b112-e178b7803ed8 1073741824" returned: 0 in 0.624s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bc5e07bd-e232-46a8-a06a-5f9ecb8d860f tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-57175706-32de-4711-b112-e178b7803ed8 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:51 devstack sudo[101301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-57175706-32de-4711-b112-e178b7803ed8 Nov 02 12:36:51 devstack sudo[101301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:51 devstack sudo[101301]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bc5e07bd-e232-46a8-a06a-5f9ecb8d860f tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-57175706-32de-4711-b112-e178b7803ed8" returned: 0 in 0.339s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:51 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-bc5e07bd-e232-46a8-a06a-5f9ecb8d860f tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:36:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-bc5e07bd-e232-46a8-a06a-5f9ecb8d860f tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e5feff43-9a93-4b20-857d-d677b0eb5b80 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.798s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:51 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e5feff43-9a93-4b20-857d-d677b0eb5b80 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2130417422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9fb7043-a8e3-41eb-9a28-86ecaa2807ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='792a0dcbfdc24276b2e36bfd9d381dd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:36:50Z,use_quota=True,user_id='62d1e4de29284a2c9a2337759ea9e611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:36:51 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-e5feff43-9a93-4b20-857d-d677b0eb5b80 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Creating volume a9fb7043-a8e3-41eb-9a28-86ecaa2807ae {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:36:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e5feff43-9a93-4b20-857d-d677b0eb5b80 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e5feff43-9a93-4b20-857d-d677b0eb5b80 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:51 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e5feff43-9a93-4b20-857d-d677b0eb5b80 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:51 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e5feff43-9a93-4b20-857d-d677b0eb5b80 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e5feff43-9a93-4b20-857d-d677b0eb5b80 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:51 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e5feff43-9a93-4b20-857d-d677b0eb5b80 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:36:51 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-e5feff43-9a93-4b20-857d-d677b0eb5b80 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:36:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e5feff43-9a93-4b20-857d-d677b0eb5b80 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a9fb7043-a8e3-41eb-9a28-86ecaa2807ae 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bc5e07bd-e232-46a8-a06a-5f9ecb8d860f tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43a9b905-8904-4f97-bf74-64e2e65cf814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57175706-32de-4711-b112-e178b7803ed8', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bc5e07bd-e232-46a8-a06a-5f9ecb8d860f tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (935aaf96-d34b-403e-96dd-a3db87e57403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:51 devstack sudo[101304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a9fb7043-a8e3-41eb-9a28-86ecaa2807ae 1073741824 Nov 02 12:36:51 devstack sudo[101304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:51 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-bc5e07bd-e232-46a8-a06a-5f9ecb8d860f tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Volume volume-57175706-32de-4711-b112-e178b7803ed8 (57175706-32de-4711-b112-e178b7803ed8): created successfully Nov 02 12:36:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bc5e07bd-e232-46a8-a06a-5f9ecb8d860f tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (935aaf96-d34b-403e-96dd-a3db87e57403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bc5e07bd-e232-46a8-a06a-5f9ecb8d860f tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Flow 'volume_create_manager' (d3ff9d3d-52d9-4ed8-8620-bb71a78af088) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:51 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-bc5e07bd-e232-46a8-a06a-5f9ecb8d860f tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Created volume successfully. Nov 02 12:36:52 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-db44d676-00dc-4372-97e0-beb3dda49bf5 req-73762641-4b3d-4719-8f72-83facca886a9 tempest-TestMinimumBasicScenario-762180589 None] Terminate volume connection completed successfully. Nov 02 12:36:52 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-db44d676-00dc-4372-97e0-beb3dda49bf5 req-73762641-4b3d-4719-8f72-83facca886a9 tempest-TestMinimumBasicScenario-762180589 None] Deleting attachment 5b442741-0212-4766-a834-b98e247c1012. {{(pid=86515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:36:52 devstack sudo[101304]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e5feff43-9a93-4b20-857d-d677b0eb5b80 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a9fb7043-a8e3-41eb-9a28-86ecaa2807ae 1073741824" returned: 0 in 0.710s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e5feff43-9a93-4b20-857d-d677b0eb5b80 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a9fb7043-a8e3-41eb-9a28-86ecaa2807ae {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:52 devstack sudo[101314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a9fb7043-a8e3-41eb-9a28-86ecaa2807ae Nov 02 12:36:52 devstack sudo[101314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:52 devstack sudo[101314]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e5feff43-9a93-4b20-857d-d677b0eb5b80 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a9fb7043-a8e3-41eb-9a28-86ecaa2807ae" returned: 0 in 0.343s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:52 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e5feff43-9a93-4b20-857d-d677b0eb5b80 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:36:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e5feff43-9a93-4b20-857d-d677b0eb5b80 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e5feff43-9a93-4b20-857d-d677b0eb5b80 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fcdbefa-2258-489a-bb84-8edbfdac0466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9fb7043-a8e3-41eb-9a28-86ecaa2807ae', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e5feff43-9a93-4b20-857d-d677b0eb5b80 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc42f3b7-8077-437b-aaa3-c0f3e8d366cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:36:53 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-e5feff43-9a93-4b20-857d-d677b0eb5b80 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Volume volume-a9fb7043-a8e3-41eb-9a28-86ecaa2807ae (a9fb7043-a8e3-41eb-9a28-86ecaa2807ae): created successfully Nov 02 12:36:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e5feff43-9a93-4b20-857d-d677b0eb5b80 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc42f3b7-8077-437b-aaa3-c0f3e8d366cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:36:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e5feff43-9a93-4b20-857d-d677b0eb5b80 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Flow 'volume_create_manager' (4e0b819e-def2-4548-98c0-158b3fe53cd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:36:53 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-e5feff43-9a93-4b20-857d-d677b0eb5b80 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Created volume successfully. Nov 02 12:36:53 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-823150c8-7f21-4e7b-a3b5-75c82b136bca tempest-TestMinimumBasicScenario-762180589 None] Acquiring lock "cinder-793c1376-2743-4997-9149-d86dfac8c2ef-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:53 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-823150c8-7f21-4e7b-a3b5-75c82b136bca tempest-TestMinimumBasicScenario-762180589 None] Lock "cinder-793c1376-2743-4997-9149-d86dfac8c2ef-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:53 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-823150c8-7f21-4e7b-a3b5-75c82b136bca tempest-TestMinimumBasicScenario-762180589 None] Acquiring lock "cinder-quobyte-793c1376-2743-4997-9149-d86dfac8c2ef" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:53 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-823150c8-7f21-4e7b-a3b5-75c82b136bca tempest-TestMinimumBasicScenario-762180589 None] Lock "cinder-quobyte-793c1376-2743-4997-9149-d86dfac8c2ef" acquired by "delete_volume" :: waited 0.017s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:53 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23c84fe-c84d-41e4-ae56-cf3e0c204b16]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:36:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-823150c8-7f21-4e7b-a3b5-75c82b136bca tempest-TestMinimumBasicScenario-762180589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-793c1376-2743-4997-9149-d86dfac8c2ef {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:53 devstack sudo[101326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-793c1376-2743-4997-9149-d86dfac8c2ef Nov 02 12:36:53 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:53 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4128d428-6ed7-42cf-a6b7-97037d616275 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Acquiring lock "cinder-a9fb7043-a8e3-41eb-9a28-86ecaa2807ae-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:53 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4128d428-6ed7-42cf-a6b7-97037d616275 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "cinder-a9fb7043-a8e3-41eb-9a28-86ecaa2807ae-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:53 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4128d428-6ed7-42cf-a6b7-97037d616275 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Acquiring lock "cinder-quobyte-a9fb7043-a8e3-41eb-9a28-86ecaa2807ae" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:53 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4128d428-6ed7-42cf-a6b7-97037d616275 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "cinder-quobyte-a9fb7043-a8e3-41eb-9a28-86ecaa2807ae" acquired by "delete_volume" :: waited 0.017s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:53 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33aa983-c73f-4be2-9d41-fc2f3a8e1ec8]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:36:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4128d428-6ed7-42cf-a6b7-97037d616275 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a9fb7043-a8e3-41eb-9a28-86ecaa2807ae {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:53 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-823150c8-7f21-4e7b-a3b5-75c82b136bca tempest-TestMinimumBasicScenario-762180589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-793c1376-2743-4997-9149-d86dfac8c2ef" returned: 0 in 0.468s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-823150c8-7f21-4e7b-a3b5-75c82b136bca tempest-TestMinimumBasicScenario-762180589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-793c1376-2743-4997-9149-d86dfac8c2ef {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:53 devstack sudo[101332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-793c1376-2743-4997-9149-d86dfac8c2ef Nov 02 12:36:53 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:53 devstack sudo[101329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a9fb7043-a8e3-41eb-9a28-86ecaa2807ae Nov 02 12:36:53 devstack sudo[101329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:54 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-823150c8-7f21-4e7b-a3b5-75c82b136bca tempest-TestMinimumBasicScenario-762180589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-793c1376-2743-4997-9149-d86dfac8c2ef" returned: 0 in 0.371s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:54 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-823150c8-7f21-4e7b-a3b5-75c82b136bca tempest-TestMinimumBasicScenario-762180589 None] Lock "cinder-quobyte-793c1376-2743-4997-9149-d86dfac8c2ef" released by "delete_volume" :: held 0.903s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:54 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-823150c8-7f21-4e7b-a3b5-75c82b136bca tempest-TestMinimumBasicScenario-762180589 None] Created reservations ['331b37eb-b53d-43d6-affa-5fd13b6f738b', '2e0d4d6c-0390-470e-8a64-2f37dc4a5345', '7b6870bc-2037-4090-af1c-79f999a070e2', '215ad346-e5e0-43b6-9ad3-5ef8ccfca4aa'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:36:54 devstack sudo[101329]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4128d428-6ed7-42cf-a6b7-97037d616275 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a9fb7043-a8e3-41eb-9a28-86ecaa2807ae" returned: 0 in 0.587s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4128d428-6ed7-42cf-a6b7-97037d616275 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a9fb7043-a8e3-41eb-9a28-86ecaa2807ae {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:54 devstack sudo[101339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a9fb7043-a8e3-41eb-9a28-86ecaa2807ae Nov 02 12:36:54 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-823150c8-7f21-4e7b-a3b5-75c82b136bca tempest-TestMinimumBasicScenario-762180589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-823150c8-7f21-4e7b-a3b5-75c82b136bca tempest-TestMinimumBasicScenario-762180589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-823150c8-7f21-4e7b-a3b5-75c82b136bca tempest-TestMinimumBasicScenario-762180589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-823150c8-7f21-4e7b-a3b5-75c82b136bca tempest-TestMinimumBasicScenario-762180589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-823150c8-7f21-4e7b-a3b5-75c82b136bca tempest-TestMinimumBasicScenario-762180589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-823150c8-7f21-4e7b-a3b5-75c82b136bca tempest-TestMinimumBasicScenario-762180589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:54 devstack sudo[101341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:36:54 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:54 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4128d428-6ed7-42cf-a6b7-97037d616275 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a9fb7043-a8e3-41eb-9a28-86ecaa2807ae" returned: 0 in 0.298s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:54 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4128d428-6ed7-42cf-a6b7-97037d616275 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "cinder-quobyte-a9fb7043-a8e3-41eb-9a28-86ecaa2807ae" released by "delete_volume" :: held 0.944s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:54 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-4128d428-6ed7-42cf-a6b7-97037d616275 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Created reservations ['1bd7b1b0-e417-4e16-b363-8a9c46ffc810', '9cd9e750-967e-4a39-a81f-c679034c977d', 'cd83e48d-a042-406b-8b73-2974122f83ff', '3e3deb61-c02c-4a76-b42b-a7da9e0fb7e3'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:36:54 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-823150c8-7f21-4e7b-a3b5-75c82b136bca tempest-TestMinimumBasicScenario-762180589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.294s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:54 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-823150c8-7f21-4e7b-a3b5-75c82b136bca tempest-TestMinimumBasicScenario-762180589 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:36:54 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-823150c8-7f21-4e7b-a3b5-75c82b136bca tempest-TestMinimumBasicScenario-762180589 None] Deleted volume successfully. Nov 02 12:36:54 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-823150c8-7f21-4e7b-a3b5-75c82b136bca tempest-TestMinimumBasicScenario-762180589 None] Lock "cinder-793c1376-2743-4997-9149-d86dfac8c2ef-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4128d428-6ed7-42cf-a6b7-97037d616275 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4128d428-6ed7-42cf-a6b7-97037d616275 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-4128d428-6ed7-42cf-a6b7-97037d616275 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-4128d428-6ed7-42cf-a6b7-97037d616275 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4128d428-6ed7-42cf-a6b7-97037d616275 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4128d428-6ed7-42cf-a6b7-97037d616275 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:54 devstack sudo[101345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:36:54 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:55 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4128d428-6ed7-42cf-a6b7-97037d616275 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.259s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:55 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-4128d428-6ed7-42cf-a6b7-97037d616275 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:36:55 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-4128d428-6ed7-42cf-a6b7-97037d616275 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Deleted volume successfully. Nov 02 12:36:55 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4128d428-6ed7-42cf-a6b7-97037d616275 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "cinder-a9fb7043-a8e3-41eb-9a28-86ecaa2807ae-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:55 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3e8dc676-fb18-43ce-bfa3-7c7ac05a6e0c tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Acquiring lock "cinder-57175706-32de-4711-b112-e178b7803ed8-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:55 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3e8dc676-fb18-43ce-bfa3-7c7ac05a6e0c tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "cinder-57175706-32de-4711-b112-e178b7803ed8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:55 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3e8dc676-fb18-43ce-bfa3-7c7ac05a6e0c tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Acquiring lock "cinder-quobyte-57175706-32de-4711-b112-e178b7803ed8" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:55 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3e8dc676-fb18-43ce-bfa3-7c7ac05a6e0c tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "cinder-quobyte-57175706-32de-4711-b112-e178b7803ed8" acquired by "delete_volume" :: waited 0.019s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:55 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b93b86b-e099-43b0-997c-19b3cb24a163]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:36:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3e8dc676-fb18-43ce-bfa3-7c7ac05a6e0c tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-57175706-32de-4711-b112-e178b7803ed8 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:56 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-57175706-32de-4711-b112-e178b7803ed8 Nov 02 12:36:56 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:56 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3e8dc676-fb18-43ce-bfa3-7c7ac05a6e0c tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-57175706-32de-4711-b112-e178b7803ed8" returned: 0 in 0.538s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3e8dc676-fb18-43ce-bfa3-7c7ac05a6e0c tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-57175706-32de-4711-b112-e178b7803ed8 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:56 devstack sudo[101375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-57175706-32de-4711-b112-e178b7803ed8 Nov 02 12:36:56 devstack sudo[101375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:56 devstack sudo[101375]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3e8dc676-fb18-43ce-bfa3-7c7ac05a6e0c tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-57175706-32de-4711-b112-e178b7803ed8" returned: 0 in 0.294s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:56 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3e8dc676-fb18-43ce-bfa3-7c7ac05a6e0c tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "cinder-quobyte-57175706-32de-4711-b112-e178b7803ed8" released by "delete_volume" :: held 0.914s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:56 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-3e8dc676-fb18-43ce-bfa3-7c7ac05a6e0c tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Created reservations ['dd7b88aa-52c1-4426-bad6-99da84288624', '5f692dc4-99c6-4f8c-93c8-36e4a3157d2d', '8ec9fe32-0988-4bfb-9fd2-4cf2ddfe7349', '14f53dcb-90fb-43ce-b4be-e342815fabe8'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:36:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3e8dc676-fb18-43ce-bfa3-7c7ac05a6e0c tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3e8dc676-fb18-43ce-bfa3-7c7ac05a6e0c tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:57 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3e8dc676-fb18-43ce-bfa3-7c7ac05a6e0c tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:57 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3e8dc676-fb18-43ce-bfa3-7c7ac05a6e0c tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3e8dc676-fb18-43ce-bfa3-7c7ac05a6e0c tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3e8dc676-fb18-43ce-bfa3-7c7ac05a6e0c tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:57 devstack sudo[101378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:36:57 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:57 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3e8dc676-fb18-43ce-bfa3-7c7ac05a6e0c tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.460s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:57 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-3e8dc676-fb18-43ce-bfa3-7c7ac05a6e0c tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:36:57 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-3e8dc676-fb18-43ce-bfa3-7c7ac05a6e0c tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Deleted volume successfully. Nov 02 12:36:57 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3e8dc676-fb18-43ce-bfa3-7c7ac05a6e0c tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "cinder-57175706-32de-4711-b112-e178b7803ed8-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:58 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0202e3c6-8dc7-41b1-900b-c8daf275b33b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Acquiring lock "cinder-319191ee-82b4-4319-ac6e-081310555764-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:58 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0202e3c6-8dc7-41b1-900b-c8daf275b33b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "cinder-319191ee-82b4-4319-ac6e-081310555764-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:58 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0202e3c6-8dc7-41b1-900b-c8daf275b33b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Acquiring lock "cinder-quobyte-319191ee-82b4-4319-ac6e-081310555764" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:58 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0202e3c6-8dc7-41b1-900b-c8daf275b33b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "cinder-quobyte-319191ee-82b4-4319-ac6e-081310555764" acquired by "delete_volume" :: waited 0.020s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:58 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ca3c5c-cda7-4117-b033-84dd22d1f35a]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:36:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0202e3c6-8dc7-41b1-900b-c8daf275b33b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-319191ee-82b4-4319-ac6e-081310555764 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:58 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-319191ee-82b4-4319-ac6e-081310555764 Nov 02 12:36:58 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:58 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0202e3c6-8dc7-41b1-900b-c8daf275b33b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-319191ee-82b4-4319-ac6e-081310555764" returned: 0 in 0.443s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0202e3c6-8dc7-41b1-900b-c8daf275b33b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-319191ee-82b4-4319-ac6e-081310555764 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:58 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-319191ee-82b4-4319-ac6e-081310555764 Nov 02 12:36:58 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:58 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0202e3c6-8dc7-41b1-900b-c8daf275b33b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-319191ee-82b4-4319-ac6e-081310555764" returned: 0 in 0.291s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0202e3c6-8dc7-41b1-900b-c8daf275b33b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "cinder-quobyte-319191ee-82b4-4319-ac6e-081310555764" released by "delete_volume" :: held 0.793s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:59 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-0202e3c6-8dc7-41b1-900b-c8daf275b33b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Created reservations ['2ecadfec-eb0d-4514-92b9-08ac9f4700b7', '0a7805ca-d243-4b27-aaf2-723bef71be9e', '642b4af4-b241-4654-bfb2-d658ee6d1ecb', '695da2e1-76be-428d-a816-cf4b429a4b90'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:36:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0202e3c6-8dc7-41b1-900b-c8daf275b33b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:36:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0202e3c6-8dc7-41b1-900b-c8daf275b33b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:36:59 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0202e3c6-8dc7-41b1-900b-c8daf275b33b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:36:59 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0202e3c6-8dc7-41b1-900b-c8daf275b33b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:36:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0202e3c6-8dc7-41b1-900b-c8daf275b33b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:36:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0202e3c6-8dc7-41b1-900b-c8daf275b33b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:59 devstack sudo[101391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:36:59 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-bb33cbfa-ac38-4cae-83a0-4772781f0a57 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Acquiring lock "cinder-fcf7edac-a544-4b25-906c-0ff5b5f5dade-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-bb33cbfa-ac38-4cae-83a0-4772781f0a57 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "cinder-fcf7edac-a544-4b25-906c-0ff5b5f5dade-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-bb33cbfa-ac38-4cae-83a0-4772781f0a57 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Acquiring lock "cinder-quobyte-fcf7edac-a544-4b25-906c-0ff5b5f5dade" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:36:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-bb33cbfa-ac38-4cae-83a0-4772781f0a57 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "cinder-quobyte-fcf7edac-a544-4b25-906c-0ff5b5f5dade" acquired by "delete_volume" :: waited 0.024s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:36:59 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e37827f-e738-4b23-90cd-fb26d0de6d07]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:36:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bb33cbfa-ac38-4cae-83a0-4772781f0a57 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-fcf7edac-a544-4b25-906c-0ff5b5f5dade {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:36:59 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0202e3c6-8dc7-41b1-900b-c8daf275b33b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.429s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:59 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-0202e3c6-8dc7-41b1-900b-c8daf275b33b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:36:59 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-0202e3c6-8dc7-41b1-900b-c8daf275b33b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Deleted volume successfully. Nov 02 12:36:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0202e3c6-8dc7-41b1-900b-c8daf275b33b tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "cinder-319191ee-82b4-4319-ac6e-081310555764-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:36:59 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-fcf7edac-a544-4b25-906c-0ff5b5f5dade Nov 02 12:36:59 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:36:59 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Nov 02 12:36:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bb33cbfa-ac38-4cae-83a0-4772781f0a57 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-fcf7edac-a544-4b25-906c-0ff5b5f5dade" returned: 0 in 0.434s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:36:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bb33cbfa-ac38-4cae-83a0-4772781f0a57 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-fcf7edac-a544-4b25-906c-0ff5b5f5dade {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:00 devstack sudo[101399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-fcf7edac-a544-4b25-906c-0ff5b5f5dade Nov 02 12:37:00 devstack sudo[101399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:00 devstack sudo[101399]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bb33cbfa-ac38-4cae-83a0-4772781f0a57 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-fcf7edac-a544-4b25-906c-0ff5b5f5dade" returned: 0 in 0.317s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:00 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-bb33cbfa-ac38-4cae-83a0-4772781f0a57 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "cinder-quobyte-fcf7edac-a544-4b25-906c-0ff5b5f5dade" released by "delete_volume" :: held 0.830s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:00 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-bb33cbfa-ac38-4cae-83a0-4772781f0a57 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Created reservations ['79d2e00c-94a5-41ce-8b10-21f74ab044b8', '8efa84ae-d1fa-40a3-adbe-ebc308333111', 'e30ae05b-1167-4aad-89f5-d999a8e2c406', '1097a66a-86ad-4e0f-b42c-62dc5f592ac4'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:37:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-bb33cbfa-ac38-4cae-83a0-4772781f0a57 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-bb33cbfa-ac38-4cae-83a0-4772781f0a57 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:00 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-bb33cbfa-ac38-4cae-83a0-4772781f0a57 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:00 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-bb33cbfa-ac38-4cae-83a0-4772781f0a57 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-bb33cbfa-ac38-4cae-83a0-4772781f0a57 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bb33cbfa-ac38-4cae-83a0-4772781f0a57 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:00 devstack sudo[101402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:37:00 devstack sudo[101402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:00 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-252abf7c-7712-414e-a926-e9d9efdcccb5 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Acquiring lock "cinder-073bcc4a-b6fe-4b36-9dce-1fa9cf5c14cd-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:00 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-252abf7c-7712-414e-a926-e9d9efdcccb5 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "cinder-073bcc4a-b6fe-4b36-9dce-1fa9cf5c14cd-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:00 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-252abf7c-7712-414e-a926-e9d9efdcccb5 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Acquiring lock "cinder-quobyte-073bcc4a-b6fe-4b36-9dce-1fa9cf5c14cd" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:00 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-252abf7c-7712-414e-a926-e9d9efdcccb5 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "cinder-quobyte-073bcc4a-b6fe-4b36-9dce-1fa9cf5c14cd" acquired by "delete_volume" :: waited 0.019s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:00 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e0e7cc-86e9-4636-90d6-1603f65e7c5f]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:37:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-252abf7c-7712-414e-a926-e9d9efdcccb5 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-073bcc4a-b6fe-4b36-9dce-1fa9cf5c14cd {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:00 devstack sudo[101402]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bb33cbfa-ac38-4cae-83a0-4772781f0a57 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.350s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:00 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-bb33cbfa-ac38-4cae-83a0-4772781f0a57 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:37:00 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-bb33cbfa-ac38-4cae-83a0-4772781f0a57 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Deleted volume successfully. Nov 02 12:37:00 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-bb33cbfa-ac38-4cae-83a0-4772781f0a57 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "cinder-fcf7edac-a544-4b25-906c-0ff5b5f5dade-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:00 devstack sudo[101405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-073bcc4a-b6fe-4b36-9dce-1fa9cf5c14cd Nov 02 12:37:00 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:01 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-252abf7c-7712-414e-a926-e9d9efdcccb5 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-073bcc4a-b6fe-4b36-9dce-1fa9cf5c14cd" returned: 0 in 0.462s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-252abf7c-7712-414e-a926-e9d9efdcccb5 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-073bcc4a-b6fe-4b36-9dce-1fa9cf5c14cd {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:01 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-073bcc4a-b6fe-4b36-9dce-1fa9cf5c14cd Nov 02 12:37:01 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:01 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-252abf7c-7712-414e-a926-e9d9efdcccb5 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-073bcc4a-b6fe-4b36-9dce-1fa9cf5c14cd" returned: 0 in 0.299s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-252abf7c-7712-414e-a926-e9d9efdcccb5 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "cinder-quobyte-073bcc4a-b6fe-4b36-9dce-1fa9cf5c14cd" released by "delete_volume" :: held 0.829s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:01 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-252abf7c-7712-414e-a926-e9d9efdcccb5 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Created reservations ['72dfc596-aec0-42f2-a2f4-bd87018194df', 'dd6516d7-22db-4f03-80b5-e2edf1654897', 'c2eb145d-5d3c-4c10-8ede-650a89896815', '3a8cb448-f256-4524-90a6-914bde21e0ee'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:37:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-252abf7c-7712-414e-a926-e9d9efdcccb5 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-252abf7c-7712-414e-a926-e9d9efdcccb5 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:01 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-252abf7c-7712-414e-a926-e9d9efdcccb5 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:01 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-252abf7c-7712-414e-a926-e9d9efdcccb5 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-252abf7c-7712-414e-a926-e9d9efdcccb5 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-252abf7c-7712-414e-a926-e9d9efdcccb5 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:01 devstack sudo[101415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:37:01 devstack sudo[101415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3b258516-eece-4cd9-986d-fa324dc13df2 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Acquiring lock "cinder-049a5375-b07e-476b-812a-8af80b707218-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3b258516-eece-4cd9-986d-fa324dc13df2 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "cinder-049a5375-b07e-476b-812a-8af80b707218-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:02 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3b258516-eece-4cd9-986d-fa324dc13df2 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Acquiring lock "cinder-quobyte-049a5375-b07e-476b-812a-8af80b707218" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:02 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3b258516-eece-4cd9-986d-fa324dc13df2 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "cinder-quobyte-049a5375-b07e-476b-812a-8af80b707218" acquired by "delete_volume" :: waited 0.027s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:02 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b52c6f9-d296-46f8-b7c3-a4c39fb7c84e]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:37:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3b258516-eece-4cd9-986d-fa324dc13df2 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-049a5375-b07e-476b-812a-8af80b707218 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:02 devstack sudo[101415]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-252abf7c-7712-414e-a926-e9d9efdcccb5 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.379s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:02 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-252abf7c-7712-414e-a926-e9d9efdcccb5 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:37:02 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-252abf7c-7712-414e-a926-e9d9efdcccb5 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Deleted volume successfully. Nov 02 12:37:02 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-252abf7c-7712-414e-a926-e9d9efdcccb5 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "cinder-073bcc4a-b6fe-4b36-9dce-1fa9cf5c14cd-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:02 devstack sudo[101418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-049a5375-b07e-476b-812a-8af80b707218 Nov 02 12:37:02 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:02 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3b258516-eece-4cd9-986d-fa324dc13df2 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-049a5375-b07e-476b-812a-8af80b707218" returned: 0 in 0.559s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3b258516-eece-4cd9-986d-fa324dc13df2 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-049a5375-b07e-476b-812a-8af80b707218 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:02 devstack sudo[101424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-049a5375-b07e-476b-812a-8af80b707218 Nov 02 12:37:02 devstack sudo[101424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:02 devstack sudo[101424]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3b258516-eece-4cd9-986d-fa324dc13df2 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-049a5375-b07e-476b-812a-8af80b707218" returned: 0 in 0.289s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:02 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3b258516-eece-4cd9-986d-fa324dc13df2 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "cinder-quobyte-049a5375-b07e-476b-812a-8af80b707218" released by "delete_volume" :: held 0.931s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:03 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-3b258516-eece-4cd9-986d-fa324dc13df2 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Created reservations ['98f47323-8238-46c5-be8a-90ecdfb1f723', '752dd683-2ac7-4055-a84c-b6186290fb28', 'c2cbaa7b-2d33-4a59-9946-3e483cf127d5', 'a3c1cb56-a2f2-4000-b1eb-1367a5cbc7b0'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:37:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3b258516-eece-4cd9-986d-fa324dc13df2 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3b258516-eece-4cd9-986d-fa324dc13df2 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:03 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3b258516-eece-4cd9-986d-fa324dc13df2 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:03 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3b258516-eece-4cd9-986d-fa324dc13df2 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3b258516-eece-4cd9-986d-fa324dc13df2 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3b258516-eece-4cd9-986d-fa324dc13df2 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:03 devstack sudo[101427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:37:03 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:03 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3b258516-eece-4cd9-986d-fa324dc13df2 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.285s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:03 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-3b258516-eece-4cd9-986d-fa324dc13df2 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:37:03 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-3b258516-eece-4cd9-986d-fa324dc13df2 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Deleted volume successfully. Nov 02 12:37:03 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3b258516-eece-4cd9-986d-fa324dc13df2 tempest-CreateVolumesFromSourceVolumeTest-2035614485 None] Lock "cinder-049a5375-b07e-476b-812a-8af80b707218-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:13 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=40,cinder:INSERT=21,cinder:UPDATE=74,cinder:DELETE=5 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:37:13 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:UPDATE=65,cinder:SELECT=47,cinder:DELETE=7,cinder:INSERT=12 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:37:15 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6ca654c-2942-4d1f-8ee6-ebb008f4b68e tempest-ProjectReaderTests-129040540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:37:15 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b6ca654c-2942-4d1f-8ee6-ebb008f4b68e tempest-ProjectReaderTests-129040540 None] Flow 'volume_create_manager' (7bc929f0-95ab-411f-9bfa-be794cbb7c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:15 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b6ca654c-2942-4d1f-8ee6-ebb008f4b68e tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (653e32bb-c8d7-41d0-aa03-33e97ebd1bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:15 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b6ca654c-2942-4d1f-8ee6-ebb008f4b68e tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (653e32bb-c8d7-41d0-aa03-33e97ebd1bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1573993183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0743a436-b92d-472c-8103-d146467def8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd11f8bae905497a84b38034277bec03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:16Z,use_quota=True,user_id='ee17b5fed2d04524aae3bd01a8f5d667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:15 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b6ca654c-2942-4d1f-8ee6-ebb008f4b68e tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a36227-b27f-4f99-9464-fe25654dff77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:15 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b6ca654c-2942-4d1f-8ee6-ebb008f4b68e tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a36227-b27f-4f99-9464-fe25654dff77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:15 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b6ca654c-2942-4d1f-8ee6-ebb008f4b68e tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d293f1e9-8fcd-4685-9d51-70cde4aee28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:15 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b6ca654c-2942-4d1f-8ee6-ebb008f4b68e tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d293f1e9-8fcd-4685-9d51-70cde4aee28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0743a436-b92d-472c-8103-d146467def8b', 'volume_name': 'volume-0743a436-b92d-472c-8103-d146467def8b', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:15 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b6ca654c-2942-4d1f-8ee6-ebb008f4b68e tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab8fe012-af43-49ff-9568-7671cc7d6b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:15 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b6ca654c-2942-4d1f-8ee6-ebb008f4b68e tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab8fe012-af43-49ff-9568-7671cc7d6b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:15 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b6ca654c-2942-4d1f-8ee6-ebb008f4b68e tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa4043a-28b8-45da-8c23-37412fbb5298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:15 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-b6ca654c-2942-4d1f-8ee6-ebb008f4b68e tempest-ProjectReaderTests-129040540 None] Volume 0743a436-b92d-472c-8103-d146467def8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0743a436-b92d-472c-8103-d146467def8b', 'volume_size': 1} Nov 02 12:37:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b6ca654c-2942-4d1f-8ee6-ebb008f4b68e tempest-ProjectReaderTests-129040540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b6ca654c-2942-4d1f-8ee6-ebb008f4b68e tempest-ProjectReaderTests-129040540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:16 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b6ca654c-2942-4d1f-8ee6-ebb008f4b68e tempest-ProjectReaderTests-129040540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1573993183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0743a436-b92d-472c-8103-d146467def8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd11f8bae905497a84b38034277bec03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:16Z,use_quota=True,user_id='ee17b5fed2d04524aae3bd01a8f5d667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:37:16 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-b6ca654c-2942-4d1f-8ee6-ebb008f4b68e tempest-ProjectReaderTests-129040540 None] Creating volume 0743a436-b92d-472c-8103-d146467def8b {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:37:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b6ca654c-2942-4d1f-8ee6-ebb008f4b68e tempest-ProjectReaderTests-129040540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b6ca654c-2942-4d1f-8ee6-ebb008f4b68e tempest-ProjectReaderTests-129040540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:16 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b6ca654c-2942-4d1f-8ee6-ebb008f4b68e tempest-ProjectReaderTests-129040540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:16 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b6ca654c-2942-4d1f-8ee6-ebb008f4b68e tempest-ProjectReaderTests-129040540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b6ca654c-2942-4d1f-8ee6-ebb008f4b68e tempest-ProjectReaderTests-129040540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:16 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b6ca654c-2942-4d1f-8ee6-ebb008f4b68e tempest-ProjectReaderTests-129040540 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:37:16 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-b6ca654c-2942-4d1f-8ee6-ebb008f4b68e tempest-ProjectReaderTests-129040540 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:37:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6ca654c-2942-4d1f-8ee6-ebb008f4b68e tempest-ProjectReaderTests-129040540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0743a436-b92d-472c-8103-d146467def8b 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:16 devstack sudo[101453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0743a436-b92d-472c-8103-d146467def8b 1073741824 Nov 02 12:37:16 devstack sudo[101453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:16 devstack sudo[101453]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6ca654c-2942-4d1f-8ee6-ebb008f4b68e tempest-ProjectReaderTests-129040540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0743a436-b92d-472c-8103-d146467def8b 1073741824" returned: 0 in 0.593s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6ca654c-2942-4d1f-8ee6-ebb008f4b68e tempest-ProjectReaderTests-129040540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0743a436-b92d-472c-8103-d146467def8b {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:16 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0743a436-b92d-472c-8103-d146467def8b Nov 02 12:37:16 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:16 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6ca654c-2942-4d1f-8ee6-ebb008f4b68e tempest-ProjectReaderTests-129040540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0743a436-b92d-472c-8103-d146467def8b" returned: 0 in 0.275s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:16 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b6ca654c-2942-4d1f-8ee6-ebb008f4b68e tempest-ProjectReaderTests-129040540 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:37:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b6ca654c-2942-4d1f-8ee6-ebb008f4b68e tempest-ProjectReaderTests-129040540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:16 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b6ca654c-2942-4d1f-8ee6-ebb008f4b68e tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa4043a-28b8-45da-8c23-37412fbb5298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0743a436-b92d-472c-8103-d146467def8b', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:16 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b6ca654c-2942-4d1f-8ee6-ebb008f4b68e tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0331fe61-543f-4c38-862e-1d859a9b0f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:16 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-b6ca654c-2942-4d1f-8ee6-ebb008f4b68e tempest-ProjectReaderTests-129040540 None] Volume volume-0743a436-b92d-472c-8103-d146467def8b (0743a436-b92d-472c-8103-d146467def8b): created successfully Nov 02 12:37:16 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b6ca654c-2942-4d1f-8ee6-ebb008f4b68e tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0331fe61-543f-4c38-862e-1d859a9b0f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:16 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b6ca654c-2942-4d1f-8ee6-ebb008f4b68e tempest-ProjectReaderTests-129040540 None] Flow 'volume_create_manager' (7bc929f0-95ab-411f-9bfa-be794cbb7c21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:16 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-b6ca654c-2942-4d1f-8ee6-ebb008f4b68e tempest-ProjectReaderTests-129040540 None] Created volume successfully. Nov 02 12:37:18 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b5adf24b-09c2-4699-8edb-72b0083b3be7 tempest-ProjectReaderTests-129040540 None] Acquiring lock "cinder-0743a436-b92d-472c-8103-d146467def8b-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:18 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b5adf24b-09c2-4699-8edb-72b0083b3be7 tempest-ProjectReaderTests-129040540 None] Lock "cinder-0743a436-b92d-472c-8103-d146467def8b-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:18 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b5adf24b-09c2-4699-8edb-72b0083b3be7 tempest-ProjectReaderTests-129040540 None] Acquiring lock "cinder-quobyte-0743a436-b92d-472c-8103-d146467def8b" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:18 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b5adf24b-09c2-4699-8edb-72b0083b3be7 tempest-ProjectReaderTests-129040540 None] Lock "cinder-quobyte-0743a436-b92d-472c-8103-d146467def8b" acquired by "delete_volume" :: waited 0.026s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:18 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[34040efd-87b5-467d-b8d5-2b3882d3664b]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:37:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b5adf24b-09c2-4699-8edb-72b0083b3be7 tempest-ProjectReaderTests-129040540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0743a436-b92d-472c-8103-d146467def8b {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:19 devstack sudo[101525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0743a436-b92d-472c-8103-d146467def8b Nov 02 12:37:19 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:19 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b5adf24b-09c2-4699-8edb-72b0083b3be7 tempest-ProjectReaderTests-129040540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0743a436-b92d-472c-8103-d146467def8b" returned: 0 in 0.548s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b5adf24b-09c2-4699-8edb-72b0083b3be7 tempest-ProjectReaderTests-129040540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0743a436-b92d-472c-8103-d146467def8b {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:19 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0743a436-b92d-472c-8103-d146467def8b Nov 02 12:37:19 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:19 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b5adf24b-09c2-4699-8edb-72b0083b3be7 tempest-ProjectReaderTests-129040540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0743a436-b92d-472c-8103-d146467def8b" returned: 0 in 0.333s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:19 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b5adf24b-09c2-4699-8edb-72b0083b3be7 tempest-ProjectReaderTests-129040540 None] Lock "cinder-quobyte-0743a436-b92d-472c-8103-d146467def8b" released by "delete_volume" :: held 0.993s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:19 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-b5adf24b-09c2-4699-8edb-72b0083b3be7 tempest-ProjectReaderTests-129040540 None] Created reservations ['2485cef4-a3db-4cc6-921c-e36e7a89db0c', 'a65c4c3d-95cf-4047-9bd4-37e8496d5dd8', '86d39c38-bfc0-4e51-8176-a1bcad3a68a7', '82a3d7f7-fa74-4401-be1a-1858a2ca8125'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:37:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b5adf24b-09c2-4699-8edb-72b0083b3be7 tempest-ProjectReaderTests-129040540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b5adf24b-09c2-4699-8edb-72b0083b3be7 tempest-ProjectReaderTests-129040540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b5adf24b-09c2-4699-8edb-72b0083b3be7 tempest-ProjectReaderTests-129040540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b5adf24b-09c2-4699-8edb-72b0083b3be7 tempest-ProjectReaderTests-129040540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b5adf24b-09c2-4699-8edb-72b0083b3be7 tempest-ProjectReaderTests-129040540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b5adf24b-09c2-4699-8edb-72b0083b3be7 tempest-ProjectReaderTests-129040540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:20 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:37:20 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:20 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b5adf24b-09c2-4699-8edb-72b0083b3be7 tempest-ProjectReaderTests-129040540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.340s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:20 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-b5adf24b-09c2-4699-8edb-72b0083b3be7 tempest-ProjectReaderTests-129040540 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:37:20 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-b5adf24b-09c2-4699-8edb-72b0083b3be7 tempest-ProjectReaderTests-129040540 None] Deleted volume successfully. Nov 02 12:37:20 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b5adf24b-09c2-4699-8edb-72b0083b3be7 tempest-ProjectReaderTests-129040540 None] Lock "cinder-0743a436-b92d-472c-8103-d146467def8b-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:21 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc8b724b-e1b8-4c03-80fa-6f88160eaef7 tempest-VolumesActionsTest-532219026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:37:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bc8b724b-e1b8-4c03-80fa-6f88160eaef7 tempest-VolumesActionsTest-532219026 None] Flow 'volume_create_manager' (b06e2c7d-be10-46b3-a81c-cbea80578a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bc8b724b-e1b8-4c03-80fa-6f88160eaef7 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48ad9cda-6029-46e7-846c-5931be8adccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bc8b724b-e1b8-4c03-80fa-6f88160eaef7 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48ad9cda-6029-46e7-846c-5931be8adccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-536696222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ebbaa1d-d2ce-4876-8609-af1232ccbba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5091079442c4a4ab610d755438c5448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:21Z,use_quota=True,user_id='c431e1f5074f4e54b37ce024ccbba5fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bc8b724b-e1b8-4c03-80fa-6f88160eaef7 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2d1d355-869d-4deb-96e2-502547b5ed27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bc8b724b-e1b8-4c03-80fa-6f88160eaef7 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2d1d355-869d-4deb-96e2-502547b5ed27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bc8b724b-e1b8-4c03-80fa-6f88160eaef7 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f7154ec-860b-42f2-84f0-ee6b10fd74c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bc8b724b-e1b8-4c03-80fa-6f88160eaef7 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f7154ec-860b-42f2-84f0-ee6b10fd74c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ebbaa1d-d2ce-4876-8609-af1232ccbba5', 'volume_name': 'volume-4ebbaa1d-d2ce-4876-8609-af1232ccbba5', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bc8b724b-e1b8-4c03-80fa-6f88160eaef7 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25c30483-74e0-4273-a2a2-954f86a441d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bc8b724b-e1b8-4c03-80fa-6f88160eaef7 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25c30483-74e0-4273-a2a2-954f86a441d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bc8b724b-e1b8-4c03-80fa-6f88160eaef7 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e8d9c72-4b81-4461-a78b-1b5b8534f8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:21 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-bc8b724b-e1b8-4c03-80fa-6f88160eaef7 tempest-VolumesActionsTest-532219026 None] Volume 4ebbaa1d-d2ce-4876-8609-af1232ccbba5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ebbaa1d-d2ce-4876-8609-af1232ccbba5', 'volume_size': 1} Nov 02 12:37:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-bc8b724b-e1b8-4c03-80fa-6f88160eaef7 tempest-VolumesActionsTest-532219026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-bc8b724b-e1b8-4c03-80fa-6f88160eaef7 tempest-VolumesActionsTest-532219026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:21 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-bc8b724b-e1b8-4c03-80fa-6f88160eaef7 tempest-VolumesActionsTest-532219026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-536696222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ebbaa1d-d2ce-4876-8609-af1232ccbba5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5091079442c4a4ab610d755438c5448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:21Z,use_quota=True,user_id='c431e1f5074f4e54b37ce024ccbba5fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:37:21 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-bc8b724b-e1b8-4c03-80fa-6f88160eaef7 tempest-VolumesActionsTest-532219026 None] Creating volume 4ebbaa1d-d2ce-4876-8609-af1232ccbba5 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:37:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-bc8b724b-e1b8-4c03-80fa-6f88160eaef7 tempest-VolumesActionsTest-532219026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-bc8b724b-e1b8-4c03-80fa-6f88160eaef7 tempest-VolumesActionsTest-532219026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:21 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-bc8b724b-e1b8-4c03-80fa-6f88160eaef7 tempest-VolumesActionsTest-532219026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:21 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-bc8b724b-e1b8-4c03-80fa-6f88160eaef7 tempest-VolumesActionsTest-532219026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-bc8b724b-e1b8-4c03-80fa-6f88160eaef7 tempest-VolumesActionsTest-532219026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:21 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-bc8b724b-e1b8-4c03-80fa-6f88160eaef7 tempest-VolumesActionsTest-532219026 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:37:21 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-bc8b724b-e1b8-4c03-80fa-6f88160eaef7 tempest-VolumesActionsTest-532219026 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:37:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bc8b724b-e1b8-4c03-80fa-6f88160eaef7 tempest-VolumesActionsTest-532219026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4ebbaa1d-d2ce-4876-8609-af1232ccbba5 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:21 devstack sudo[101544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4ebbaa1d-d2ce-4876-8609-af1232ccbba5 1073741824 Nov 02 12:37:21 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:21 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-957e6e28-0c61-4073-8fcb-da2cda555b78 tempest-ProjectReaderTests-129040540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:37:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-957e6e28-0c61-4073-8fcb-da2cda555b78 tempest-ProjectReaderTests-129040540 None] Flow 'volume_create_manager' (9baa33b7-0970-430d-ac98-b83c2cbfa1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-957e6e28-0c61-4073-8fcb-da2cda555b78 tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9fb04d5-a1b3-4df2-a584-e920fe1eae1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-957e6e28-0c61-4073-8fcb-da2cda555b78 tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9fb04d5-a1b3-4df2-a584-e920fe1eae1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-324080902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de0fc62f-7cf7-4bd2-9d85-c494fd081b9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd11f8bae905497a84b38034277bec03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:22Z,use_quota=True,user_id='ee17b5fed2d04524aae3bd01a8f5d667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-957e6e28-0c61-4073-8fcb-da2cda555b78 tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27348123-7b56-451c-aa68-ff947bb7e4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-957e6e28-0c61-4073-8fcb-da2cda555b78 tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27348123-7b56-451c-aa68-ff947bb7e4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-957e6e28-0c61-4073-8fcb-da2cda555b78 tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4775324c-003d-4b22-b518-44069941f177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-957e6e28-0c61-4073-8fcb-da2cda555b78 tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4775324c-003d-4b22-b518-44069941f177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de0fc62f-7cf7-4bd2-9d85-c494fd081b9f', 'volume_name': 'volume-de0fc62f-7cf7-4bd2-9d85-c494fd081b9f', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-957e6e28-0c61-4073-8fcb-da2cda555b78 tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (853f919c-3442-45b6-b55a-3960b8fcc3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-957e6e28-0c61-4073-8fcb-da2cda555b78 tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (853f919c-3442-45b6-b55a-3960b8fcc3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:22 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-957e6e28-0c61-4073-8fcb-da2cda555b78 tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f11413ff-a457-4e27-80d8-296745c6cffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:22 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-957e6e28-0c61-4073-8fcb-da2cda555b78 tempest-ProjectReaderTests-129040540 None] Volume de0fc62f-7cf7-4bd2-9d85-c494fd081b9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de0fc62f-7cf7-4bd2-9d85-c494fd081b9f', 'volume_size': 1} Nov 02 12:37:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-957e6e28-0c61-4073-8fcb-da2cda555b78 tempest-ProjectReaderTests-129040540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:22 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bc8b724b-e1b8-4c03-80fa-6f88160eaef7 tempest-VolumesActionsTest-532219026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4ebbaa1d-d2ce-4876-8609-af1232ccbba5 1073741824" returned: 0 in 0.581s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bc8b724b-e1b8-4c03-80fa-6f88160eaef7 tempest-VolumesActionsTest-532219026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4ebbaa1d-d2ce-4876-8609-af1232ccbba5 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:22 devstack sudo[101550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4ebbaa1d-d2ce-4876-8609-af1232ccbba5 Nov 02 12:37:22 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:22 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bc8b724b-e1b8-4c03-80fa-6f88160eaef7 tempest-VolumesActionsTest-532219026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4ebbaa1d-d2ce-4876-8609-af1232ccbba5" returned: 0 in 0.348s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:22 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-bc8b724b-e1b8-4c03-80fa-6f88160eaef7 tempest-VolumesActionsTest-532219026 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:37:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-bc8b724b-e1b8-4c03-80fa-6f88160eaef7 tempest-VolumesActionsTest-532219026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-957e6e28-0c61-4073-8fcb-da2cda555b78 tempest-ProjectReaderTests-129040540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.531s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:22 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-957e6e28-0c61-4073-8fcb-da2cda555b78 tempest-ProjectReaderTests-129040540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-324080902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de0fc62f-7cf7-4bd2-9d85-c494fd081b9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd11f8bae905497a84b38034277bec03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:22Z,use_quota=True,user_id='ee17b5fed2d04524aae3bd01a8f5d667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:37:22 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-957e6e28-0c61-4073-8fcb-da2cda555b78 tempest-ProjectReaderTests-129040540 None] Creating volume de0fc62f-7cf7-4bd2-9d85-c494fd081b9f {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:37:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-957e6e28-0c61-4073-8fcb-da2cda555b78 tempest-ProjectReaderTests-129040540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-957e6e28-0c61-4073-8fcb-da2cda555b78 tempest-ProjectReaderTests-129040540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:22 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-957e6e28-0c61-4073-8fcb-da2cda555b78 tempest-ProjectReaderTests-129040540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:22 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-957e6e28-0c61-4073-8fcb-da2cda555b78 tempest-ProjectReaderTests-129040540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-957e6e28-0c61-4073-8fcb-da2cda555b78 tempest-ProjectReaderTests-129040540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:22 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-957e6e28-0c61-4073-8fcb-da2cda555b78 tempest-ProjectReaderTests-129040540 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:37:22 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-957e6e28-0c61-4073-8fcb-da2cda555b78 tempest-ProjectReaderTests-129040540 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:37:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-957e6e28-0c61-4073-8fcb-da2cda555b78 tempest-ProjectReaderTests-129040540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-de0fc62f-7cf7-4bd2-9d85-c494fd081b9f 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:22 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bc8b724b-e1b8-4c03-80fa-6f88160eaef7 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e8d9c72-4b81-4461-a78b-1b5b8534f8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ebbaa1d-d2ce-4876-8609-af1232ccbba5', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:22 devstack sudo[101553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-de0fc62f-7cf7-4bd2-9d85-c494fd081b9f 1073741824 Nov 02 12:37:22 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:22 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bc8b724b-e1b8-4c03-80fa-6f88160eaef7 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b99b667-ffd3-4c0a-a10a-f3b0c9fede02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:22 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-bc8b724b-e1b8-4c03-80fa-6f88160eaef7 tempest-VolumesActionsTest-532219026 None] Volume volume-4ebbaa1d-d2ce-4876-8609-af1232ccbba5 (4ebbaa1d-d2ce-4876-8609-af1232ccbba5): created successfully Nov 02 12:37:22 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bc8b724b-e1b8-4c03-80fa-6f88160eaef7 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b99b667-ffd3-4c0a-a10a-f3b0c9fede02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:22 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-bc8b724b-e1b8-4c03-80fa-6f88160eaef7 tempest-VolumesActionsTest-532219026 None] Flow 'volume_create_manager' (b06e2c7d-be10-46b3-a81c-cbea80578a3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:22 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-bc8b724b-e1b8-4c03-80fa-6f88160eaef7 tempest-VolumesActionsTest-532219026 None] Created volume successfully. Nov 02 12:37:23 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-957e6e28-0c61-4073-8fcb-da2cda555b78 tempest-ProjectReaderTests-129040540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-de0fc62f-7cf7-4bd2-9d85-c494fd081b9f 1073741824" returned: 0 in 0.536s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-957e6e28-0c61-4073-8fcb-da2cda555b78 tempest-ProjectReaderTests-129040540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-de0fc62f-7cf7-4bd2-9d85-c494fd081b9f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:23 devstack sudo[101559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-de0fc62f-7cf7-4bd2-9d85-c494fd081b9f Nov 02 12:37:23 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:23 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-957e6e28-0c61-4073-8fcb-da2cda555b78 tempest-ProjectReaderTests-129040540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-de0fc62f-7cf7-4bd2-9d85-c494fd081b9f" returned: 0 in 0.302s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:23 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-957e6e28-0c61-4073-8fcb-da2cda555b78 tempest-ProjectReaderTests-129040540 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:37:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-957e6e28-0c61-4073-8fcb-da2cda555b78 tempest-ProjectReaderTests-129040540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:23 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-957e6e28-0c61-4073-8fcb-da2cda555b78 tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f11413ff-a457-4e27-80d8-296745c6cffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de0fc62f-7cf7-4bd2-9d85-c494fd081b9f', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:23 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-957e6e28-0c61-4073-8fcb-da2cda555b78 tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d6c151e-4697-40b7-95a2-5001ae88d0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:23 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-957e6e28-0c61-4073-8fcb-da2cda555b78 tempest-ProjectReaderTests-129040540 None] Volume volume-de0fc62f-7cf7-4bd2-9d85-c494fd081b9f (de0fc62f-7cf7-4bd2-9d85-c494fd081b9f): created successfully Nov 02 12:37:23 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-957e6e28-0c61-4073-8fcb-da2cda555b78 tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d6c151e-4697-40b7-95a2-5001ae88d0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:23 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-957e6e28-0c61-4073-8fcb-da2cda555b78 tempest-ProjectReaderTests-129040540 None] Flow 'volume_create_manager' (9baa33b7-0970-430d-ac98-b83c2cbfa1c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:23 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-957e6e28-0c61-4073-8fcb-da2cda555b78 tempest-ProjectReaderTests-129040540 None] Created volume successfully. Nov 02 12:37:23 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d1e3e4a1-99b1-4e0e-85b7-643665f78c8f tempest-VolumesActionsTest-532219026 None] Acquiring lock "cinder-4ebbaa1d-d2ce-4876-8609-af1232ccbba5" by "attach_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:23 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d1e3e4a1-99b1-4e0e-85b7-643665f78c8f tempest-VolumesActionsTest-532219026 None] Lock "cinder-4ebbaa1d-d2ce-4876-8609-af1232ccbba5" acquired by "attach_volume" :: waited 0.021s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:23 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-d1e3e4a1-99b1-4e0e-85b7-643665f78c8f tempest-VolumesActionsTest-532219026 None] Attaching volume 4ebbaa1d-d2ce-4876-8609-af1232ccbba5 to instance 01985e86-3620-417a-b967-09bf3d3be6cf at mountpoint /dev/vdb on host None. Nov 02 12:37:23 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-d1e3e4a1-99b1-4e0e-85b7-643665f78c8f tempest-VolumesActionsTest-532219026 None] Attach volume completed successfully. Nov 02 12:37:23 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d1e3e4a1-99b1-4e0e-85b7-643665f78c8f tempest-VolumesActionsTest-532219026 None] Lock "cinder-4ebbaa1d-d2ce-4876-8609-af1232ccbba5" released by "attach_volume" :: held 0.089s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:24 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7a269c16-6204-4c2c-8303-6582f4913eb3 tempest-ProjectReaderTests-129040540 None] Acquiring lock "cinder-de0fc62f-7cf7-4bd2-9d85-c494fd081b9f-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:24 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7a269c16-6204-4c2c-8303-6582f4913eb3 tempest-ProjectReaderTests-129040540 None] Lock "cinder-de0fc62f-7cf7-4bd2-9d85-c494fd081b9f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:24 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7a269c16-6204-4c2c-8303-6582f4913eb3 tempest-ProjectReaderTests-129040540 None] Acquiring lock "cinder-quobyte-de0fc62f-7cf7-4bd2-9d85-c494fd081b9f" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:24 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7a269c16-6204-4c2c-8303-6582f4913eb3 tempest-ProjectReaderTests-129040540 None] Lock "cinder-quobyte-de0fc62f-7cf7-4bd2-9d85-c494fd081b9f" acquired by "delete_volume" :: waited 0.027s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:24 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cfc974-ba9d-49e9-a99d-0e532b71212d]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:37:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7a269c16-6204-4c2c-8303-6582f4913eb3 tempest-ProjectReaderTests-129040540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-de0fc62f-7cf7-4bd2-9d85-c494fd081b9f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:24 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-de0fc62f-7cf7-4bd2-9d85-c494fd081b9f Nov 02 12:37:24 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:24 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7a269c16-6204-4c2c-8303-6582f4913eb3 tempest-ProjectReaderTests-129040540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-de0fc62f-7cf7-4bd2-9d85-c494fd081b9f" returned: 0 in 0.471s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7a269c16-6204-4c2c-8303-6582f4913eb3 tempest-ProjectReaderTests-129040540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-de0fc62f-7cf7-4bd2-9d85-c494fd081b9f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:24 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-744f8934-2c91-46cb-a1b0-80c40f82c959 tempest-VolumesActionsTest-909889282 None] Terminate volume connection completed successfully. Nov 02 12:37:24 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-de0fc62f-7cf7-4bd2-9d85-c494fd081b9f Nov 02 12:37:24 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:24 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-744f8934-2c91-46cb-a1b0-80c40f82c959 tempest-VolumesActionsTest-909889282 None] Acquiring lock "cinder-4ebbaa1d-d2ce-4876-8609-af1232ccbba5-detach_volume" by "detach_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:24 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-744f8934-2c91-46cb-a1b0-80c40f82c959 tempest-VolumesActionsTest-909889282 None] Lock "cinder-4ebbaa1d-d2ce-4876-8609-af1232ccbba5-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:24 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-744f8934-2c91-46cb-a1b0-80c40f82c959 tempest-VolumesActionsTest-909889282 None] Detaching volume 4ebbaa1d-d2ce-4876-8609-af1232ccbba5 from instance 01985e86-3620-417a-b967-09bf3d3be6cf. Nov 02 12:37:24 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-744f8934-2c91-46cb-a1b0-80c40f82c959 tempest-VolumesActionsTest-909889282 None] Detach volume completed successfully. Nov 02 12:37:24 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-744f8934-2c91-46cb-a1b0-80c40f82c959 tempest-VolumesActionsTest-909889282 None] Lock "cinder-4ebbaa1d-d2ce-4876-8609-af1232ccbba5-detach_volume" released by "detach_volume" :: held 0.077s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:25 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7a269c16-6204-4c2c-8303-6582f4913eb3 tempest-ProjectReaderTests-129040540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-de0fc62f-7cf7-4bd2-9d85-c494fd081b9f" returned: 0 in 0.332s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:25 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7a269c16-6204-4c2c-8303-6582f4913eb3 tempest-ProjectReaderTests-129040540 None] Lock "cinder-quobyte-de0fc62f-7cf7-4bd2-9d85-c494fd081b9f" released by "delete_volume" :: held 0.871s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:25 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-7a269c16-6204-4c2c-8303-6582f4913eb3 tempest-ProjectReaderTests-129040540 None] Created reservations ['c7486a94-2dad-4687-a1e4-e2b22c1b6295', 'ad982644-2b26-450d-80c7-4d528dff5f26', '4b93375e-5358-4c13-bc54-9b1ac63515d9', 'd53892a4-cd55-44dc-ab5c-16d51510c26c'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:37:25 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8e767486-ec20-484b-8c0e-a653613c1dd5 tempest-VolumesActionsTest-532219026 None] Acquiring lock "cinder-4ebbaa1d-d2ce-4876-8609-af1232ccbba5-detach_volume" by "detach_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:25 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8e767486-ec20-484b-8c0e-a653613c1dd5 tempest-VolumesActionsTest-532219026 None] Lock "cinder-4ebbaa1d-d2ce-4876-8609-af1232ccbba5-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:25 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-8e767486-ec20-484b-8c0e-a653613c1dd5 tempest-VolumesActionsTest-532219026 None] Volume detach called, but volume not attached. Nov 02 12:37:25 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8e767486-ec20-484b-8c0e-a653613c1dd5 tempest-VolumesActionsTest-532219026 None] Lock "cinder-4ebbaa1d-d2ce-4876-8609-af1232ccbba5-detach_volume" released by "detach_volume" :: held 0.030s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7a269c16-6204-4c2c-8303-6582f4913eb3 tempest-ProjectReaderTests-129040540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7a269c16-6204-4c2c-8303-6582f4913eb3 tempest-ProjectReaderTests-129040540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:25 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-7a269c16-6204-4c2c-8303-6582f4913eb3 tempest-ProjectReaderTests-129040540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:25 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-7a269c16-6204-4c2c-8303-6582f4913eb3 tempest-ProjectReaderTests-129040540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7a269c16-6204-4c2c-8303-6582f4913eb3 tempest-ProjectReaderTests-129040540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7a269c16-6204-4c2c-8303-6582f4913eb3 tempest-ProjectReaderTests-129040540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:25 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:37:25 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:25 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:25 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-02853eed-1d14-4cf6-8444-a2ad7069a178 tempest-VolumesActionsTest-532219026 None] Acquiring lock "cinder-4ebbaa1d-d2ce-4876-8609-af1232ccbba5-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7a269c16-6204-4c2c-8303-6582f4913eb3 tempest-ProjectReaderTests-129040540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.371s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:25 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-7a269c16-6204-4c2c-8303-6582f4913eb3 tempest-ProjectReaderTests-129040540 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:37:25 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-02853eed-1d14-4cf6-8444-a2ad7069a178 tempest-VolumesActionsTest-532219026 None] Lock "cinder-4ebbaa1d-d2ce-4876-8609-af1232ccbba5-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:25 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-7a269c16-6204-4c2c-8303-6582f4913eb3 tempest-ProjectReaderTests-129040540 None] Deleted volume successfully. Nov 02 12:37:25 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7a269c16-6204-4c2c-8303-6582f4913eb3 tempest-ProjectReaderTests-129040540 None] Lock "cinder-de0fc62f-7cf7-4bd2-9d85-c494fd081b9f-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:25 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-02853eed-1d14-4cf6-8444-a2ad7069a178 tempest-VolumesActionsTest-532219026 None] Acquiring lock "cinder-quobyte-4ebbaa1d-d2ce-4876-8609-af1232ccbba5" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:25 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-02853eed-1d14-4cf6-8444-a2ad7069a178 tempest-VolumesActionsTest-532219026 None] Lock "cinder-quobyte-4ebbaa1d-d2ce-4876-8609-af1232ccbba5" acquired by "delete_volume" :: waited 0.031s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:25 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b424ef-63f6-4bb7-b4d8-28c9d61d0495]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:37:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-02853eed-1d14-4cf6-8444-a2ad7069a178 tempest-VolumesActionsTest-532219026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4ebbaa1d-d2ce-4876-8609-af1232ccbba5 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:25 devstack sudo[101573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4ebbaa1d-d2ce-4876-8609-af1232ccbba5 Nov 02 12:37:25 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:26 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0c7e78f-35a2-4cae-9f16-69c77cf8a3dd tempest-ProjectReaderTests-129040540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:37:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a0c7e78f-35a2-4cae-9f16-69c77cf8a3dd tempest-ProjectReaderTests-129040540 None] Flow 'volume_create_manager' (68060110-37a0-4fda-86c3-d4ac33ea927f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:26 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a0c7e78f-35a2-4cae-9f16-69c77cf8a3dd tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0732f0f3-c09f-4f2d-8804-120c004f216c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-02853eed-1d14-4cf6-8444-a2ad7069a178 tempest-VolumesActionsTest-532219026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4ebbaa1d-d2ce-4876-8609-af1232ccbba5" returned: 0 in 0.457s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-02853eed-1d14-4cf6-8444-a2ad7069a178 tempest-VolumesActionsTest-532219026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4ebbaa1d-d2ce-4876-8609-af1232ccbba5 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a0c7e78f-35a2-4cae-9f16-69c77cf8a3dd tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0732f0f3-c09f-4f2d-8804-120c004f216c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-754370854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e4480b8-91eb-4ee7-b101-bf26410be454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd11f8bae905497a84b38034277bec03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:26Z,use_quota=True,user_id='ee17b5fed2d04524aae3bd01a8f5d667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a0c7e78f-35a2-4cae-9f16-69c77cf8a3dd tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e76d95bd-3a89-42db-9cb0-ae58138f8575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:26 devstack sudo[101579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4ebbaa1d-d2ce-4876-8609-af1232ccbba5 Nov 02 12:37:26 devstack sudo[101579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a0c7e78f-35a2-4cae-9f16-69c77cf8a3dd tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e76d95bd-3a89-42db-9cb0-ae58138f8575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a0c7e78f-35a2-4cae-9f16-69c77cf8a3dd tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ac4dcde-f8ba-42a0-875e-3bcec9a9fdd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a0c7e78f-35a2-4cae-9f16-69c77cf8a3dd tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ac4dcde-f8ba-42a0-875e-3bcec9a9fdd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e4480b8-91eb-4ee7-b101-bf26410be454', 'volume_name': 'volume-2e4480b8-91eb-4ee7-b101-bf26410be454', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a0c7e78f-35a2-4cae-9f16-69c77cf8a3dd tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a852d5be-7134-4b9c-8e28-e2767d48e03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a0c7e78f-35a2-4cae-9f16-69c77cf8a3dd tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a852d5be-7134-4b9c-8e28-e2767d48e03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a0c7e78f-35a2-4cae-9f16-69c77cf8a3dd tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad0bf7e3-c450-40d3-8121-f398d6bb4f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:26 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-a0c7e78f-35a2-4cae-9f16-69c77cf8a3dd tempest-ProjectReaderTests-129040540 None] Volume 2e4480b8-91eb-4ee7-b101-bf26410be454: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e4480b8-91eb-4ee7-b101-bf26410be454', 'volume_size': 1} Nov 02 12:37:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a0c7e78f-35a2-4cae-9f16-69c77cf8a3dd tempest-ProjectReaderTests-129040540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a0c7e78f-35a2-4cae-9f16-69c77cf8a3dd tempest-ProjectReaderTests-129040540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:26 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a0c7e78f-35a2-4cae-9f16-69c77cf8a3dd tempest-ProjectReaderTests-129040540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-754370854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e4480b8-91eb-4ee7-b101-bf26410be454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd11f8bae905497a84b38034277bec03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:26Z,use_quota=True,user_id='ee17b5fed2d04524aae3bd01a8f5d667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:37:26 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-a0c7e78f-35a2-4cae-9f16-69c77cf8a3dd tempest-ProjectReaderTests-129040540 None] Creating volume 2e4480b8-91eb-4ee7-b101-bf26410be454 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:37:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a0c7e78f-35a2-4cae-9f16-69c77cf8a3dd tempest-ProjectReaderTests-129040540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a0c7e78f-35a2-4cae-9f16-69c77cf8a3dd tempest-ProjectReaderTests-129040540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:26 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a0c7e78f-35a2-4cae-9f16-69c77cf8a3dd tempest-ProjectReaderTests-129040540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:26 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a0c7e78f-35a2-4cae-9f16-69c77cf8a3dd tempest-ProjectReaderTests-129040540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a0c7e78f-35a2-4cae-9f16-69c77cf8a3dd tempest-ProjectReaderTests-129040540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:26 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a0c7e78f-35a2-4cae-9f16-69c77cf8a3dd tempest-ProjectReaderTests-129040540 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:37:26 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-a0c7e78f-35a2-4cae-9f16-69c77cf8a3dd tempest-ProjectReaderTests-129040540 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:37:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a0c7e78f-35a2-4cae-9f16-69c77cf8a3dd tempest-ProjectReaderTests-129040540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2e4480b8-91eb-4ee7-b101-bf26410be454 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:26 devstack sudo[101581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2e4480b8-91eb-4ee7-b101-bf26410be454 1073741824 Nov 02 12:37:26 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:26 devstack sudo[101579]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-02853eed-1d14-4cf6-8444-a2ad7069a178 tempest-VolumesActionsTest-532219026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4ebbaa1d-d2ce-4876-8609-af1232ccbba5" returned: 0 in 0.348s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:26 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-02853eed-1d14-4cf6-8444-a2ad7069a178 tempest-VolumesActionsTest-532219026 None] Lock "cinder-quobyte-4ebbaa1d-d2ce-4876-8609-af1232ccbba5" released by "delete_volume" :: held 0.868s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:26 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-02853eed-1d14-4cf6-8444-a2ad7069a178 tempest-VolumesActionsTest-532219026 None] Created reservations ['9dcf7daf-4e70-41e1-830a-d5f40fcc0764', '3644bd77-0917-4447-8ec1-27f351cf989e', '35421c50-3666-493a-9697-514a90dada68', '3d074fcf-9d2b-4753-a0a5-5f3c078a004b'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:37:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-02853eed-1d14-4cf6-8444-a2ad7069a178 tempest-VolumesActionsTest-532219026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-02853eed-1d14-4cf6-8444-a2ad7069a178 tempest-VolumesActionsTest-532219026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:26 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-02853eed-1d14-4cf6-8444-a2ad7069a178 tempest-VolumesActionsTest-532219026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:26 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-02853eed-1d14-4cf6-8444-a2ad7069a178 tempest-VolumesActionsTest-532219026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-02853eed-1d14-4cf6-8444-a2ad7069a178 tempest-VolumesActionsTest-532219026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-02853eed-1d14-4cf6-8444-a2ad7069a178 tempest-VolumesActionsTest-532219026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:26 devstack sudo[101587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:37:26 devstack sudo[101587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:27 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a0c7e78f-35a2-4cae-9f16-69c77cf8a3dd tempest-ProjectReaderTests-129040540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2e4480b8-91eb-4ee7-b101-bf26410be454 1073741824" returned: 0 in 0.674s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a0c7e78f-35a2-4cae-9f16-69c77cf8a3dd tempest-ProjectReaderTests-129040540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2e4480b8-91eb-4ee7-b101-bf26410be454 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:27 devstack sudo[101591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2e4480b8-91eb-4ee7-b101-bf26410be454 Nov 02 12:37:27 devstack sudo[101591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:27 devstack sudo[101587]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-02853eed-1d14-4cf6-8444-a2ad7069a178 tempest-VolumesActionsTest-532219026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.327s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:27 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-02853eed-1d14-4cf6-8444-a2ad7069a178 tempest-VolumesActionsTest-532219026 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:37:27 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-02853eed-1d14-4cf6-8444-a2ad7069a178 tempest-VolumesActionsTest-532219026 None] Deleted volume successfully. Nov 02 12:37:27 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-02853eed-1d14-4cf6-8444-a2ad7069a178 tempest-VolumesActionsTest-532219026 None] Lock "cinder-4ebbaa1d-d2ce-4876-8609-af1232ccbba5-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:27 devstack sudo[101591]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a0c7e78f-35a2-4cae-9f16-69c77cf8a3dd tempest-ProjectReaderTests-129040540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2e4480b8-91eb-4ee7-b101-bf26410be454" returned: 0 in 0.289s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:27 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a0c7e78f-35a2-4cae-9f16-69c77cf8a3dd tempest-ProjectReaderTests-129040540 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:37:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a0c7e78f-35a2-4cae-9f16-69c77cf8a3dd tempest-ProjectReaderTests-129040540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:27 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a0c7e78f-35a2-4cae-9f16-69c77cf8a3dd tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad0bf7e3-c450-40d3-8121-f398d6bb4f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e4480b8-91eb-4ee7-b101-bf26410be454', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:27 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a0c7e78f-35a2-4cae-9f16-69c77cf8a3dd tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edcd41c5-a746-4513-bc1d-b3a6913b8c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:27 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-a0c7e78f-35a2-4cae-9f16-69c77cf8a3dd tempest-ProjectReaderTests-129040540 None] Volume volume-2e4480b8-91eb-4ee7-b101-bf26410be454 (2e4480b8-91eb-4ee7-b101-bf26410be454): created successfully Nov 02 12:37:27 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a0c7e78f-35a2-4cae-9f16-69c77cf8a3dd tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edcd41c5-a746-4513-bc1d-b3a6913b8c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:27 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a0c7e78f-35a2-4cae-9f16-69c77cf8a3dd tempest-ProjectReaderTests-129040540 None] Flow 'volume_create_manager' (68060110-37a0-4fda-86c3-d4ac33ea927f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:27 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-a0c7e78f-35a2-4cae-9f16-69c77cf8a3dd tempest-ProjectReaderTests-129040540 None] Created volume successfully. Nov 02 12:37:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-6618a6e8-3546-4434-81ee-f770aa71d1a3 tempest-ProjectReaderTests-129040540 None] Acquiring lock "cinder-2e4480b8-91eb-4ee7-b101-bf26410be454-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-6618a6e8-3546-4434-81ee-f770aa71d1a3 tempest-ProjectReaderTests-129040540 None] Lock "cinder-2e4480b8-91eb-4ee7-b101-bf26410be454-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-6618a6e8-3546-4434-81ee-f770aa71d1a3 tempest-ProjectReaderTests-129040540 None] Acquiring lock "cinder-quobyte-2e4480b8-91eb-4ee7-b101-bf26410be454" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-6618a6e8-3546-4434-81ee-f770aa71d1a3 tempest-ProjectReaderTests-129040540 None] Lock "cinder-quobyte-2e4480b8-91eb-4ee7-b101-bf26410be454" acquired by "delete_volume" :: waited 0.023s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:28 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2a5627-d3ea-4080-a99c-8dd3cc8dbf21]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:37:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6618a6e8-3546-4434-81ee-f770aa71d1a3 tempest-ProjectReaderTests-129040540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2e4480b8-91eb-4ee7-b101-bf26410be454 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:28 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2e4480b8-91eb-4ee7-b101-bf26410be454 Nov 02 12:37:28 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:29 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6618a6e8-3546-4434-81ee-f770aa71d1a3 tempest-ProjectReaderTests-129040540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2e4480b8-91eb-4ee7-b101-bf26410be454" returned: 0 in 0.570s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6618a6e8-3546-4434-81ee-f770aa71d1a3 tempest-ProjectReaderTests-129040540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2e4480b8-91eb-4ee7-b101-bf26410be454 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:29 devstack sudo[101620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2e4480b8-91eb-4ee7-b101-bf26410be454 Nov 02 12:37:29 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:29 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6618a6e8-3546-4434-81ee-f770aa71d1a3 tempest-ProjectReaderTests-129040540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2e4480b8-91eb-4ee7-b101-bf26410be454" returned: 0 in 0.314s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:29 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-6618a6e8-3546-4434-81ee-f770aa71d1a3 tempest-ProjectReaderTests-129040540 None] Lock "cinder-quobyte-2e4480b8-91eb-4ee7-b101-bf26410be454" released by "delete_volume" :: held 0.946s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:29 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-6618a6e8-3546-4434-81ee-f770aa71d1a3 tempest-ProjectReaderTests-129040540 None] Created reservations ['9b71659b-243c-48cc-bfe8-443845c84384', '486125de-883f-40ef-a09e-33b3ab973725', '02055356-e08b-4523-8d10-07977b0df34e', '34318118-56db-4ab3-bbf7-67dfe2218577'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:37:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-6618a6e8-3546-4434-81ee-f770aa71d1a3 tempest-ProjectReaderTests-129040540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-6618a6e8-3546-4434-81ee-f770aa71d1a3 tempest-ProjectReaderTests-129040540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:29 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-6618a6e8-3546-4434-81ee-f770aa71d1a3 tempest-ProjectReaderTests-129040540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:29 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-6618a6e8-3546-4434-81ee-f770aa71d1a3 tempest-ProjectReaderTests-129040540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-6618a6e8-3546-4434-81ee-f770aa71d1a3 tempest-ProjectReaderTests-129040540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6618a6e8-3546-4434-81ee-f770aa71d1a3 tempest-ProjectReaderTests-129040540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:29 devstack sudo[101623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:37:29 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6618a6e8-3546-4434-81ee-f770aa71d1a3 tempest-ProjectReaderTests-129040540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.327s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:29 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:29 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-6618a6e8-3546-4434-81ee-f770aa71d1a3 tempest-ProjectReaderTests-129040540 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:37:29 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-6618a6e8-3546-4434-81ee-f770aa71d1a3 tempest-ProjectReaderTests-129040540 None] Deleted volume successfully. Nov 02 12:37:30 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-6618a6e8-3546-4434-81ee-f770aa71d1a3 tempest-ProjectReaderTests-129040540 None] Lock "cinder-2e4480b8-91eb-4ee7-b101-bf26410be454-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:31 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d4963b-ef61-47f6-915b-12cc628cde79 tempest-ProjectReaderTests-129040540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:37:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-97d4963b-ef61-47f6-915b-12cc628cde79 tempest-ProjectReaderTests-129040540 None] Flow 'volume_create_manager' (74362959-5a9e-4836-a3ad-bb9ff7a8234c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-97d4963b-ef61-47f6-915b-12cc628cde79 tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c396f5d-f404-4607-900a-105cf1414702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-97d4963b-ef61-47f6-915b-12cc628cde79 tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c396f5d-f404-4607-900a-105cf1414702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1495723155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a3053d7-d89f-4f3f-bf6d-c44fa29660ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd11f8bae905497a84b38034277bec03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:31Z,use_quota=True,user_id='ee17b5fed2d04524aae3bd01a8f5d667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-97d4963b-ef61-47f6-915b-12cc628cde79 tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7170ba1-0eca-40e8-9a14-7857c07e66f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-97d4963b-ef61-47f6-915b-12cc628cde79 tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7170ba1-0eca-40e8-9a14-7857c07e66f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-97d4963b-ef61-47f6-915b-12cc628cde79 tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f30a8b5-630c-4480-8dec-475816a101c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-97d4963b-ef61-47f6-915b-12cc628cde79 tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f30a8b5-630c-4480-8dec-475816a101c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a3053d7-d89f-4f3f-bf6d-c44fa29660ac', 'volume_name': 'volume-2a3053d7-d89f-4f3f-bf6d-c44fa29660ac', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-97d4963b-ef61-47f6-915b-12cc628cde79 tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (934c5f38-0a7a-40fc-bab3-435dea180649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-97d4963b-ef61-47f6-915b-12cc628cde79 tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (934c5f38-0a7a-40fc-bab3-435dea180649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-97d4963b-ef61-47f6-915b-12cc628cde79 tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (994ee132-808f-4895-a8ca-481a078cff2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:31 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-97d4963b-ef61-47f6-915b-12cc628cde79 tempest-ProjectReaderTests-129040540 None] Volume 2a3053d7-d89f-4f3f-bf6d-c44fa29660ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a3053d7-d89f-4f3f-bf6d-c44fa29660ac', 'volume_size': 1} Nov 02 12:37:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-97d4963b-ef61-47f6-915b-12cc628cde79 tempest-ProjectReaderTests-129040540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-97d4963b-ef61-47f6-915b-12cc628cde79 tempest-ProjectReaderTests-129040540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:31 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-97d4963b-ef61-47f6-915b-12cc628cde79 tempest-ProjectReaderTests-129040540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1495723155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a3053d7-d89f-4f3f-bf6d-c44fa29660ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd11f8bae905497a84b38034277bec03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:31Z,use_quota=True,user_id='ee17b5fed2d04524aae3bd01a8f5d667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:37:31 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-97d4963b-ef61-47f6-915b-12cc628cde79 tempest-ProjectReaderTests-129040540 None] Creating volume 2a3053d7-d89f-4f3f-bf6d-c44fa29660ac {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:37:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-97d4963b-ef61-47f6-915b-12cc628cde79 tempest-ProjectReaderTests-129040540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-97d4963b-ef61-47f6-915b-12cc628cde79 tempest-ProjectReaderTests-129040540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:31 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-97d4963b-ef61-47f6-915b-12cc628cde79 tempest-ProjectReaderTests-129040540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:31 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-97d4963b-ef61-47f6-915b-12cc628cde79 tempest-ProjectReaderTests-129040540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-97d4963b-ef61-47f6-915b-12cc628cde79 tempest-ProjectReaderTests-129040540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:31 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-97d4963b-ef61-47f6-915b-12cc628cde79 tempest-ProjectReaderTests-129040540 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:37:31 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-97d4963b-ef61-47f6-915b-12cc628cde79 tempest-ProjectReaderTests-129040540 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:37:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-97d4963b-ef61-47f6-915b-12cc628cde79 tempest-ProjectReaderTests-129040540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2a3053d7-d89f-4f3f-bf6d-c44fa29660ac 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:31 devstack sudo[101629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2a3053d7-d89f-4f3f-bf6d-c44fa29660ac 1073741824 Nov 02 12:37:31 devstack sudo[101629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:31 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7a8cf58-f710-4600-8350-e3dad0275020 tempest-VolumesActionsTest-532219026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:37:31 devstack sudo[101629]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:32 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a7a8cf58-f710-4600-8350-e3dad0275020 tempest-VolumesActionsTest-532219026 None] Flow 'volume_create_manager' (3cceab04-fe41-41e7-b13c-2b25034ef30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:32 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a7a8cf58-f710-4600-8350-e3dad0275020 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (625533d4-491f-497d-9833-10724c34e5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-97d4963b-ef61-47f6-915b-12cc628cde79 tempest-ProjectReaderTests-129040540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2a3053d7-d89f-4f3f-bf6d-c44fa29660ac 1073741824" returned: 0 in 0.618s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:32 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a7a8cf58-f710-4600-8350-e3dad0275020 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (625533d4-491f-497d-9833-10724c34e5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1831641688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05ca7f00-80a3-44d0-a2e5-6e8223491c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5091079442c4a4ab610d755438c5448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:32Z,use_quota=True,user_id='c431e1f5074f4e54b37ce024ccbba5fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:32 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a7a8cf58-f710-4600-8350-e3dad0275020 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c59af091-351e-406a-a5b5-4fbcbb0342a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:32 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a7a8cf58-f710-4600-8350-e3dad0275020 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c59af091-351e-406a-a5b5-4fbcbb0342a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:32 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a7a8cf58-f710-4600-8350-e3dad0275020 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (218d4acf-f1ec-4cd7-a669-68a31b870a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:32 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a7a8cf58-f710-4600-8350-e3dad0275020 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (218d4acf-f1ec-4cd7-a669-68a31b870a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05ca7f00-80a3-44d0-a2e5-6e8223491c3f', 'volume_name': 'volume-05ca7f00-80a3-44d0-a2e5-6e8223491c3f', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:32 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a7a8cf58-f710-4600-8350-e3dad0275020 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (592a2a07-3c4f-4688-8a98-dcff827f6448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:32 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a7a8cf58-f710-4600-8350-e3dad0275020 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (592a2a07-3c4f-4688-8a98-dcff827f6448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:32 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a7a8cf58-f710-4600-8350-e3dad0275020 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f00b87d-5092-4c2d-a280-cbab2a284d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:32 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-a7a8cf58-f710-4600-8350-e3dad0275020 tempest-VolumesActionsTest-532219026 None] Volume 05ca7f00-80a3-44d0-a2e5-6e8223491c3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05ca7f00-80a3-44d0-a2e5-6e8223491c3f', 'volume_size': 1} Nov 02 12:37:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a7a8cf58-f710-4600-8350-e3dad0275020 tempest-VolumesActionsTest-532219026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-97d4963b-ef61-47f6-915b-12cc628cde79 tempest-ProjectReaderTests-129040540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2a3053d7-d89f-4f3f-bf6d-c44fa29660ac {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:32 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2a3053d7-d89f-4f3f-bf6d-c44fa29660ac Nov 02 12:37:32 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:32 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-97d4963b-ef61-47f6-915b-12cc628cde79 tempest-ProjectReaderTests-129040540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2a3053d7-d89f-4f3f-bf6d-c44fa29660ac" returned: 0 in 0.251s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:32 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-97d4963b-ef61-47f6-915b-12cc628cde79 tempest-ProjectReaderTests-129040540 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:37:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-97d4963b-ef61-47f6-915b-12cc628cde79 tempest-ProjectReaderTests-129040540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a7a8cf58-f710-4600-8350-e3dad0275020 tempest-VolumesActionsTest-532219026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.285s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:32 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a7a8cf58-f710-4600-8350-e3dad0275020 tempest-VolumesActionsTest-532219026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1831641688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05ca7f00-80a3-44d0-a2e5-6e8223491c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5091079442c4a4ab610d755438c5448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:32Z,use_quota=True,user_id='c431e1f5074f4e54b37ce024ccbba5fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:37:32 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-a7a8cf58-f710-4600-8350-e3dad0275020 tempest-VolumesActionsTest-532219026 None] Creating volume 05ca7f00-80a3-44d0-a2e5-6e8223491c3f {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:37:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a7a8cf58-f710-4600-8350-e3dad0275020 tempest-VolumesActionsTest-532219026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a7a8cf58-f710-4600-8350-e3dad0275020 tempest-VolumesActionsTest-532219026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:32 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a7a8cf58-f710-4600-8350-e3dad0275020 tempest-VolumesActionsTest-532219026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:32 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a7a8cf58-f710-4600-8350-e3dad0275020 tempest-VolumesActionsTest-532219026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a7a8cf58-f710-4600-8350-e3dad0275020 tempest-VolumesActionsTest-532219026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:32 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a7a8cf58-f710-4600-8350-e3dad0275020 tempest-VolumesActionsTest-532219026 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:37:32 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-a7a8cf58-f710-4600-8350-e3dad0275020 tempest-VolumesActionsTest-532219026 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:37:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a7a8cf58-f710-4600-8350-e3dad0275020 tempest-VolumesActionsTest-532219026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-05ca7f00-80a3-44d0-a2e5-6e8223491c3f 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:32 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-97d4963b-ef61-47f6-915b-12cc628cde79 tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (994ee132-808f-4895-a8ca-481a078cff2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a3053d7-d89f-4f3f-bf6d-c44fa29660ac', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:32 devstack sudo[101638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-05ca7f00-80a3-44d0-a2e5-6e8223491c3f 1073741824 Nov 02 12:37:32 devstack sudo[101638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:32 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-97d4963b-ef61-47f6-915b-12cc628cde79 tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2554449a-5919-406c-854e-23b6a99a2005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:32 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-97d4963b-ef61-47f6-915b-12cc628cde79 tempest-ProjectReaderTests-129040540 None] Volume volume-2a3053d7-d89f-4f3f-bf6d-c44fa29660ac (2a3053d7-d89f-4f3f-bf6d-c44fa29660ac): created successfully Nov 02 12:37:32 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-97d4963b-ef61-47f6-915b-12cc628cde79 tempest-ProjectReaderTests-129040540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2554449a-5919-406c-854e-23b6a99a2005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:32 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-97d4963b-ef61-47f6-915b-12cc628cde79 tempest-ProjectReaderTests-129040540 None] Flow 'volume_create_manager' (74362959-5a9e-4836-a3ad-bb9ff7a8234c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:32 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-97d4963b-ef61-47f6-915b-12cc628cde79 tempest-ProjectReaderTests-129040540 None] Created volume successfully. Nov 02 12:37:32 devstack sudo[101638]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a7a8cf58-f710-4600-8350-e3dad0275020 tempest-VolumesActionsTest-532219026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-05ca7f00-80a3-44d0-a2e5-6e8223491c3f 1073741824" returned: 0 in 0.506s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a7a8cf58-f710-4600-8350-e3dad0275020 tempest-VolumesActionsTest-532219026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-05ca7f00-80a3-44d0-a2e5-6e8223491c3f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:32 devstack sudo[101644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-05ca7f00-80a3-44d0-a2e5-6e8223491c3f Nov 02 12:37:32 devstack sudo[101644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:33 devstack sudo[101644]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a7a8cf58-f710-4600-8350-e3dad0275020 tempest-VolumesActionsTest-532219026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-05ca7f00-80a3-44d0-a2e5-6e8223491c3f" returned: 0 in 0.282s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a7a8cf58-f710-4600-8350-e3dad0275020 tempest-VolumesActionsTest-532219026 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:37:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a7a8cf58-f710-4600-8350-e3dad0275020 tempest-VolumesActionsTest-532219026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a7a8cf58-f710-4600-8350-e3dad0275020 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f00b87d-5092-4c2d-a280-cbab2a284d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05ca7f00-80a3-44d0-a2e5-6e8223491c3f', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a7a8cf58-f710-4600-8350-e3dad0275020 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a28c77a-a4b5-455f-b949-142138b784cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:33 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-a7a8cf58-f710-4600-8350-e3dad0275020 tempest-VolumesActionsTest-532219026 None] Volume volume-05ca7f00-80a3-44d0-a2e5-6e8223491c3f (05ca7f00-80a3-44d0-a2e5-6e8223491c3f): created successfully Nov 02 12:37:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a7a8cf58-f710-4600-8350-e3dad0275020 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a28c77a-a4b5-455f-b949-142138b784cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a7a8cf58-f710-4600-8350-e3dad0275020 tempest-VolumesActionsTest-532219026 None] Flow 'volume_create_manager' (3cceab04-fe41-41e7-b13c-2b25034ef30e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:33 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-a7a8cf58-f710-4600-8350-e3dad0275020 tempest-VolumesActionsTest-532219026 None] Created volume successfully. Nov 02 12:37:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8f2f160a-feb8-40e8-bb21-cd79a77e22ed tempest-ProjectReaderTests-129040540 None] Acquiring lock "cinder-2a3053d7-d89f-4f3f-bf6d-c44fa29660ac-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8f2f160a-feb8-40e8-bb21-cd79a77e22ed tempest-ProjectReaderTests-129040540 None] Lock "cinder-2a3053d7-d89f-4f3f-bf6d-c44fa29660ac-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8f2f160a-feb8-40e8-bb21-cd79a77e22ed tempest-ProjectReaderTests-129040540 None] Acquiring lock "cinder-quobyte-2a3053d7-d89f-4f3f-bf6d-c44fa29660ac" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8f2f160a-feb8-40e8-bb21-cd79a77e22ed tempest-ProjectReaderTests-129040540 None] Lock "cinder-quobyte-2a3053d7-d89f-4f3f-bf6d-c44fa29660ac" acquired by "delete_volume" :: waited 0.019s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:33 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[528dc959-375b-45db-8403-151333b1f532]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:37:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8f2f160a-feb8-40e8-bb21-cd79a77e22ed tempest-ProjectReaderTests-129040540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2a3053d7-d89f-4f3f-bf6d-c44fa29660ac {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:33 devstack sudo[101647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2a3053d7-d89f-4f3f-bf6d-c44fa29660ac Nov 02 12:37:33 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:33 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8f2f160a-feb8-40e8-bb21-cd79a77e22ed tempest-ProjectReaderTests-129040540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2a3053d7-d89f-4f3f-bf6d-c44fa29660ac" returned: 0 in 0.374s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8f2f160a-feb8-40e8-bb21-cd79a77e22ed tempest-ProjectReaderTests-129040540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2a3053d7-d89f-4f3f-bf6d-c44fa29660ac {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:33 devstack sudo[101652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2a3053d7-d89f-4f3f-bf6d-c44fa29660ac Nov 02 12:37:33 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:34 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8f2f160a-feb8-40e8-bb21-cd79a77e22ed tempest-ProjectReaderTests-129040540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-2a3053d7-d89f-4f3f-bf6d-c44fa29660ac" returned: 0 in 0.262s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:34 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8f2f160a-feb8-40e8-bb21-cd79a77e22ed tempest-ProjectReaderTests-129040540 None] Lock "cinder-quobyte-2a3053d7-d89f-4f3f-bf6d-c44fa29660ac" released by "delete_volume" :: held 0.692s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:34 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-8f2f160a-feb8-40e8-bb21-cd79a77e22ed tempest-ProjectReaderTests-129040540 None] Created reservations ['bfa411c5-1733-45bb-b9e9-98a78a8fcf15', '2acdc718-a29b-45cb-a67f-29fed7d4f138', 'e5bab283-e20d-4434-93d7-415a68840a6c', '0680e8e8-f041-4c3f-abca-22ad1e0ab198'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:37:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8f2f160a-feb8-40e8-bb21-cd79a77e22ed tempest-ProjectReaderTests-129040540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8f2f160a-feb8-40e8-bb21-cd79a77e22ed tempest-ProjectReaderTests-129040540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8f2f160a-feb8-40e8-bb21-cd79a77e22ed tempest-ProjectReaderTests-129040540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8f2f160a-feb8-40e8-bb21-cd79a77e22ed tempest-ProjectReaderTests-129040540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8f2f160a-feb8-40e8-bb21-cd79a77e22ed tempest-ProjectReaderTests-129040540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8f2f160a-feb8-40e8-bb21-cd79a77e22ed tempest-ProjectReaderTests-129040540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:34 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ec2cfda0-596f-412a-9129-bad3d60c245c tempest-VolumesActionsTest-909889282 None] Acquiring lock "cinder-05ca7f00-80a3-44d0-a2e5-6e8223491c3f-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:34 devstack sudo[101655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:37:34 devstack sudo[101655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:34 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ec2cfda0-596f-412a-9129-bad3d60c245c tempest-VolumesActionsTest-909889282 None] Lock "cinder-05ca7f00-80a3-44d0-a2e5-6e8223491c3f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:34 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ec2cfda0-596f-412a-9129-bad3d60c245c tempest-VolumesActionsTest-909889282 None] Acquiring lock "cinder-quobyte-05ca7f00-80a3-44d0-a2e5-6e8223491c3f" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:34 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ec2cfda0-596f-412a-9129-bad3d60c245c tempest-VolumesActionsTest-909889282 None] Lock "cinder-quobyte-05ca7f00-80a3-44d0-a2e5-6e8223491c3f" acquired by "delete_volume" :: waited 0.021s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:34 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f09aee-15b2-41df-9d27-d70fc29e077e]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:37:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ec2cfda0-596f-412a-9129-bad3d60c245c tempest-VolumesActionsTest-909889282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-05ca7f00-80a3-44d0-a2e5-6e8223491c3f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:34 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-05ca7f00-80a3-44d0-a2e5-6e8223491c3f Nov 02 12:37:34 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:34 devstack sudo[101655]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8f2f160a-feb8-40e8-bb21-cd79a77e22ed tempest-ProjectReaderTests-129040540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.359s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:34 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-8f2f160a-feb8-40e8-bb21-cd79a77e22ed tempest-ProjectReaderTests-129040540 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:37:34 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-8f2f160a-feb8-40e8-bb21-cd79a77e22ed tempest-ProjectReaderTests-129040540 None] Deleted volume successfully. Nov 02 12:37:34 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8f2f160a-feb8-40e8-bb21-cd79a77e22ed tempest-ProjectReaderTests-129040540 None] Lock "cinder-2a3053d7-d89f-4f3f-bf6d-c44fa29660ac-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:34 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ec2cfda0-596f-412a-9129-bad3d60c245c tempest-VolumesActionsTest-909889282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-05ca7f00-80a3-44d0-a2e5-6e8223491c3f" returned: 0 in 0.447s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ec2cfda0-596f-412a-9129-bad3d60c245c tempest-VolumesActionsTest-909889282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-05ca7f00-80a3-44d0-a2e5-6e8223491c3f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:34 devstack sudo[101663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-05ca7f00-80a3-44d0-a2e5-6e8223491c3f Nov 02 12:37:34 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:35 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ec2cfda0-596f-412a-9129-bad3d60c245c tempest-VolumesActionsTest-909889282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-05ca7f00-80a3-44d0-a2e5-6e8223491c3f" returned: 0 in 0.332s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:35 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ec2cfda0-596f-412a-9129-bad3d60c245c tempest-VolumesActionsTest-909889282 None] Lock "cinder-quobyte-05ca7f00-80a3-44d0-a2e5-6e8223491c3f" released by "delete_volume" :: held 0.847s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:35 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-ec2cfda0-596f-412a-9129-bad3d60c245c tempest-VolumesActionsTest-909889282 None] Created reservations ['d2f81d0f-ade0-42ee-99f3-d3852aafb1cb', 'eeca16ef-5c30-42c4-a1b1-96faca2f8850', '36cf566a-1e64-41ff-8ee4-3e15877dd746', 'e272d8a5-b0ba-4ad8-8202-e89c7443beb6'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:37:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ec2cfda0-596f-412a-9129-bad3d60c245c tempest-VolumesActionsTest-909889282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ec2cfda0-596f-412a-9129-bad3d60c245c tempest-VolumesActionsTest-909889282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:35 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cfda0-596f-412a-9129-bad3d60c245c tempest-VolumesActionsTest-909889282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:35 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ec2cfda0-596f-412a-9129-bad3d60c245c tempest-VolumesActionsTest-909889282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ec2cfda0-596f-412a-9129-bad3d60c245c tempest-VolumesActionsTest-909889282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ec2cfda0-596f-412a-9129-bad3d60c245c tempest-VolumesActionsTest-909889282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:35 devstack sudo[101666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:37:35 devstack sudo[101666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:35 devstack sudo[101666]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ec2cfda0-596f-412a-9129-bad3d60c245c tempest-VolumesActionsTest-909889282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.311s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:35 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-ec2cfda0-596f-412a-9129-bad3d60c245c tempest-VolumesActionsTest-909889282 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:37:35 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-ec2cfda0-596f-412a-9129-bad3d60c245c tempest-VolumesActionsTest-909889282 None] Deleted volume successfully. Nov 02 12:37:35 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ec2cfda0-596f-412a-9129-bad3d60c245c tempest-VolumesActionsTest-909889282 None] Lock "cinder-05ca7f00-80a3-44d0-a2e5-6e8223491c3f-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:36 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c76acfb-4711-4320-bfa8-02cbb3ab1993 tempest-VolumesActionsTest-532219026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:37:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3c76acfb-4711-4320-bfa8-02cbb3ab1993 tempest-VolumesActionsTest-532219026 None] Flow 'volume_create_manager' (7f9a9a39-c750-4caa-aa81-d9f783908c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3c76acfb-4711-4320-bfa8-02cbb3ab1993 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9acb0c3-1a87-432f-ac72-d45cad2fd2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3c76acfb-4711-4320-bfa8-02cbb3ab1993 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9acb0c3-1a87-432f-ac72-d45cad2fd2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-675617674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61d387d3-710a-4874-a255-aec0d02e005b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5091079442c4a4ab610d755438c5448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:36Z,use_quota=True,user_id='c431e1f5074f4e54b37ce024ccbba5fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3c76acfb-4711-4320-bfa8-02cbb3ab1993 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d59e86b1-4d5a-40ba-bbb7-f5e645bbf3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3c76acfb-4711-4320-bfa8-02cbb3ab1993 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d59e86b1-4d5a-40ba-bbb7-f5e645bbf3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3c76acfb-4711-4320-bfa8-02cbb3ab1993 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe1ebcdc-dc8e-4a3e-9930-276119e55628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3c76acfb-4711-4320-bfa8-02cbb3ab1993 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe1ebcdc-dc8e-4a3e-9930-276119e55628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61d387d3-710a-4874-a255-aec0d02e005b', 'volume_name': 'volume-61d387d3-710a-4874-a255-aec0d02e005b', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3c76acfb-4711-4320-bfa8-02cbb3ab1993 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2039015a-9b15-42ed-b042-4ed9255ee6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3c76acfb-4711-4320-bfa8-02cbb3ab1993 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2039015a-9b15-42ed-b042-4ed9255ee6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3c76acfb-4711-4320-bfa8-02cbb3ab1993 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5022fb83-7fb8-4699-80fb-2907354a6fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:36 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-3c76acfb-4711-4320-bfa8-02cbb3ab1993 tempest-VolumesActionsTest-532219026 None] Volume 61d387d3-710a-4874-a255-aec0d02e005b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61d387d3-710a-4874-a255-aec0d02e005b', 'volume_size': 1} Nov 02 12:37:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3c76acfb-4711-4320-bfa8-02cbb3ab1993 tempest-VolumesActionsTest-532219026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3c76acfb-4711-4320-bfa8-02cbb3ab1993 tempest-VolumesActionsTest-532219026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3c76acfb-4711-4320-bfa8-02cbb3ab1993 tempest-VolumesActionsTest-532219026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-675617674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61d387d3-710a-4874-a255-aec0d02e005b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5091079442c4a4ab610d755438c5448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:36Z,use_quota=True,user_id='c431e1f5074f4e54b37ce024ccbba5fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:37:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-3c76acfb-4711-4320-bfa8-02cbb3ab1993 tempest-VolumesActionsTest-532219026 None] Creating volume 61d387d3-710a-4874-a255-aec0d02e005b {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:37:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3c76acfb-4711-4320-bfa8-02cbb3ab1993 tempest-VolumesActionsTest-532219026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3c76acfb-4711-4320-bfa8-02cbb3ab1993 tempest-VolumesActionsTest-532219026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3c76acfb-4711-4320-bfa8-02cbb3ab1993 tempest-VolumesActionsTest-532219026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3c76acfb-4711-4320-bfa8-02cbb3ab1993 tempest-VolumesActionsTest-532219026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3c76acfb-4711-4320-bfa8-02cbb3ab1993 tempest-VolumesActionsTest-532219026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3c76acfb-4711-4320-bfa8-02cbb3ab1993 tempest-VolumesActionsTest-532219026 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:37:36 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-3c76acfb-4711-4320-bfa8-02cbb3ab1993 tempest-VolumesActionsTest-532219026 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:37:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3c76acfb-4711-4320-bfa8-02cbb3ab1993 tempest-VolumesActionsTest-532219026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-61d387d3-710a-4874-a255-aec0d02e005b 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:36 devstack sudo[101669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-61d387d3-710a-4874-a255-aec0d02e005b 1073741824 Nov 02 12:37:36 devstack sudo[101669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:36 devstack sudo[101669]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3c76acfb-4711-4320-bfa8-02cbb3ab1993 tempest-VolumesActionsTest-532219026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-61d387d3-710a-4874-a255-aec0d02e005b 1073741824" returned: 0 in 0.531s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3c76acfb-4711-4320-bfa8-02cbb3ab1993 tempest-VolumesActionsTest-532219026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-61d387d3-710a-4874-a255-aec0d02e005b {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:36 devstack sudo[101675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-61d387d3-710a-4874-a255-aec0d02e005b Nov 02 12:37:36 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:37 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3c76acfb-4711-4320-bfa8-02cbb3ab1993 tempest-VolumesActionsTest-532219026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-61d387d3-710a-4874-a255-aec0d02e005b" returned: 0 in 0.260s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:37 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3c76acfb-4711-4320-bfa8-02cbb3ab1993 tempest-VolumesActionsTest-532219026 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:37:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3c76acfb-4711-4320-bfa8-02cbb3ab1993 tempest-VolumesActionsTest-532219026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3c76acfb-4711-4320-bfa8-02cbb3ab1993 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5022fb83-7fb8-4699-80fb-2907354a6fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61d387d3-710a-4874-a255-aec0d02e005b', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3c76acfb-4711-4320-bfa8-02cbb3ab1993 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af5aaf4-0f38-4c8a-82a2-426df8a4404c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:37 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-3c76acfb-4711-4320-bfa8-02cbb3ab1993 tempest-VolumesActionsTest-532219026 None] Volume volume-61d387d3-710a-4874-a255-aec0d02e005b (61d387d3-710a-4874-a255-aec0d02e005b): created successfully Nov 02 12:37:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3c76acfb-4711-4320-bfa8-02cbb3ab1993 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af5aaf4-0f38-4c8a-82a2-426df8a4404c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3c76acfb-4711-4320-bfa8-02cbb3ab1993 tempest-VolumesActionsTest-532219026 None] Flow 'volume_create_manager' (7f9a9a39-c750-4caa-aa81-d9f783908c7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:37 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-3c76acfb-4711-4320-bfa8-02cbb3ab1993 tempest-VolumesActionsTest-532219026 None] Created volume successfully. Nov 02 12:37:38 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ff86ae6b-a33e-4344-9975-504d7362d754 tempest-VolumesActionsTest-909889282 None] Acquiring lock "cinder-61d387d3-710a-4874-a255-aec0d02e005b-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:38 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ff86ae6b-a33e-4344-9975-504d7362d754 tempest-VolumesActionsTest-909889282 None] Lock "cinder-61d387d3-710a-4874-a255-aec0d02e005b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:38 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ff86ae6b-a33e-4344-9975-504d7362d754 tempest-VolumesActionsTest-909889282 None] Acquiring lock "cinder-quobyte-61d387d3-710a-4874-a255-aec0d02e005b" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:38 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ff86ae6b-a33e-4344-9975-504d7362d754 tempest-VolumesActionsTest-909889282 None] Lock "cinder-quobyte-61d387d3-710a-4874-a255-aec0d02e005b" acquired by "delete_volume" :: waited 0.033s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:38 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c4bdf5-19af-4920-b563-c6b2ebad8ede]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:37:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ff86ae6b-a33e-4344-9975-504d7362d754 tempest-VolumesActionsTest-909889282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-61d387d3-710a-4874-a255-aec0d02e005b {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:38 devstack sudo[101678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-61d387d3-710a-4874-a255-aec0d02e005b Nov 02 12:37:38 devstack sudo[101678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:39 devstack sudo[101678]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ff86ae6b-a33e-4344-9975-504d7362d754 tempest-VolumesActionsTest-909889282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-61d387d3-710a-4874-a255-aec0d02e005b" returned: 0 in 0.452s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ff86ae6b-a33e-4344-9975-504d7362d754 tempest-VolumesActionsTest-909889282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-61d387d3-710a-4874-a255-aec0d02e005b {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:39 devstack sudo[101684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-61d387d3-710a-4874-a255-aec0d02e005b Nov 02 12:37:39 devstack sudo[101684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:39 devstack sudo[101684]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ff86ae6b-a33e-4344-9975-504d7362d754 tempest-VolumesActionsTest-909889282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-61d387d3-710a-4874-a255-aec0d02e005b" returned: 0 in 0.250s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:39 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ff86ae6b-a33e-4344-9975-504d7362d754 tempest-VolumesActionsTest-909889282 None] Lock "cinder-quobyte-61d387d3-710a-4874-a255-aec0d02e005b" released by "delete_volume" :: held 0.836s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:39 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-ff86ae6b-a33e-4344-9975-504d7362d754 tempest-VolumesActionsTest-909889282 None] Created reservations ['318d717b-dd5b-4ca3-87c2-9d4afd3010e9', '2a71884a-8282-4f20-a713-ab04a50c8886', 'eab30259-5ef6-4c0f-a651-e4c759522642', 'fa34bf19-6219-4590-8bb0-c6671566ebc9'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:37:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ff86ae6b-a33e-4344-9975-504d7362d754 tempest-VolumesActionsTest-909889282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ff86ae6b-a33e-4344-9975-504d7362d754 tempest-VolumesActionsTest-909889282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:39 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ff86ae6b-a33e-4344-9975-504d7362d754 tempest-VolumesActionsTest-909889282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:39 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ff86ae6b-a33e-4344-9975-504d7362d754 tempest-VolumesActionsTest-909889282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ff86ae6b-a33e-4344-9975-504d7362d754 tempest-VolumesActionsTest-909889282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ff86ae6b-a33e-4344-9975-504d7362d754 tempest-VolumesActionsTest-909889282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:39 devstack sudo[101687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:37:39 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:39 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ff86ae6b-a33e-4344-9975-504d7362d754 tempest-VolumesActionsTest-909889282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.298s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:39 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-ff86ae6b-a33e-4344-9975-504d7362d754 tempest-VolumesActionsTest-909889282 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:37:39 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-ff86ae6b-a33e-4344-9975-504d7362d754 tempest-VolumesActionsTest-909889282 None] Deleted volume successfully. Nov 02 12:37:39 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ff86ae6b-a33e-4344-9975-504d7362d754 tempest-VolumesActionsTest-909889282 None] Lock "cinder-61d387d3-710a-4874-a255-aec0d02e005b-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:40 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1a629b6-1cad-4ad0-91b0-dba5337ad75a tempest-VolumesActionsTest-532219026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:37:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e1a629b6-1cad-4ad0-91b0-dba5337ad75a tempest-VolumesActionsTest-532219026 None] Flow 'volume_create_manager' (577ceecb-386e-403d-a9a4-375d7e571388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e1a629b6-1cad-4ad0-91b0-dba5337ad75a tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3403513-d1c2-4661-bc49-1a82fa55fd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e1a629b6-1cad-4ad0-91b0-dba5337ad75a tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3403513-d1c2-4661-bc49-1a82fa55fd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1011006595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb9a4f71-eec8-4a0a-b029-cb5bfa2e7a4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5091079442c4a4ab610d755438c5448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:40Z,use_quota=True,user_id='c431e1f5074f4e54b37ce024ccbba5fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e1a629b6-1cad-4ad0-91b0-dba5337ad75a tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f1f5330-689c-438c-8e90-aa1d31ffdddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e1a629b6-1cad-4ad0-91b0-dba5337ad75a tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f1f5330-689c-438c-8e90-aa1d31ffdddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e1a629b6-1cad-4ad0-91b0-dba5337ad75a tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3f57bfd-78c3-4623-951d-b1a0a14d9f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e1a629b6-1cad-4ad0-91b0-dba5337ad75a tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3f57bfd-78c3-4623-951d-b1a0a14d9f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb9a4f71-eec8-4a0a-b029-cb5bfa2e7a4a', 'volume_name': 'volume-cb9a4f71-eec8-4a0a-b029-cb5bfa2e7a4a', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e1a629b6-1cad-4ad0-91b0-dba5337ad75a tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (674198cb-6dfa-414e-a5c6-ccdf1f022c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e1a629b6-1cad-4ad0-91b0-dba5337ad75a tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (674198cb-6dfa-414e-a5c6-ccdf1f022c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e1a629b6-1cad-4ad0-91b0-dba5337ad75a tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09c26535-35e9-44a5-a06f-c1204a7fa518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:40 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-e1a629b6-1cad-4ad0-91b0-dba5337ad75a tempest-VolumesActionsTest-532219026 None] Volume cb9a4f71-eec8-4a0a-b029-cb5bfa2e7a4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb9a4f71-eec8-4a0a-b029-cb5bfa2e7a4a', 'volume_size': 1} Nov 02 12:37:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e1a629b6-1cad-4ad0-91b0-dba5337ad75a tempest-VolumesActionsTest-532219026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e1a629b6-1cad-4ad0-91b0-dba5337ad75a tempest-VolumesActionsTest-532219026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:40 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e1a629b6-1cad-4ad0-91b0-dba5337ad75a tempest-VolumesActionsTest-532219026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1011006595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb9a4f71-eec8-4a0a-b029-cb5bfa2e7a4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5091079442c4a4ab610d755438c5448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:40Z,use_quota=True,user_id='c431e1f5074f4e54b37ce024ccbba5fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:37:40 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-e1a629b6-1cad-4ad0-91b0-dba5337ad75a tempest-VolumesActionsTest-532219026 None] Creating volume cb9a4f71-eec8-4a0a-b029-cb5bfa2e7a4a {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:37:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e1a629b6-1cad-4ad0-91b0-dba5337ad75a tempest-VolumesActionsTest-532219026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e1a629b6-1cad-4ad0-91b0-dba5337ad75a tempest-VolumesActionsTest-532219026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:40 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e1a629b6-1cad-4ad0-91b0-dba5337ad75a tempest-VolumesActionsTest-532219026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:40 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e1a629b6-1cad-4ad0-91b0-dba5337ad75a tempest-VolumesActionsTest-532219026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e1a629b6-1cad-4ad0-91b0-dba5337ad75a tempest-VolumesActionsTest-532219026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:40 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e1a629b6-1cad-4ad0-91b0-dba5337ad75a tempest-VolumesActionsTest-532219026 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:37:40 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-e1a629b6-1cad-4ad0-91b0-dba5337ad75a tempest-VolumesActionsTest-532219026 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:37:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e1a629b6-1cad-4ad0-91b0-dba5337ad75a tempest-VolumesActionsTest-532219026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cb9a4f71-eec8-4a0a-b029-cb5bfa2e7a4a 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:40 devstack sudo[101690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cb9a4f71-eec8-4a0a-b029-cb5bfa2e7a4a 1073741824 Nov 02 12:37:40 devstack sudo[101690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:40 devstack sudo[101690]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e1a629b6-1cad-4ad0-91b0-dba5337ad75a tempest-VolumesActionsTest-532219026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cb9a4f71-eec8-4a0a-b029-cb5bfa2e7a4a 1073741824" returned: 0 in 0.445s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e1a629b6-1cad-4ad0-91b0-dba5337ad75a tempest-VolumesActionsTest-532219026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cb9a4f71-eec8-4a0a-b029-cb5bfa2e7a4a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:40 devstack sudo[101696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cb9a4f71-eec8-4a0a-b029-cb5bfa2e7a4a Nov 02 12:37:40 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:40 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e1a629b6-1cad-4ad0-91b0-dba5337ad75a tempest-VolumesActionsTest-532219026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cb9a4f71-eec8-4a0a-b029-cb5bfa2e7a4a" returned: 0 in 0.276s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:40 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e1a629b6-1cad-4ad0-91b0-dba5337ad75a tempest-VolumesActionsTest-532219026 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:37:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e1a629b6-1cad-4ad0-91b0-dba5337ad75a tempest-VolumesActionsTest-532219026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e1a629b6-1cad-4ad0-91b0-dba5337ad75a tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09c26535-35e9-44a5-a06f-c1204a7fa518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb9a4f71-eec8-4a0a-b029-cb5bfa2e7a4a', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e1a629b6-1cad-4ad0-91b0-dba5337ad75a tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c9e435c-2c1d-4095-ae4e-e05be6f7c51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:40 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-e1a629b6-1cad-4ad0-91b0-dba5337ad75a tempest-VolumesActionsTest-532219026 None] Volume volume-cb9a4f71-eec8-4a0a-b029-cb5bfa2e7a4a (cb9a4f71-eec8-4a0a-b029-cb5bfa2e7a4a): created successfully Nov 02 12:37:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e1a629b6-1cad-4ad0-91b0-dba5337ad75a tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c9e435c-2c1d-4095-ae4e-e05be6f7c51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e1a629b6-1cad-4ad0-91b0-dba5337ad75a tempest-VolumesActionsTest-532219026 None] Flow 'volume_create_manager' (577ceecb-386e-403d-a9a4-375d7e571388) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:40 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-e1a629b6-1cad-4ad0-91b0-dba5337ad75a tempest-VolumesActionsTest-532219026 None] Created volume successfully. Nov 02 12:37:42 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-04bd164a-98f7-4cbc-914b-b8df05853b07 tempest-VolumesActionsTest-909889282 None] Acquiring lock "cinder-cb9a4f71-eec8-4a0a-b029-cb5bfa2e7a4a-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:42 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-04bd164a-98f7-4cbc-914b-b8df05853b07 tempest-VolumesActionsTest-909889282 None] Lock "cinder-cb9a4f71-eec8-4a0a-b029-cb5bfa2e7a4a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:42 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-04bd164a-98f7-4cbc-914b-b8df05853b07 tempest-VolumesActionsTest-909889282 None] Acquiring lock "cinder-quobyte-cb9a4f71-eec8-4a0a-b029-cb5bfa2e7a4a" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:42 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-04bd164a-98f7-4cbc-914b-b8df05853b07 tempest-VolumesActionsTest-909889282 None] Lock "cinder-quobyte-cb9a4f71-eec8-4a0a-b029-cb5bfa2e7a4a" acquired by "delete_volume" :: waited 0.017s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:42 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba76b4c3-abde-4a08-b7db-e94bf8c15327]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:37:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-04bd164a-98f7-4cbc-914b-b8df05853b07 tempest-VolumesActionsTest-909889282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cb9a4f71-eec8-4a0a-b029-cb5bfa2e7a4a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:42 devstack sudo[101736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cb9a4f71-eec8-4a0a-b029-cb5bfa2e7a4a Nov 02 12:37:42 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:42 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-04bd164a-98f7-4cbc-914b-b8df05853b07 tempest-VolumesActionsTest-909889282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cb9a4f71-eec8-4a0a-b029-cb5bfa2e7a4a" returned: 0 in 0.387s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-04bd164a-98f7-4cbc-914b-b8df05853b07 tempest-VolumesActionsTest-909889282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cb9a4f71-eec8-4a0a-b029-cb5bfa2e7a4a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:42 devstack sudo[101742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cb9a4f71-eec8-4a0a-b029-cb5bfa2e7a4a Nov 02 12:37:42 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:43 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-04bd164a-98f7-4cbc-914b-b8df05853b07 tempest-VolumesActionsTest-909889282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cb9a4f71-eec8-4a0a-b029-cb5bfa2e7a4a" returned: 0 in 0.273s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:43 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-04bd164a-98f7-4cbc-914b-b8df05853b07 tempest-VolumesActionsTest-909889282 None] Lock "cinder-quobyte-cb9a4f71-eec8-4a0a-b029-cb5bfa2e7a4a" released by "delete_volume" :: held 0.709s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:43 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-04bd164a-98f7-4cbc-914b-b8df05853b07 tempest-VolumesActionsTest-909889282 None] Created reservations ['f726f60f-f20d-4028-925d-b86211076a32', 'bbe88285-e3e8-4ce0-8d6e-d2b68d14c261', '86588e8e-4fd5-449a-a59d-f55d6da4a59b', 'c5317810-e27c-4ff2-bdaa-e93eebbd5244'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:37:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-04bd164a-98f7-4cbc-914b-b8df05853b07 tempest-VolumesActionsTest-909889282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-04bd164a-98f7-4cbc-914b-b8df05853b07 tempest-VolumesActionsTest-909889282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-04bd164a-98f7-4cbc-914b-b8df05853b07 tempest-VolumesActionsTest-909889282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-04bd164a-98f7-4cbc-914b-b8df05853b07 tempest-VolumesActionsTest-909889282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-04bd164a-98f7-4cbc-914b-b8df05853b07 tempest-VolumesActionsTest-909889282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-04bd164a-98f7-4cbc-914b-b8df05853b07 tempest-VolumesActionsTest-909889282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:43 devstack sudo[101745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:37:43 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:43 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-04bd164a-98f7-4cbc-914b-b8df05853b07 tempest-VolumesActionsTest-909889282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.345s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:43 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-04bd164a-98f7-4cbc-914b-b8df05853b07 tempest-VolumesActionsTest-909889282 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:37:43 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-04bd164a-98f7-4cbc-914b-b8df05853b07 tempest-VolumesActionsTest-909889282 None] Deleted volume successfully. Nov 02 12:37:43 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-04bd164a-98f7-4cbc-914b-b8df05853b07 tempest-VolumesActionsTest-909889282 None] Lock "cinder-cb9a4f71-eec8-4a0a-b029-cb5bfa2e7a4a-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:43 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:37:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:43 devstack sudo[101748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:37:43 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:44 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-df75a1b2-5321-42fb-adde-165a37b7cc70 tempest-VolumesActionsTest-532219026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:37:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-df75a1b2-5321-42fb-adde-165a37b7cc70 tempest-VolumesActionsTest-532219026 None] Flow 'volume_create_manager' (a78a25f7-88e4-49a8-a28f-9d1e76f530d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-df75a1b2-5321-42fb-adde-165a37b7cc70 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (481d3e4d-5123-4900-8068-b519ccc8409f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:44 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-df75a1b2-5321-42fb-adde-165a37b7cc70 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (481d3e4d-5123-4900-8068-b519ccc8409f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-652659669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ad96b4-ed9a-40c2-bf8d-19bbdc57c497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5091079442c4a4ab610d755438c5448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:44Z,use_quota=True,user_id='c431e1f5074f4e54b37ce024ccbba5fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-df75a1b2-5321-42fb-adde-165a37b7cc70 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f70dfa2-a4ce-4bef-86c3-7d2ead977b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-df75a1b2-5321-42fb-adde-165a37b7cc70 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f70dfa2-a4ce-4bef-86c3-7d2ead977b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-df75a1b2-5321-42fb-adde-165a37b7cc70 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (026099ef-62b1-48a1-aeae-34cb604e5906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-df75a1b2-5321-42fb-adde-165a37b7cc70 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (026099ef-62b1-48a1-aeae-34cb604e5906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6ad96b4-ed9a-40c2-bf8d-19bbdc57c497', 'volume_name': 'volume-c6ad96b4-ed9a-40c2-bf8d-19bbdc57c497', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-df75a1b2-5321-42fb-adde-165a37b7cc70 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f68d8824-e512-47ca-8e3c-4dafdf92c73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-df75a1b2-5321-42fb-adde-165a37b7cc70 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f68d8824-e512-47ca-8e3c-4dafdf92c73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-df75a1b2-5321-42fb-adde-165a37b7cc70 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eafc4758-a04f-419c-9b03-c70231496e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:44 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-df75a1b2-5321-42fb-adde-165a37b7cc70 tempest-VolumesActionsTest-532219026 None] Volume c6ad96b4-ed9a-40c2-bf8d-19bbdc57c497: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6ad96b4-ed9a-40c2-bf8d-19bbdc57c497', 'volume_size': 1} Nov 02 12:37:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-df75a1b2-5321-42fb-adde-165a37b7cc70 tempest-VolumesActionsTest-532219026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-df75a1b2-5321-42fb-adde-165a37b7cc70 tempest-VolumesActionsTest-532219026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:44 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-df75a1b2-5321-42fb-adde-165a37b7cc70 tempest-VolumesActionsTest-532219026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-652659669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ad96b4-ed9a-40c2-bf8d-19bbdc57c497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5091079442c4a4ab610d755438c5448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:44Z,use_quota=True,user_id='c431e1f5074f4e54b37ce024ccbba5fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:37:44 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-df75a1b2-5321-42fb-adde-165a37b7cc70 tempest-VolumesActionsTest-532219026 None] Creating volume c6ad96b4-ed9a-40c2-bf8d-19bbdc57c497 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:37:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-df75a1b2-5321-42fb-adde-165a37b7cc70 tempest-VolumesActionsTest-532219026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-df75a1b2-5321-42fb-adde-165a37b7cc70 tempest-VolumesActionsTest-532219026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:44 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-df75a1b2-5321-42fb-adde-165a37b7cc70 tempest-VolumesActionsTest-532219026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:44 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-df75a1b2-5321-42fb-adde-165a37b7cc70 tempest-VolumesActionsTest-532219026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-df75a1b2-5321-42fb-adde-165a37b7cc70 tempest-VolumesActionsTest-532219026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:44 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-df75a1b2-5321-42fb-adde-165a37b7cc70 tempest-VolumesActionsTest-532219026 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:37:44 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-df75a1b2-5321-42fb-adde-165a37b7cc70 tempest-VolumesActionsTest-532219026 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:37:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-df75a1b2-5321-42fb-adde-165a37b7cc70 tempest-VolumesActionsTest-532219026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c6ad96b4-ed9a-40c2-bf8d-19bbdc57c497 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.314s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:44 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:37:44 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager._thread_info {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:37:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread count: 28 {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:37:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread info: [<_MainThread(MainThread, started 129944084402304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:37:44 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c6ad96b4-ed9a-40c2-bf8d-19bbdc57c497 1073741824 Nov 02 12:37:44 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:44 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-df75a1b2-5321-42fb-adde-165a37b7cc70 tempest-VolumesActionsTest-532219026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c6ad96b4-ed9a-40c2-bf8d-19bbdc57c497 1073741824" returned: 0 in 0.479s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-df75a1b2-5321-42fb-adde-165a37b7cc70 tempest-VolumesActionsTest-532219026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c6ad96b4-ed9a-40c2-bf8d-19bbdc57c497 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:44 devstack sudo[101758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c6ad96b4-ed9a-40c2-bf8d-19bbdc57c497 Nov 02 12:37:44 devstack sudo[101758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:44 devstack sudo[101758]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-df75a1b2-5321-42fb-adde-165a37b7cc70 tempest-VolumesActionsTest-532219026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c6ad96b4-ed9a-40c2-bf8d-19bbdc57c497" returned: 0 in 0.251s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:44 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-df75a1b2-5321-42fb-adde-165a37b7cc70 tempest-VolumesActionsTest-532219026 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:37:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-df75a1b2-5321-42fb-adde-165a37b7cc70 tempest-VolumesActionsTest-532219026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-df75a1b2-5321-42fb-adde-165a37b7cc70 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eafc4758-a04f-419c-9b03-c70231496e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6ad96b4-ed9a-40c2-bf8d-19bbdc57c497', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-df75a1b2-5321-42fb-adde-165a37b7cc70 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3167ecf-b40b-420a-acf7-bd86f94a5aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:45 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-df75a1b2-5321-42fb-adde-165a37b7cc70 tempest-VolumesActionsTest-532219026 None] Volume volume-c6ad96b4-ed9a-40c2-bf8d-19bbdc57c497 (c6ad96b4-ed9a-40c2-bf8d-19bbdc57c497): created successfully Nov 02 12:37:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-df75a1b2-5321-42fb-adde-165a37b7cc70 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3167ecf-b40b-420a-acf7-bd86f94a5aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-df75a1b2-5321-42fb-adde-165a37b7cc70 tempest-VolumesActionsTest-532219026 None] Flow 'volume_create_manager' (a78a25f7-88e4-49a8-a28f-9d1e76f530d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:45 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-df75a1b2-5321-42fb-adde-165a37b7cc70 tempest-VolumesActionsTest-532219026 None] Created volume successfully. Nov 02 12:37:46 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-814b42a6-5b67-44fe-a7b6-7107a8437ada tempest-VolumesActionsTest-909889282 None] Acquiring lock "cinder-c6ad96b4-ed9a-40c2-bf8d-19bbdc57c497-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:46 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-814b42a6-5b67-44fe-a7b6-7107a8437ada tempest-VolumesActionsTest-909889282 None] Lock "cinder-c6ad96b4-ed9a-40c2-bf8d-19bbdc57c497-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:46 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-814b42a6-5b67-44fe-a7b6-7107a8437ada tempest-VolumesActionsTest-909889282 None] Acquiring lock "cinder-quobyte-c6ad96b4-ed9a-40c2-bf8d-19bbdc57c497" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:46 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-814b42a6-5b67-44fe-a7b6-7107a8437ada tempest-VolumesActionsTest-909889282 None] Lock "cinder-quobyte-c6ad96b4-ed9a-40c2-bf8d-19bbdc57c497" acquired by "delete_volume" :: waited 0.020s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:46 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3a3b50-4f77-47d1-b73d-a0779908e6a3]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:37:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-814b42a6-5b67-44fe-a7b6-7107a8437ada tempest-VolumesActionsTest-909889282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c6ad96b4-ed9a-40c2-bf8d-19bbdc57c497 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:46 devstack sudo[101770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c6ad96b4-ed9a-40c2-bf8d-19bbdc57c497 Nov 02 12:37:46 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:46 devstack sudo[101770]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-814b42a6-5b67-44fe-a7b6-7107a8437ada tempest-VolumesActionsTest-909889282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c6ad96b4-ed9a-40c2-bf8d-19bbdc57c497" returned: 0 in 0.372s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-814b42a6-5b67-44fe-a7b6-7107a8437ada tempest-VolumesActionsTest-909889282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c6ad96b4-ed9a-40c2-bf8d-19bbdc57c497 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:46 devstack sudo[101775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c6ad96b4-ed9a-40c2-bf8d-19bbdc57c497 Nov 02 12:37:46 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:47 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-814b42a6-5b67-44fe-a7b6-7107a8437ada tempest-VolumesActionsTest-909889282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c6ad96b4-ed9a-40c2-bf8d-19bbdc57c497" returned: 0 in 0.252s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:47 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-814b42a6-5b67-44fe-a7b6-7107a8437ada tempest-VolumesActionsTest-909889282 None] Lock "cinder-quobyte-c6ad96b4-ed9a-40c2-bf8d-19bbdc57c497" released by "delete_volume" :: held 0.669s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:47 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-814b42a6-5b67-44fe-a7b6-7107a8437ada tempest-VolumesActionsTest-909889282 None] Created reservations ['d33daba8-315b-4881-bc6a-fa29c3f55a4e', '47de2d6e-0f0c-47cf-9ecc-8136ca9f0aec', 'eb3d8d85-d442-405b-9bc4-7459bff504e5', 'c7efe891-ff8d-49c2-91c7-1c804f625194'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:37:47 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:37:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Flow 'volume_create_manager' (1c3e7a68-c695-460e-965b-4f654a79f6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db82b720-cae8-4d5e-812c-4bc00aafa2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-814b42a6-5b67-44fe-a7b6-7107a8437ada tempest-VolumesActionsTest-909889282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-814b42a6-5b67-44fe-a7b6-7107a8437ada tempest-VolumesActionsTest-909889282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:47 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-814b42a6-5b67-44fe-a7b6-7107a8437ada tempest-VolumesActionsTest-909889282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:47 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-814b42a6-5b67-44fe-a7b6-7107a8437ada tempest-VolumesActionsTest-909889282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-814b42a6-5b67-44fe-a7b6-7107a8437ada tempest-VolumesActionsTest-909889282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-814b42a6-5b67-44fe-a7b6-7107a8437ada tempest-VolumesActionsTest-909889282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db82b720-cae8-4d5e-812c-4bc00aafa2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1491943433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f59e28ae-e543-43ab-9559-ed2f3eb76d4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='048f17692fd748cf90132ac3bb37a384',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:47Z,use_quota=True,user_id='2ea1233150044fa2a8a33f4d6817f4c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:47 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:37:47 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7149046-b074-431a-9996-34b3cbf15a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7149046-b074-431a-9996-34b3cbf15a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab684684-2656-4721-b142-ab113e531adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:47 devstack cinder-volume[86515]: DEBUG cinder.image.glance [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Creating Keystone auth plugin from conf {{(pid=86515) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 12:37:47 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-814b42a6-5b67-44fe-a7b6-7107a8437ada tempest-VolumesActionsTest-909889282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.253s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:47 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-814b42a6-5b67-44fe-a7b6-7107a8437ada tempest-VolumesActionsTest-909889282 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:37:47 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-814b42a6-5b67-44fe-a7b6-7107a8437ada tempest-VolumesActionsTest-909889282 None] Deleted volume successfully. Nov 02 12:37:47 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-814b42a6-5b67-44fe-a7b6-7107a8437ada tempest-VolumesActionsTest-909889282 None] Lock "cinder-c6ad96b4-ed9a-40c2-bf8d-19bbdc57c497-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab684684-2656-4721-b142-ab113e531adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f59e28ae-e543-43ab-9559-ed2f3eb76d4f', 'volume_name': 'volume-f59e28ae-e543-43ab-9559-ed2f3eb76d4f', 'volume_size': 1, 'image_id': '4d531188-e398-41fe-8056-e52aa8e7c4ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d531188-e398-41fe-8056-e52aa8e7c4ab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ea64174531846a688f10d8f38a757ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d531188-e398-41fe-8056-e52aa8e7c4ab', 'created_at': datetime.datetime(2026, 11, 2, 11, 16, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 16, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d531188-e398-41fe-8056-e52aa8e7c4ab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cd1cd39-eec4-4bf2-896f-b962391d080f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cd1cd39-eec4-4bf2-896f-b962391d080f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1e008a9-8cd5-4234-9026-8248c9b45fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:47 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Volume f59e28ae-e543-43ab-9559-ed2f3eb76d4f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f59e28ae-e543-43ab-9559-ed2f3eb76d4f', 'volume_size': 1, 'image_id': '4d531188-e398-41fe-8056-e52aa8e7c4ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d531188-e398-41fe-8056-e52aa8e7c4ab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ea64174531846a688f10d8f38a757ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d531188-e398-41fe-8056-e52aa8e7c4ab', 'created_at': datetime.datetime(2026, 11, 2, 11, 16, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 16, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d531188-e398-41fe-8056-e52aa8e7c4ab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 12:37:47 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Trying to clone f59e28ae-e543-43ab-9559-ed2f3eb76d4f from image 4d531188-e398-41fe-8056-e52aa8e7c4ab at location (None, [{'url': 'file:///opt/stack/data/glance/images/4d531188-e398-41fe-8056-e52aa8e7c4ab', 'metadata': {}}]). {{(pid=86515) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1127}} Nov 02 12:37:47 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_o8bgkxx_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86515) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 12:37:47 devstack cinder-volume[86515]: INFO cinder.image.image_utils [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Image download 20.69 MB at 20.69 MB/s Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed92f746-1eb3-4ac6-b754-ffafa95fc552]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_o8bgkxx_devstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-3660b655-e94d-4107-8a54-823185d6cb84 tempest-VolumesActionsTest-532219026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3660b655-e94d-4107-8a54-823185d6cb84 tempest-VolumesActionsTest-532219026 None] Flow 'volume_create_manager' (28dbd7f1-55c5-4a8f-8a38-be63051f5b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3660b655-e94d-4107-8a54-823185d6cb84 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f824c0d-691f-47de-bd45-bc3d847fc3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3660b655-e94d-4107-8a54-823185d6cb84 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f824c0d-691f-47de-bd45-bc3d847fc3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1663959659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=394d8874-6ac3-4f4a-a817-9fd2b8d83840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5091079442c4a4ab610d755438c5448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:48Z,use_quota=True,user_id='c431e1f5074f4e54b37ce024ccbba5fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3660b655-e94d-4107-8a54-823185d6cb84 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf55cf0-e3af-4e18-b878-94064b910d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3660b655-e94d-4107-8a54-823185d6cb84 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf55cf0-e3af-4e18-b878-94064b910d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:48 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_o8bgkxx_devstack@QuobyteHD Nov 02 12:37:48 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3660b655-e94d-4107-8a54-823185d6cb84 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef9a11c-98a7-4533-aeeb-732ec43ab8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3660b655-e94d-4107-8a54-823185d6cb84 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef9a11c-98a7-4533-aeeb-732ec43ab8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '394d8874-6ac3-4f4a-a817-9fd2b8d83840', 'volume_name': 'volume-394d8874-6ac3-4f4a-a817-9fd2b8d83840', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3660b655-e94d-4107-8a54-823185d6cb84 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32bddcb7-c8aa-4567-83de-5f29fb631f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3660b655-e94d-4107-8a54-823185d6cb84 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32bddcb7-c8aa-4567-83de-5f29fb631f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3660b655-e94d-4107-8a54-823185d6cb84 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ef58ef2-e326-4f83-994e-3775b236dcb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:48 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-3660b655-e94d-4107-8a54-823185d6cb84 tempest-VolumesActionsTest-532219026 None] Volume 394d8874-6ac3-4f4a-a817-9fd2b8d83840: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-394d8874-6ac3-4f4a-a817-9fd2b8d83840', 'volume_size': 1} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3660b655-e94d-4107-8a54-823185d6cb84 tempest-VolumesActionsTest-532219026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3660b655-e94d-4107-8a54-823185d6cb84 tempest-VolumesActionsTest-532219026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3660b655-e94d-4107-8a54-823185d6cb84 tempest-VolumesActionsTest-532219026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1663959659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=394d8874-6ac3-4f4a-a817-9fd2b8d83840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5091079442c4a4ab610d755438c5448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:48Z,use_quota=True,user_id='c431e1f5074f4e54b37ce024ccbba5fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-3660b655-e94d-4107-8a54-823185d6cb84 tempest-VolumesActionsTest-532219026 None] Creating volume 394d8874-6ac3-4f4a-a817-9fd2b8d83840 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3660b655-e94d-4107-8a54-823185d6cb84 tempest-VolumesActionsTest-532219026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3660b655-e94d-4107-8a54-823185d6cb84 tempest-VolumesActionsTest-532219026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3660b655-e94d-4107-8a54-823185d6cb84 tempest-VolumesActionsTest-532219026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3660b655-e94d-4107-8a54-823185d6cb84 tempest-VolumesActionsTest-532219026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3660b655-e94d-4107-8a54-823185d6cb84 tempest-VolumesActionsTest-532219026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3660b655-e94d-4107-8a54-823185d6cb84 tempest-VolumesActionsTest-532219026 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:37:48 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-3660b655-e94d-4107-8a54-823185d6cb84 tempest-VolumesActionsTest-532219026 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3660b655-e94d-4107-8a54-823185d6cb84 tempest-VolumesActionsTest-532219026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-394d8874-6ac3-4f4a-a817-9fd2b8d83840 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:48 devstack sudo[101784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-394d8874-6ac3-4f4a-a817-9fd2b8d83840 1073741824 Nov 02 12:37:48 devstack sudo[101784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:48 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_o8bgkxx_devstack@QuobyteHD" returned: 0 in 0.356s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Temporary image 4d531188-e398-41fe-8056-e52aa8e7c4ab is fetched for user 2ea1233150044fa2a8a33f4d6817f4c2. {{(pid=86515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd23c595-61ec-42c5-b72a-11fdb6556105]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_o8bgkxx_devstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:48 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_o8bgkxx_devstack@QuobyteHD Nov 02 12:37:48 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:48 devstack sudo[101784]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3660b655-e94d-4107-8a54-823185d6cb84 tempest-VolumesActionsTest-532219026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-394d8874-6ac3-4f4a-a817-9fd2b8d83840 1073741824" returned: 0 in 0.437s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3660b655-e94d-4107-8a54-823185d6cb84 tempest-VolumesActionsTest-532219026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-394d8874-6ac3-4f4a-a817-9fd2b8d83840 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:48 devstack sudo[101795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-394d8874-6ac3-4f4a-a817-9fd2b8d83840 Nov 02 12:37:48 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:48 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_o8bgkxx_devstack@QuobyteHD" returned: 0 in 0.338s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:48 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3660b655-e94d-4107-8a54-823185d6cb84 tempest-VolumesActionsTest-532219026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-394d8874-6ac3-4f4a-a817-9fd2b8d83840" returned: 0 in 0.245s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3660b655-e94d-4107-8a54-823185d6cb84 tempest-VolumesActionsTest-532219026 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3660b655-e94d-4107-8a54-823185d6cb84 tempest-VolumesActionsTest-532219026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.127s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1491943433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f59e28ae-e543-43ab-9559-ed2f3eb76d4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='048f17692fd748cf90132ac3bb37a384',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:37:47Z,use_quota=True,user_id='2ea1233150044fa2a8a33f4d6817f4c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Creating volume f59e28ae-e543-43ab-9559-ed2f3eb76d4f {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:37:48 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f59e28ae-e543-43ab-9559-ed2f3eb76d4f 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3660b655-e94d-4107-8a54-823185d6cb84 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ef58ef2-e326-4f83-994e-3775b236dcb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-394d8874-6ac3-4f4a-a817-9fd2b8d83840', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:48 devstack sudo[101801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f59e28ae-e543-43ab-9559-ed2f3eb76d4f 1073741824 Nov 02 12:37:48 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3660b655-e94d-4107-8a54-823185d6cb84 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c257777-a120-4952-a285-04662f290fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:48 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-3660b655-e94d-4107-8a54-823185d6cb84 tempest-VolumesActionsTest-532219026 None] Volume volume-394d8874-6ac3-4f4a-a817-9fd2b8d83840 (394d8874-6ac3-4f4a-a817-9fd2b8d83840): created successfully Nov 02 12:37:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3660b655-e94d-4107-8a54-823185d6cb84 tempest-VolumesActionsTest-532219026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c257777-a120-4952-a285-04662f290fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3660b655-e94d-4107-8a54-823185d6cb84 tempest-VolumesActionsTest-532219026 None] Flow 'volume_create_manager' (28dbd7f1-55c5-4a8f-8a38-be63051f5b1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:49 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-3660b655-e94d-4107-8a54-823185d6cb84 tempest-VolumesActionsTest-532219026 None] Created volume successfully. Nov 02 12:37:49 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f59e28ae-e543-43ab-9559-ed2f3eb76d4f 1073741824" returned: 0 in 0.425s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f59e28ae-e543-43ab-9559-ed2f3eb76d4f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:49 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f59e28ae-e543-43ab-9559-ed2f3eb76d4f Nov 02 12:37:49 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:49 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f59e28ae-e543-43ab-9559-ed2f3eb76d4f" returned: 0 in 0.236s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:49 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:37:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:49 devstack cinder-volume[86515]: DEBUG cinder.volume.volume_utils [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Attempting download of 4d531188-e398-41fe-8056-e52aa8e7c4ab ((None, [{'url': 'file:///opt/stack/data/glance/images/4d531188-e398-41fe-8056-e52aa8e7c4ab', 'metadata': {}}])) to volume f59e28ae-e543-43ab-9559-ed2f3eb76d4f. {{(pid=86515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 12:37:49 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ca8e74-ffc8-45a6-930e-e78a65c12ea8]: (4, 'raw') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:37:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d531188-e398-41fe-8056-e52aa8e7c4ab_41lt0en8 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:49 devstack sudo[101810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d531188-e398-41fe-8056-e52aa8e7c4ab_41lt0en8 Nov 02 12:37:49 devstack sudo[101810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:50 devstack sudo[101810]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4d531188-e398-41fe-8056-e52aa8e7c4ab_41lt0en8" returned: 0 in 0.323s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d531188-e398-41fe-8056-e52aa8e7c4ab_41lt0en8 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:50 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d531188-e398-41fe-8056-e52aa8e7c4ab_41lt0en8 Nov 02 12:37:50 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:50 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d531188-e398-41fe-8056-e52aa8e7c4ab_41lt0en8" returned: 1 in 0.369s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4d531188-e398-41fe-8056-e52aa8e7c4ab_41lt0en8' failed. Not Retrying. {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:37:50 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec011ab5-6c68-41da-8808-fdf471c2b6e3]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:37:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_o8bgkxx_devstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:50 devstack sudo[101818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_o8bgkxx_devstack@QuobyteHD Nov 02 12:37:50 devstack sudo[101818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:50 devstack sudo[101818]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_o8bgkxx_devstack@QuobyteHD" returned: 0 in 0.340s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:50 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] 4d531188-e398-41fe-8056-e52aa8e7c4ab was qcow2, converting to qcow2 {{(pid=86515) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 12:37:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_o8bgkxx_devstack@QuobyteHD /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f59e28ae-e543-43ab-9559-ed2f3eb76d4f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:50 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-aa6fc0d6-7709-4e2f-b16b-398a6a4e1fae tempest-VolumesActionsTest-532219026 None] Acquiring lock "cinder-394d8874-6ac3-4f4a-a817-9fd2b8d83840-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:50 devstack sudo[101823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_o8bgkxx_devstack@QuobyteHD /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f59e28ae-e543-43ab-9559-ed2f3eb76d4f Nov 02 12:37:50 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:50 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-aa6fc0d6-7709-4e2f-b16b-398a6a4e1fae tempest-VolumesActionsTest-532219026 None] Lock "cinder-394d8874-6ac3-4f4a-a817-9fd2b8d83840-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:50 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-aa6fc0d6-7709-4e2f-b16b-398a6a4e1fae tempest-VolumesActionsTest-532219026 None] Acquiring lock "cinder-quobyte-394d8874-6ac3-4f4a-a817-9fd2b8d83840" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:37:50 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-aa6fc0d6-7709-4e2f-b16b-398a6a4e1fae tempest-VolumesActionsTest-532219026 None] Lock "cinder-quobyte-394d8874-6ac3-4f4a-a817-9fd2b8d83840" acquired by "delete_volume" :: waited 0.019s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:37:50 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c9ce1a-c371-45e6-8a54-c136918eb327]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:37:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-aa6fc0d6-7709-4e2f-b16b-398a6a4e1fae tempest-VolumesActionsTest-532219026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-394d8874-6ac3-4f4a-a817-9fd2b8d83840 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:50 devstack sudo[101825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-394d8874-6ac3-4f4a-a817-9fd2b8d83840 Nov 02 12:37:50 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:51 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-aa6fc0d6-7709-4e2f-b16b-398a6a4e1fae tempest-VolumesActionsTest-532219026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-394d8874-6ac3-4f4a-a817-9fd2b8d83840" returned: 0 in 0.399s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-aa6fc0d6-7709-4e2f-b16b-398a6a4e1fae tempest-VolumesActionsTest-532219026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-394d8874-6ac3-4f4a-a817-9fd2b8d83840 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:51 devstack sudo[101836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-394d8874-6ac3-4f4a-a817-9fd2b8d83840 Nov 02 12:37:51 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:51 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-aa6fc0d6-7709-4e2f-b16b-398a6a4e1fae tempest-VolumesActionsTest-532219026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-394d8874-6ac3-4f4a-a817-9fd2b8d83840" returned: 0 in 0.279s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:51 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-aa6fc0d6-7709-4e2f-b16b-398a6a4e1fae tempest-VolumesActionsTest-532219026 None] Lock "cinder-quobyte-394d8874-6ac3-4f4a-a817-9fd2b8d83840" released by "delete_volume" :: held 0.724s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:51 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-aa6fc0d6-7709-4e2f-b16b-398a6a4e1fae tempest-VolumesActionsTest-532219026 None] Created reservations ['b9eff9a4-a74d-4307-b5ed-cb7a3e3cb6de', 'fd682356-fe07-413c-abe8-3841d5f27940', 'c630a10b-8a96-4d24-b493-fc3ceced7098', 'a6561b1f-a607-42eb-af70-20187db1bc8a'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:37:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-aa6fc0d6-7709-4e2f-b16b-398a6a4e1fae tempest-VolumesActionsTest-532219026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-aa6fc0d6-7709-4e2f-b16b-398a6a4e1fae tempest-VolumesActionsTest-532219026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:51 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-aa6fc0d6-7709-4e2f-b16b-398a6a4e1fae tempest-VolumesActionsTest-532219026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:37:51 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-aa6fc0d6-7709-4e2f-b16b-398a6a4e1fae tempest-VolumesActionsTest-532219026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:37:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-aa6fc0d6-7709-4e2f-b16b-398a6a4e1fae tempest-VolumesActionsTest-532219026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-aa6fc0d6-7709-4e2f-b16b-398a6a4e1fae tempest-VolumesActionsTest-532219026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:51 devstack sudo[101840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:37:51 devstack sudo[101840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:51 devstack sudo[101840]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-aa6fc0d6-7709-4e2f-b16b-398a6a4e1fae tempest-VolumesActionsTest-532219026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.261s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:51 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-aa6fc0d6-7709-4e2f-b16b-398a6a4e1fae tempest-VolumesActionsTest-532219026 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:37:51 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-aa6fc0d6-7709-4e2f-b16b-398a6a4e1fae tempest-VolumesActionsTest-532219026 None] Deleted volume successfully. Nov 02 12:37:51 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-aa6fc0d6-7709-4e2f-b16b-398a6a4e1fae tempest-VolumesActionsTest-532219026 None] Lock "cinder-394d8874-6ac3-4f4a-a817-9fd2b8d83840-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:37:52 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_o8bgkxx_devstack@QuobyteHD /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f59e28ae-e543-43ab-9559-ed2f3eb76d4f" returned: 0 in 1.826s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:52 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4d531188-e398-41fe-8056-e52aa8e7c4ab_o8bgkxx_devstack@QuobyteHD, size 112.00 MB, duration 1.83 sec, destination /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f59e28ae-e543-43ab-9559-ed2f3eb76d4f {{(pid=86515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 12:37:52 devstack cinder-volume[86515]: INFO cinder.image.image_utils [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Converted 112.00 MB image at 61.32 MB/s Nov 02 12:37:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f59e28ae-e543-43ab-9559-ed2f3eb76d4f 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:37:52 devstack sudo[101845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f59e28ae-e543-43ab-9559-ed2f3eb76d4f 1G Nov 02 12:37:52 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:37:52 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root Nov 02 12:37:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f59e28ae-e543-43ab-9559-ed2f3eb76d4f 1G" returned: 0 in 0.345s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:37:52 devstack cinder-volume[86515]: DEBUG cinder.volume.volume_utils [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Downloaded image 4d531188-e398-41fe-8056-e52aa8e7c4ab ((None, [{'url': 'file:///opt/stack/data/glance/images/4d531188-e398-41fe-8056-e52aa8e7c4ab', 'metadata': {}}])) to volume f59e28ae-e543-43ab-9559-ed2f3eb76d4f successfully. {{(pid=86515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 12:37:52 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Temporary image 4d531188-e398-41fe-8056-e52aa8e7c4ab for user 2ea1233150044fa2a8a33f4d6817f4c2 is deleted. {{(pid=86515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 12:37:52 devstack cinder-volume[86515]: DEBUG cinder.volume.volume_utils [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Marking volume f59e28ae-e543-43ab-9559-ed2f3eb76d4f as bootable. {{(pid=86515) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 12:37:52 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Copying metadata from image 4d531188-e398-41fe-8056-e52aa8e7c4ab to f59e28ae-e543-43ab-9559-ed2f3eb76d4f. {{(pid=86515) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 12:37:52 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Creating volume glance metadata for volume f59e28ae-e543-43ab-9559-ed2f3eb76d4f backed by image 4d531188-e398-41fe-8056-e52aa8e7c4ab with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4d531188-e398-41fe-8056-e52aa8e7c4ab', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86515) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 12:37:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1e008a9-8cd5-4234-9026-8248c9b45fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f59e28ae-e543-43ab-9559-ed2f3eb76d4f', 'volume_size': 1, 'image_id': '4d531188-e398-41fe-8056-e52aa8e7c4ab', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4d531188-e398-41fe-8056-e52aa8e7c4ab', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0ea64174531846a688f10d8f38a757ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4d531188-e398-41fe-8056-e52aa8e7c4ab', 'created_at': datetime.datetime(2026, 11, 2, 11, 16, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 16, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4d531188-e398-41fe-8056-e52aa8e7c4ab/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a5b143-c2a1-4f3a-89fb-2e6c579abe01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:37:53 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Volume volume-f59e28ae-e543-43ab-9559-ed2f3eb76d4f (f59e28ae-e543-43ab-9559-ed2f3eb76d4f): created successfully Nov 02 12:37:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a5b143-c2a1-4f3a-89fb-2e6c579abe01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:37:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Flow 'volume_create_manager' (1c3e7a68-c695-460e-965b-4f654a79f6c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:37:53 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-53ed4104-a5b5-4457-bcc6-b78386cd14e7 tempest-TestShelveInstance-2111934223 None] Created volume successfully. Nov 02 12:37:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-4d970ae0-59d8-48e4-ae8b-4fa62a2cc223 req-f1167c87-7ec5-48e7-9e0a-9b07a7ce02b9 tempest-TestShelveInstance-2111934223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:37:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-4d970ae0-59d8-48e4-ae8b-4fa62a2cc223 req-f1167c87-7ec5-48e7-9e0a-9b07a7ce02b9 tempest-TestShelveInstance-2111934223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:37:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-4d970ae0-59d8-48e4-ae8b-4fa62a2cc223 req-f1167c87-7ec5-48e7-9e0a-9b07a7ce02b9 tempest-TestShelveInstance-2111934223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:37:55 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-4d970ae0-59d8-48e4-ae8b-4fa62a2cc223 req-f1167c87-7ec5-48e7-9e0a-9b07a7ce02b9 tempest-TestShelveInstance-2111934223 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae', 'name': 'volume-f59e28ae-e543-43ab-9559-ed2f3eb76d4f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '779dce43-b01b-4917-bc89-a05966258fdb', 'enforce_multipath': True} {{(pid=86515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:37:56 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-4d970ae0-59d8-48e4-ae8b-4fa62a2cc223 req-f1167c87-7ec5-48e7-9e0a-9b07a7ce02b9 tempest-TestShelveInstance-2111934223 None] attachment_update completed successfully. Nov 02 12:38:06 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:UPDATE=116,cinder:SELECT=89,cinder:DELETE=12,cinder:INSERT=30 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:38:06 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=98,cinder:INSERT=36,cinder:UPDATE=123,cinder:DELETE=9 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:38:06 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1939bd3-5fc9-48da-8fd4-e185b4b56dc1 tempest-VolumesDeleteCascade-897627988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:38:06 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a1939bd3-5fc9-48da-8fd4-e185b4b56dc1 tempest-VolumesDeleteCascade-897627988 None] Flow 'volume_create_manager' (83af04c2-5295-4cae-803b-4a3159de61ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:38:06 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a1939bd3-5fc9-48da-8fd4-e185b4b56dc1 tempest-VolumesDeleteCascade-897627988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52d31f4-12b2-4813-b01a-ae2c4a5bdfa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:06 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a1939bd3-5fc9-48da-8fd4-e185b4b56dc1 tempest-VolumesDeleteCascade-897627988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52d31f4-12b2-4813-b01a-ae2c4a5bdfa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-184398750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c9284ac7e4750b0bd56ea17f53e26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:38:06Z,use_quota=True,user_id='ac062954c4624aa29de1034aa3d20b05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:06 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a1939bd3-5fc9-48da-8fd4-e185b4b56dc1 tempest-VolumesDeleteCascade-897627988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f705892e-09c7-45b7-aa95-04bbcf4fa382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:06 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a1939bd3-5fc9-48da-8fd4-e185b4b56dc1 tempest-VolumesDeleteCascade-897627988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f705892e-09c7-45b7-aa95-04bbcf4fa382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:06 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a1939bd3-5fc9-48da-8fd4-e185b4b56dc1 tempest-VolumesDeleteCascade-897627988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90dda1d2-3ce6-4529-b962-4e15a0c69123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:06 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a1939bd3-5fc9-48da-8fd4-e185b4b56dc1 tempest-VolumesDeleteCascade-897627988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90dda1d2-3ce6-4529-b962-4e15a0c69123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7', 'volume_name': 'volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:06 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a1939bd3-5fc9-48da-8fd4-e185b4b56dc1 tempest-VolumesDeleteCascade-897627988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (605caae1-b9a5-492c-9947-73cfe5bd82f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:06 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a1939bd3-5fc9-48da-8fd4-e185b4b56dc1 tempest-VolumesDeleteCascade-897627988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (605caae1-b9a5-492c-9947-73cfe5bd82f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:06 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a1939bd3-5fc9-48da-8fd4-e185b4b56dc1 tempest-VolumesDeleteCascade-897627988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a96299c0-a48f-4ce1-bbe3-8bd44c04db9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:06 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-a1939bd3-5fc9-48da-8fd4-e185b4b56dc1 tempest-VolumesDeleteCascade-897627988 None] Volume a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7', 'volume_size': 1} Nov 02 12:38:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a1939bd3-5fc9-48da-8fd4-e185b4b56dc1 tempest-VolumesDeleteCascade-897627988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a1939bd3-5fc9-48da-8fd4-e185b4b56dc1 tempest-VolumesDeleteCascade-897627988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:06 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a1939bd3-5fc9-48da-8fd4-e185b4b56dc1 tempest-VolumesDeleteCascade-897627988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-184398750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c9284ac7e4750b0bd56ea17f53e26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:38:06Z,use_quota=True,user_id='ac062954c4624aa29de1034aa3d20b05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:38:06 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-a1939bd3-5fc9-48da-8fd4-e185b4b56dc1 tempest-VolumesDeleteCascade-897627988 None] Creating volume a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:38:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a1939bd3-5fc9-48da-8fd4-e185b4b56dc1 tempest-VolumesDeleteCascade-897627988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a1939bd3-5fc9-48da-8fd4-e185b4b56dc1 tempest-VolumesDeleteCascade-897627988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:06 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a1939bd3-5fc9-48da-8fd4-e185b4b56dc1 tempest-VolumesDeleteCascade-897627988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:38:06 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a1939bd3-5fc9-48da-8fd4-e185b4b56dc1 tempest-VolumesDeleteCascade-897627988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:38:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a1939bd3-5fc9-48da-8fd4-e185b4b56dc1 tempest-VolumesDeleteCascade-897627988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:06 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a1939bd3-5fc9-48da-8fd4-e185b4b56dc1 tempest-VolumesDeleteCascade-897627988 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:38:06 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-a1939bd3-5fc9-48da-8fd4-e185b4b56dc1 tempest-VolumesDeleteCascade-897627988 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:38:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a1939bd3-5fc9-48da-8fd4-e185b4b56dc1 tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:06 devstack sudo[102350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7 1073741824 Nov 02 12:38:06 devstack sudo[102350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:06 devstack sudo[102350]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a1939bd3-5fc9-48da-8fd4-e185b4b56dc1 tempest-VolumesDeleteCascade-897627988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7 1073741824" returned: 0 in 0.395s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a1939bd3-5fc9-48da-8fd4-e185b4b56dc1 tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:06 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7 Nov 02 12:38:06 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:07 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a1939bd3-5fc9-48da-8fd4-e185b4b56dc1 tempest-VolumesDeleteCascade-897627988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7" returned: 0 in 0.233s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:07 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a1939bd3-5fc9-48da-8fd4-e185b4b56dc1 tempest-VolumesDeleteCascade-897627988 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:38:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a1939bd3-5fc9-48da-8fd4-e185b4b56dc1 tempest-VolumesDeleteCascade-897627988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a1939bd3-5fc9-48da-8fd4-e185b4b56dc1 tempest-VolumesDeleteCascade-897627988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a96299c0-a48f-4ce1-bbe3-8bd44c04db9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a1939bd3-5fc9-48da-8fd4-e185b4b56dc1 tempest-VolumesDeleteCascade-897627988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea79491e-4eea-4f28-add0-f097e235d380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:07 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-a1939bd3-5fc9-48da-8fd4-e185b4b56dc1 tempest-VolumesDeleteCascade-897627988 None] Volume volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7 (a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7): created successfully Nov 02 12:38:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a1939bd3-5fc9-48da-8fd4-e185b4b56dc1 tempest-VolumesDeleteCascade-897627988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea79491e-4eea-4f28-add0-f097e235d380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a1939bd3-5fc9-48da-8fd4-e185b4b56dc1 tempest-VolumesDeleteCascade-897627988 None] Flow 'volume_create_manager' (83af04c2-5295-4cae-803b-4a3159de61ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:38:07 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-a1939bd3-5fc9-48da-8fd4-e185b4b56dc1 tempest-VolumesDeleteCascade-897627988 None] Created volume successfully. Nov 02 12:38:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-abbbdec4-3a6e-4725-94b2-2bd4d85eec45 tempest-VolumesDeleteCascade-897627988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-abbbdec4-3a6e-4725-94b2-2bd4d85eec45 tempest-VolumesDeleteCascade-897627988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:07 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-abbbdec4-3a6e-4725-94b2-2bd4d85eec45 tempest-VolumesDeleteCascade-897627988 None] Creating offline snapshot f8982626-714e-4970-b555-4407eec67f05 of volume a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7 {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:38:07 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd89511-6ce2-4d48-8932-c74d9acb3ad8]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-abbbdec4-3a6e-4725-94b2-2bd4d85eec45 tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:07 devstack sudo[102358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7 Nov 02 12:38:07 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:07 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-abbbdec4-3a6e-4725-94b2-2bd4d85eec45 tempest-VolumesDeleteCascade-897627988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7" returned: 0 in 0.356s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-abbbdec4-3a6e-4725-94b2-2bd4d85eec45 tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.f8982626-714e-4970-b555-4407eec67f05 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:07 devstack sudo[102363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.f8982626-714e-4970-b555-4407eec67f05 1G Nov 02 12:38:07 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:08 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-abbbdec4-3a6e-4725-94b2-2bd4d85eec45 tempest-VolumesDeleteCascade-897627988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.f8982626-714e-4970-b555-4407eec67f05 1G" returned: 0 in 0.369s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-abbbdec4-3a6e-4725-94b2-2bd4d85eec45 tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.f8982626-714e-4970-b555-4407eec67f05 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:08 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.f8982626-714e-4970-b555-4407eec67f05 Nov 02 12:38:08 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:08 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-abbbdec4-3a6e-4725-94b2-2bd4d85eec45 tempest-VolumesDeleteCascade-897627988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.f8982626-714e-4970-b555-4407eec67f05" returned: 0 in 0.293s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:08 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-abbbdec4-3a6e-4725-94b2-2bd4d85eec45 tempest-VolumesDeleteCascade-897627988 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.f8982626-714e-4970-b555-4407eec67f05 is being set with open permissions: ugo+rw Nov 02 12:38:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-abbbdec4-3a6e-4725-94b2-2bd4d85eec45 tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.f8982626-714e-4970-b555-4407eec67f05 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:08 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.f8982626-714e-4970-b555-4407eec67f05 Nov 02 12:38:08 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:08 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-abbbdec4-3a6e-4725-94b2-2bd4d85eec45 tempest-VolumesDeleteCascade-897627988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.f8982626-714e-4970-b555-4407eec67f05" returned: 0 in 0.236s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-abbbdec4-3a6e-4725-94b2-2bd4d85eec45 tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:08 devstack sudo[102376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.info Nov 02 12:38:08 devstack sudo[102376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:09 devstack sudo[102376]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-abbbdec4-3a6e-4725-94b2-2bd4d85eec45 tempest-VolumesDeleteCascade-897627988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.info" returned: 0 in 0.240s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:09 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-abbbdec4-3a6e-4725-94b2-2bd4d85eec45 tempest-VolumesDeleteCascade-897627988 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.info is being set with open permissions: ugo+rw Nov 02 12:38:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-abbbdec4-3a6e-4725-94b2-2bd4d85eec45 tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:09 devstack sudo[102379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.info Nov 02 12:38:09 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:09 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-abbbdec4-3a6e-4725-94b2-2bd4d85eec45 tempest-VolumesDeleteCascade-897627988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.info" returned: 0 in 0.247s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-abbbdec4-3a6e-4725-94b2-2bd4d85eec45 tempest-VolumesDeleteCascade-897627988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.836s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:09 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-abbbdec4-3a6e-4725-94b2-2bd4d85eec45 tempest-VolumesDeleteCascade-897627988 None] Create snapshot completed successfully Nov 02 12:38:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-932fee14-fc9d-4a22-af90-11ad30c1cb62 tempest-VolumesDeleteCascade-897627988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-932fee14-fc9d-4a22-af90-11ad30c1cb62 tempest-VolumesDeleteCascade-897627988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:09 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-932fee14-fc9d-4a22-af90-11ad30c1cb62 tempest-VolumesDeleteCascade-897627988 None] Creating offline snapshot 25ba388f-5815-4182-92d8-c3969e5b95ec of volume a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7 {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:38:09 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[9013960b-80b6-4ded-aa0b-919aa6373a6b]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-932fee14-fc9d-4a22-af90-11ad30c1cb62 tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.f8982626-714e-4970-b555-4407eec67f05 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:10 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.f8982626-714e-4970-b555-4407eec67f05 Nov 02 12:38:10 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:10 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-932fee14-fc9d-4a22-af90-11ad30c1cb62 tempest-VolumesDeleteCascade-897627988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.f8982626-714e-4970-b555-4407eec67f05" returned: 0 in 0.358s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:10 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-932fee14-fc9d-4a22-af90-11ad30c1cb62 tempest-VolumesDeleteCascade-897627988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:38:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-932fee14-fc9d-4a22-af90-11ad30c1cb62 tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.f8982626-714e-4970-b555-4407eec67f05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.25ba388f-5815-4182-92d8-c3969e5b95ec 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:10 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.f8982626-714e-4970-b555-4407eec67f05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.25ba388f-5815-4182-92d8-c3969e5b95ec 1G Nov 02 12:38:10 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:10 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-932fee14-fc9d-4a22-af90-11ad30c1cb62 tempest-VolumesDeleteCascade-897627988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.f8982626-714e-4970-b555-4407eec67f05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.25ba388f-5815-4182-92d8-c3969e5b95ec 1G" returned: 0 in 0.400s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-932fee14-fc9d-4a22-af90-11ad30c1cb62 tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.f8982626-714e-4970-b555-4407eec67f05 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.25ba388f-5815-4182-92d8-c3969e5b95ec {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:10 devstack sudo[102392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.f8982626-714e-4970-b555-4407eec67f05 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.25ba388f-5815-4182-92d8-c3969e5b95ec Nov 02 12:38:10 devstack sudo[102392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:10 devstack sudo[102392]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-932fee14-fc9d-4a22-af90-11ad30c1cb62 tempest-VolumesDeleteCascade-897627988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.f8982626-714e-4970-b555-4407eec67f05 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.25ba388f-5815-4182-92d8-c3969e5b95ec" returned: 0 in 0.297s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:10 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-932fee14-fc9d-4a22-af90-11ad30c1cb62 tempest-VolumesDeleteCascade-897627988 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.25ba388f-5815-4182-92d8-c3969e5b95ec is being set with open permissions: ugo+rw Nov 02 12:38:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-932fee14-fc9d-4a22-af90-11ad30c1cb62 tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.25ba388f-5815-4182-92d8-c3969e5b95ec {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:10 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.25ba388f-5815-4182-92d8-c3969e5b95ec Nov 02 12:38:10 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:11 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-932fee14-fc9d-4a22-af90-11ad30c1cb62 tempest-VolumesDeleteCascade-897627988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.25ba388f-5815-4182-92d8-c3969e5b95ec" returned: 0 in 0.259s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-932fee14-fc9d-4a22-af90-11ad30c1cb62 tempest-VolumesDeleteCascade-897627988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.406s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:11 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-932fee14-fc9d-4a22-af90-11ad30c1cb62 tempest-VolumesDeleteCascade-897627988 None] Create snapshot completed successfully Nov 02 12:38:11 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Acquiring lock "cinder-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:12 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Lock "cinder-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:12 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Performing cascade delete. {{(pid=86515) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 02 12:38:12 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Acquiring lock "cinder-25ba388f-5815-4182-92d8-c3969e5b95ec-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:12 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Lock "cinder-25ba388f-5815-4182-92d8-c3969e5b95ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:12 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Acquiring lock "cinder-quobyte-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:12 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Lock "cinder-quobyte-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:12 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Acquiring lock "cinder-quobyte-25ba388f-5815-4182-92d8-c3969e5b95ec" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:12 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Lock "cinder-quobyte-25ba388f-5815-4182-92d8-c3969e5b95ec" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:12 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Deleting offline snapshot 25ba388f-5815-4182-92d8-c3969e5b95ec of volume a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:38:12 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] snapshot_file for this snap is: volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.25ba388f-5815-4182-92d8-c3969e5b95ec {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:38:12 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d9e74b-1b6b-4c9f-95fc-7744e7e443cc]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.25ba388f-5815-4182-92d8-c3969e5b95ec {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:12 devstack sudo[102401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.25ba388f-5815-4182-92d8-c3969e5b95ec Nov 02 12:38:12 devstack sudo[102401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:12 devstack sudo[102401]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.25ba388f-5815-4182-92d8-c3969e5b95ec" returned: 0 in 0.355s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:12 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:38:12 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[153f45d9-cf2a-4f86-951b-9de0b6d40e37]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.f8982626-714e-4970-b555-4407eec67f05 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:12 devstack sudo[102406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.f8982626-714e-4970-b555-4407eec67f05 Nov 02 12:38:12 devstack sudo[102406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:12 devstack sudo[102406]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.f8982626-714e-4970-b555-4407eec67f05" returned: 0 in 0.337s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:12 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:38:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.25ba388f-5815-4182-92d8-c3969e5b95ec {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:12 devstack sudo[102411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.25ba388f-5815-4182-92d8-c3969e5b95ec Nov 02 12:38:12 devstack sudo[102411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:13 devstack sudo[102411]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.25ba388f-5815-4182-92d8-c3969e5b95ec" returned: 0 in 0.364s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.25ba388f-5815-4182-92d8-c3969e5b95ec {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:13 devstack sudo[102417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.25ba388f-5815-4182-92d8-c3969e5b95ec Nov 02 12:38:13 devstack sudo[102417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:13 devstack sudo[102417]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.25ba388f-5815-4182-92d8-c3969e5b95ec" returned: 0 in 0.238s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:13 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Lock "cinder-quobyte-25ba388f-5815-4182-92d8-c3969e5b95ec" released by "_delete_snapshot" :: held 1.380s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:13 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Lock "cinder-quobyte-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7" released by "delete_snapshot" :: held 1.399s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:13 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Created reservations ['78bb5cf5-57c7-4397-b1d8-3e60c7dc3e78', '9ee727cb-d803-457f-b5c7-96d6d8efb516', '13a55896-747c-4ccb-9828-dfe441ba8b07', '3782bcec-369f-4d32-bbf0-b0f860956088'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:38:13 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Delete snapshot completed successfully. Nov 02 12:38:13 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Lock "cinder-25ba388f-5815-4182-92d8-c3969e5b95ec-delete_snapshot" released by "delete_snapshot" :: held 1.542s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:13 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Acquiring lock "cinder-f8982626-714e-4970-b555-4407eec67f05-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:13 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Lock "cinder-f8982626-714e-4970-b555-4407eec67f05-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:13 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Acquiring lock "cinder-quobyte-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:13 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Lock "cinder-quobyte-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:13 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Acquiring lock "cinder-quobyte-f8982626-714e-4970-b555-4407eec67f05" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:13 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Lock "cinder-quobyte-f8982626-714e-4970-b555-4407eec67f05" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:13 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Deleting offline snapshot f8982626-714e-4970-b555-4407eec67f05 of volume a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:38:13 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] snapshot_file for this snap is: volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.f8982626-714e-4970-b555-4407eec67f05 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:38:13 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c82484-a83b-4f87-83b7-c29cac3d9759]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.f8982626-714e-4970-b555-4407eec67f05 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:13 devstack sudo[102420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.f8982626-714e-4970-b555-4407eec67f05 Nov 02 12:38:13 devstack sudo[102420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:14 devstack sudo[102420]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.f8982626-714e-4970-b555-4407eec67f05" returned: 0 in 0.346s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:14 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:38:14 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[a995a324-99a5-4639-bd16-58269f924ea8]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:14 devstack sudo[102425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7 Nov 02 12:38:14 devstack sudo[102425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:14 devstack sudo[102425]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7" returned: 0 in 0.364s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.f8982626-714e-4970-b555-4407eec67f05 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:14 devstack sudo[102430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.f8982626-714e-4970-b555-4407eec67f05 Nov 02 12:38:14 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:14 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.f8982626-714e-4970-b555-4407eec67f05" returned: 0 in 0.328s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.f8982626-714e-4970-b555-4407eec67f05 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:14 devstack sudo[102435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.f8982626-714e-4970-b555-4407eec67f05 Nov 02 12:38:14 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:15 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7.f8982626-714e-4970-b555-4407eec67f05" returned: 0 in 0.255s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:15 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Lock "cinder-quobyte-f8982626-714e-4970-b555-4407eec67f05" released by "_delete_snapshot" :: held 1.394s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:15 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Lock "cinder-quobyte-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7" released by "delete_snapshot" :: held 1.415s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:15 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Created reservations ['95fb01a3-b729-47df-bbcb-403e4ae95aa2', '55a2c298-cc1e-4abf-a6ce-271165024142', '0022e4ef-2341-4ef2-8312-df51ba69a9a2', 'd289d446-c163-43dd-a669-3802b4cba37d'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:38:15 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Delete snapshot completed successfully. Nov 02 12:38:15 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Lock "cinder-f8982626-714e-4970-b555-4407eec67f05-delete_snapshot" released by "delete_snapshot" :: held 1.569s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:15 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Snapshots deleted, issuing volume delete {{(pid=86515) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 02 12:38:15 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Acquiring lock "cinder-quobyte-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:15 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Lock "cinder-quobyte-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7" acquired by "delete_volume" :: waited 0.014s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:15 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a408b0e-f7c6-4e7c-a268-a908cd5464bb]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:15 devstack sudo[102442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7 Nov 02 12:38:15 devstack sudo[102442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:15 devstack sudo[102442]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7" returned: 0 in 0.400s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:15 devstack sudo[102447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7 Nov 02 12:38:15 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:15 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7" returned: 0 in 0.277s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:15 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Lock "cinder-quobyte-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7" released by "delete_volume" :: held 0.775s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:16 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Created reservations ['735f04cd-2eb4-4c51-9358-8df4fbd6f73a', '9c8fdf1b-586c-4950-bdfb-2cdcbbcd86d0', '029d65d9-05f6-4394-abb1-b32d741b5e77', '4b237e58-ebf8-42e2-950e-807f75251b8e'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:38:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:16 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:38:16 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:38:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:16 devstack sudo[102450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:38:16 devstack sudo[102450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:16 devstack sudo[102450]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.270s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:16 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:38:16 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Deleted volume successfully. Nov 02 12:38:16 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-644c9a44-e9d0-470e-acb2-49e0787ae60d tempest-VolumesDeleteCascade-897627988 None] Lock "cinder-a5f6ee06-ab7b-42c2-a431-73a4bb1c87e7-delete_volume" released by "delete_volume" :: held 4.418s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:17 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbc0e1dd-b427-4374-9fd5-34ba5615aec1 tempest-VolumesDeleteCascade-897627988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:38:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fbc0e1dd-b427-4374-9fd5-34ba5615aec1 tempest-VolumesDeleteCascade-897627988 None] Flow 'volume_create_manager' (df1cd525-40b3-4a30-90cc-e4005ee51141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:38:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fbc0e1dd-b427-4374-9fd5-34ba5615aec1 tempest-VolumesDeleteCascade-897627988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3787edc-e0f5-4df9-895d-86ec41839999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fbc0e1dd-b427-4374-9fd5-34ba5615aec1 tempest-VolumesDeleteCascade-897627988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3787edc-e0f5-4df9-895d-86ec41839999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1150770579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f6b627b-f93e-445e-9cb2-ece44ec08246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c9284ac7e4750b0bd56ea17f53e26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:38:17Z,use_quota=True,user_id='ac062954c4624aa29de1034aa3d20b05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fbc0e1dd-b427-4374-9fd5-34ba5615aec1 tempest-VolumesDeleteCascade-897627988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e8ae942-a044-4f21-adf6-a0efc0fc1b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fbc0e1dd-b427-4374-9fd5-34ba5615aec1 tempest-VolumesDeleteCascade-897627988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e8ae942-a044-4f21-adf6-a0efc0fc1b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fbc0e1dd-b427-4374-9fd5-34ba5615aec1 tempest-VolumesDeleteCascade-897627988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b93e124-094c-4576-a06b-1405cb0afb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fbc0e1dd-b427-4374-9fd5-34ba5615aec1 tempest-VolumesDeleteCascade-897627988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b93e124-094c-4576-a06b-1405cb0afb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f6b627b-f93e-445e-9cb2-ece44ec08246', 'volume_name': 'volume-8f6b627b-f93e-445e-9cb2-ece44ec08246', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fbc0e1dd-b427-4374-9fd5-34ba5615aec1 tempest-VolumesDeleteCascade-897627988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d02cf6d4-ada4-4a38-b06e-99ea289e2882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fbc0e1dd-b427-4374-9fd5-34ba5615aec1 tempest-VolumesDeleteCascade-897627988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d02cf6d4-ada4-4a38-b06e-99ea289e2882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fbc0e1dd-b427-4374-9fd5-34ba5615aec1 tempest-VolumesDeleteCascade-897627988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5d4e95e-9195-4b3d-a597-8061903c3280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:17 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-fbc0e1dd-b427-4374-9fd5-34ba5615aec1 tempest-VolumesDeleteCascade-897627988 None] Volume 8f6b627b-f93e-445e-9cb2-ece44ec08246: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f6b627b-f93e-445e-9cb2-ece44ec08246', 'volume_size': 1} Nov 02 12:38:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fbc0e1dd-b427-4374-9fd5-34ba5615aec1 tempest-VolumesDeleteCascade-897627988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fbc0e1dd-b427-4374-9fd5-34ba5615aec1 tempest-VolumesDeleteCascade-897627988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-fbc0e1dd-b427-4374-9fd5-34ba5615aec1 tempest-VolumesDeleteCascade-897627988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1150770579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f6b627b-f93e-445e-9cb2-ece44ec08246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c9284ac7e4750b0bd56ea17f53e26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:38:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:38:17Z,use_quota=True,user_id='ac062954c4624aa29de1034aa3d20b05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:38:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-fbc0e1dd-b427-4374-9fd5-34ba5615aec1 tempest-VolumesDeleteCascade-897627988 None] Creating volume 8f6b627b-f93e-445e-9cb2-ece44ec08246 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:38:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fbc0e1dd-b427-4374-9fd5-34ba5615aec1 tempest-VolumesDeleteCascade-897627988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fbc0e1dd-b427-4374-9fd5-34ba5615aec1 tempest-VolumesDeleteCascade-897627988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-fbc0e1dd-b427-4374-9fd5-34ba5615aec1 tempest-VolumesDeleteCascade-897627988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:38:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-fbc0e1dd-b427-4374-9fd5-34ba5615aec1 tempest-VolumesDeleteCascade-897627988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:38:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fbc0e1dd-b427-4374-9fd5-34ba5615aec1 tempest-VolumesDeleteCascade-897627988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-fbc0e1dd-b427-4374-9fd5-34ba5615aec1 tempest-VolumesDeleteCascade-897627988 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:38:17 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-fbc0e1dd-b427-4374-9fd5-34ba5615aec1 tempest-VolumesDeleteCascade-897627988 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:38:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fbc0e1dd-b427-4374-9fd5-34ba5615aec1 tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:17 devstack sudo[102464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246 1073741824 Nov 02 12:38:17 devstack sudo[102464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:17 devstack sudo[102464]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fbc0e1dd-b427-4374-9fd5-34ba5615aec1 tempest-VolumesDeleteCascade-897627988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246 1073741824" returned: 0 in 0.389s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fbc0e1dd-b427-4374-9fd5-34ba5615aec1 tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:17 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246 Nov 02 12:38:17 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:17 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fbc0e1dd-b427-4374-9fd5-34ba5615aec1 tempest-VolumesDeleteCascade-897627988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246" returned: 0 in 0.244s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-fbc0e1dd-b427-4374-9fd5-34ba5615aec1 tempest-VolumesDeleteCascade-897627988 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:38:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fbc0e1dd-b427-4374-9fd5-34ba5615aec1 tempest-VolumesDeleteCascade-897627988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fbc0e1dd-b427-4374-9fd5-34ba5615aec1 tempest-VolumesDeleteCascade-897627988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5d4e95e-9195-4b3d-a597-8061903c3280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f6b627b-f93e-445e-9cb2-ece44ec08246', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fbc0e1dd-b427-4374-9fd5-34ba5615aec1 tempest-VolumesDeleteCascade-897627988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc83bf8-6ff6-428f-9197-70066f154ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:17 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-fbc0e1dd-b427-4374-9fd5-34ba5615aec1 tempest-VolumesDeleteCascade-897627988 None] Volume volume-8f6b627b-f93e-445e-9cb2-ece44ec08246 (8f6b627b-f93e-445e-9cb2-ece44ec08246): created successfully Nov 02 12:38:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fbc0e1dd-b427-4374-9fd5-34ba5615aec1 tempest-VolumesDeleteCascade-897627988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc83bf8-6ff6-428f-9197-70066f154ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fbc0e1dd-b427-4374-9fd5-34ba5615aec1 tempest-VolumesDeleteCascade-897627988 None] Flow 'volume_create_manager' (df1cd525-40b3-4a30-90cc-e4005ee51141) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:38:17 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-fbc0e1dd-b427-4374-9fd5-34ba5615aec1 tempest-VolumesDeleteCascade-897627988 None] Created volume successfully. Nov 02 12:38:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8cfe76ae-daaa-4682-9ff0-29ad69c6ad12 tempest-VolumesDeleteCascade-897627988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8cfe76ae-daaa-4682-9ff0-29ad69c6ad12 tempest-VolumesDeleteCascade-897627988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:18 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-8cfe76ae-daaa-4682-9ff0-29ad69c6ad12 tempest-VolumesDeleteCascade-897627988 None] Creating offline snapshot d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7 of volume 8f6b627b-f93e-445e-9cb2-ece44ec08246 {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:38:18 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41727a7-9818-402e-8ed7-4660cefb3c26]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8cfe76ae-daaa-4682-9ff0-29ad69c6ad12 tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:18 devstack sudo[102473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246 Nov 02 12:38:18 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:18 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8cfe76ae-daaa-4682-9ff0-29ad69c6ad12 tempest-VolumesDeleteCascade-897627988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246" returned: 0 in 0.348s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8cfe76ae-daaa-4682-9ff0-29ad69c6ad12 tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246.d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:18 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246.d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7 1G Nov 02 12:38:18 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:18 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8cfe76ae-daaa-4682-9ff0-29ad69c6ad12 tempest-VolumesDeleteCascade-897627988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246.d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7 1G" returned: 0 in 0.378s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8cfe76ae-daaa-4682-9ff0-29ad69c6ad12 tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f6b627b-f93e-445e-9cb2-ece44ec08246 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246.d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:19 devstack sudo[102507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f6b627b-f93e-445e-9cb2-ece44ec08246 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246.d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7 Nov 02 12:38:19 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:19 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8cfe76ae-daaa-4682-9ff0-29ad69c6ad12 tempest-VolumesDeleteCascade-897627988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f6b627b-f93e-445e-9cb2-ece44ec08246 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246.d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7" returned: 0 in 0.288s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:19 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-8cfe76ae-daaa-4682-9ff0-29ad69c6ad12 tempest-VolumesDeleteCascade-897627988 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246.d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7 is being set with open permissions: ugo+rw Nov 02 12:38:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8cfe76ae-daaa-4682-9ff0-29ad69c6ad12 tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246.d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:19 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246.d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7 Nov 02 12:38:19 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:19 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8cfe76ae-daaa-4682-9ff0-29ad69c6ad12 tempest-VolumesDeleteCascade-897627988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246.d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7" returned: 0 in 0.230s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8cfe76ae-daaa-4682-9ff0-29ad69c6ad12 tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:19 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246.info Nov 02 12:38:19 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:19 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8cfe76ae-daaa-4682-9ff0-29ad69c6ad12 tempest-VolumesDeleteCascade-897627988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246.info" returned: 0 in 0.243s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:19 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-8cfe76ae-daaa-4682-9ff0-29ad69c6ad12 tempest-VolumesDeleteCascade-897627988 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246.info is being set with open permissions: ugo+rw Nov 02 12:38:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8cfe76ae-daaa-4682-9ff0-29ad69c6ad12 tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:19 devstack sudo[102519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246.info Nov 02 12:38:19 devstack sudo[102519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:20 devstack sudo[102519]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8cfe76ae-daaa-4682-9ff0-29ad69c6ad12 tempest-VolumesDeleteCascade-897627988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246.info" returned: 0 in 0.232s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8cfe76ae-daaa-4682-9ff0-29ad69c6ad12 tempest-VolumesDeleteCascade-897627988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.805s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:20 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-8cfe76ae-daaa-4682-9ff0-29ad69c6ad12 tempest-VolumesDeleteCascade-897627988 None] Create snapshot completed successfully Nov 02 12:38:20 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:38:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Flow 'volume_create_manager' (819caf08-9019-47e7-988d-cb80663d7c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:38:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (297085a7-29f0-4317-b5c8-d011f48ec887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (297085a7-29f0-4317-b5c8-d011f48ec887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:38:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1561358188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49cfaac4-45b2-4cf3-ac38-1510b7b8134f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='049c9284ac7e4750b0bd56ea17f53e26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:38:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:38:21Z,use_quota=True,user_id='ac062954c4624aa29de1034aa3d20b05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca97b225-9f85-4e17-b514-4808e48b4d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca97b225-9f85-4e17-b514-4808e48b4d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39fdef1f-a86b-4147-a24a-8aa49bd4f765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39fdef1f-a86b-4147-a24a-8aa49bd4f765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '49cfaac4-45b2-4cf3-ac38-1510b7b8134f', 'volume_name': 'volume-49cfaac4-45b2-4cf3-ac38-1510b7b8134f', 'volume_size': 1, 'snapshot_id': 'd1ff0b4a-ea0f-492b-9551-aecfddc9c9c7'}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ecf150-44d4-4235-bd37-b2a7460670b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ecf150-44d4-4235-bd37-b2a7460670b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (938f7f6a-7814-46a7-91fa-0e78682613a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:20 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Volume 49cfaac4-45b2-4cf3-ac38-1510b7b8134f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-49cfaac4-45b2-4cf3-ac38-1510b7b8134f', 'volume_size': 1, 'snapshot_id': 'd1ff0b4a-ea0f-492b-9551-aecfddc9c9c7'} Nov 02 12:38:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:20 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Acquiring lock "cinder-quobyte-d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7-49cfaac4-45b2-4cf3-ac38-1510b7b8134f" by "_create_volume_from_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:20 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Lock "cinder-quobyte-d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7-49cfaac4-45b2-4cf3-ac38-1510b7b8134f" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Creating volume 49cfaac4-45b2-4cf3-ac38-1510b7b8134f from snapshot d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7 {{(pid=86515) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 12:38:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:38:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:38:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:38:20 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Acquiring lock "cinder-quobyte-49cfaac4-45b2-4cf3-ac38-1510b7b8134f" by "_copy_volume_from_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:20 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Lock "cinder-quobyte-49cfaac4-45b2-4cf3-ac38-1510b7b8134f" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] snapshot: d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7, volume: 49cfaac4-45b2-4cf3-ac38-1510b7b8134f, {{(pid=86515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 12:38:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:38:21 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:38:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:21 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b43c9f-d624-4d9f-8580-af26da49d469]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246.d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:21 devstack sudo[102522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246.d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7 Nov 02 12:38:21 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:21 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246.d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7" returned: 0 in 0.350s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:21 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f6b627b-f93e-445e-9cb2-ece44ec08246(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:38:21 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca49465-d3a9-4b33-b6e2-41492ae17755]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:21 devstack sudo[102528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246 Nov 02 12:38:21 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:21 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246" returned: 0 in 0.373s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:21 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] will copy from snapshot at /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246 {{(pid=86515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 12:38:21 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Creating direct copy from snapshot {{(pid=86515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 12:38:21 devstack cinder-volume[86515]: DEBUG cinder.utils [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Path /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-49cfaac4-45b2-4cf3-ac38-1510b7b8134f not found in is_blk_device check {{(pid=86515) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 12:38:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-49cfaac4-45b2-4cf3-ac38-1510b7b8134f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:21 devstack sudo[102533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-49cfaac4-45b2-4cf3-ac38-1510b7b8134f Nov 02 12:38:21 devstack sudo[102533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:27 devstack sudo[102533]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-49cfaac4-45b2-4cf3-ac38-1510b7b8134f" returned: 0 in 6.053s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:27 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Image conversion details: src /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246, size 1024.00 MB, duration 6.05 sec, destination /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-49cfaac4-45b2-4cf3-ac38-1510b7b8134f {{(pid=86515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 12:38:27 devstack cinder-volume[86515]: INFO cinder.image.image_utils [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Converted 1024.00 MB image at 169.13 MB/s Nov 02 12:38:27 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-49cfaac4-45b2-4cf3-ac38-1510b7b8134f is being set with open permissions: ugo+rw Nov 02 12:38:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-49cfaac4-45b2-4cf3-ac38-1510b7b8134f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:27 devstack sudo[102557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-49cfaac4-45b2-4cf3-ac38-1510b7b8134f Nov 02 12:38:27 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:28 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-49cfaac4-45b2-4cf3-ac38-1510b7b8134f" returned: 0 in 0.269s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Lock "cinder-quobyte-49cfaac4-45b2-4cf3-ac38-1510b7b8134f" released by "_copy_volume_from_snapshot" :: held 7.137s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Lock "cinder-quobyte-d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7-49cfaac4-45b2-4cf3-ac38-1510b7b8134f" released by "_create_volume_from_snapshot" :: held 7.209s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.223s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:28 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (938f7f6a-7814-46a7-91fa-0e78682613a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49cfaac4-45b2-4cf3-ac38-1510b7b8134f', 'volume_size': 1, 'snapshot_id': 'd1ff0b4a-ea0f-492b-9551-aecfddc9c9c7'}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:28 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a4b95c-4844-427e-9b3b-04ae5a0edd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:28 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Volume volume-49cfaac4-45b2-4cf3-ac38-1510b7b8134f (49cfaac4-45b2-4cf3-ac38-1510b7b8134f): created successfully Nov 02 12:38:28 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a4b95c-4844-427e-9b3b-04ae5a0edd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:28 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Flow 'volume_create_manager' (819caf08-9019-47e7-988d-cb80663d7c89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:38:28 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-fbc649d9-2c79-43a5-a58d-c681fb1e9919 tempest-VolumesDeleteCascade-897627988 None] Created volume successfully. Nov 02 12:38:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] Acquiring lock "cinder-8f6b627b-f93e-445e-9cb2-ece44ec08246-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] Lock "cinder-8f6b627b-f93e-445e-9cb2-ece44ec08246-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:28 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] Performing cascade delete. {{(pid=86515) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 02 12:38:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] Acquiring lock "cinder-d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] Lock "cinder-d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] Acquiring lock "cinder-quobyte-8f6b627b-f93e-445e-9cb2-ece44ec08246" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] Lock "cinder-quobyte-8f6b627b-f93e-445e-9cb2-ece44ec08246" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] Acquiring lock "cinder-quobyte-d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] Lock "cinder-quobyte-d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:28 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] Deleting offline snapshot d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7 of volume 8f6b627b-f93e-445e-9cb2-ece44ec08246 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:38:28 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] snapshot_file for this snap is: volume-8f6b627b-f93e-445e-9cb2-ece44ec08246.d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:38:28 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c78977-a837-4655-8ddd-9d8a79f2926e]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246.d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:28 devstack sudo[102565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246.d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7 Nov 02 12:38:28 devstack sudo[102565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:29 devstack sudo[102565]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246.d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7" returned: 0 in 0.373s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:29 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f6b627b-f93e-445e-9cb2-ece44ec08246(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:38:29 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ce4887-dafd-4897-8433-bec0dd4b1424]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:29 devstack sudo[102571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246 Nov 02 12:38:29 devstack sudo[102571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:29 devstack sudo[102571]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246" returned: 0 in 0.591s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246.d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:29 devstack sudo[102579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246.d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7 Nov 02 12:38:29 devstack sudo[102579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:30 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-2ec6c35e-29bd-40e9-84e5-a7c050c11a9c req-6231d461-76ba-4a27-b97f-d11424033862 tempest-TestShelveInstance-2111934223 None] Terminate volume connection completed successfully. Nov 02 12:38:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-2ec6c35e-29bd-40e9-84e5-a7c050c11a9c req-6231d461-76ba-4a27-b97f-d11424033862 tempest-TestShelveInstance-2111934223 None] Deleting attachment 779dce43-b01b-4917-bc89-a05966258fdb. {{(pid=86515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:38:30 devstack sudo[102579]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246.d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7" returned: 0 in 0.512s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246.d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:30 devstack sudo[102601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246.d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7 Nov 02 12:38:30 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:30 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246.d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7" returned: 0 in 0.271s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:30 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] Lock "cinder-quobyte-d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7" released by "_delete_snapshot" :: held 1.856s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:30 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] Lock "cinder-quobyte-8f6b627b-f93e-445e-9cb2-ece44ec08246" released by "delete_snapshot" :: held 1.878s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:30 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] Created reservations ['dc4a723f-9e2e-4c29-9ede-44e18364b617', '3df14810-79c2-410a-a505-4e227ea8b194', 'c3499529-91e7-4052-ad9b-3398cf923653', 'c6c55b25-58d9-4fc7-ba3a-3a3e928f24e7'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:38:30 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] Delete snapshot completed successfully. Nov 02 12:38:30 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] Lock "cinder-d1ff0b4a-ea0f-492b-9551-aecfddc9c9c7-delete_snapshot" released by "delete_snapshot" :: held 2.038s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] Snapshots deleted, issuing volume delete {{(pid=86515) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 02 12:38:30 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] Acquiring lock "cinder-quobyte-8f6b627b-f93e-445e-9cb2-ece44ec08246" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:30 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] Lock "cinder-quobyte-8f6b627b-f93e-445e-9cb2-ece44ec08246" acquired by "delete_volume" :: waited 0.014s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:30 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c70865-c8c3-424a-94b4-397445fef09d]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:30 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246 Nov 02 12:38:30 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:31 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246" returned: 0 in 0.355s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:31 devstack sudo[102609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246 Nov 02 12:38:31 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:31 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8f6b627b-f93e-445e-9cb2-ece44ec08246" returned: 0 in 0.262s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:31 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] Lock "cinder-quobyte-8f6b627b-f93e-445e-9cb2-ece44ec08246" released by "delete_volume" :: held 0.688s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:31 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] Created reservations ['f50d9818-db1e-415b-867e-334c002d31fd', 'cd6fa99b-8bf1-4251-8e1c-9f1ab2de1230', 'c1d82edf-b7c0-49af-8abd-b3a278351b8a', '0ceb72ef-6112-4ef6-99d3-769ef684c04a'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:38:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:31 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:38:31 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:38:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:31 devstack sudo[102615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:38:31 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:31 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.246s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:31 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:38:31 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] Deleted volume successfully. Nov 02 12:38:31 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-633df477-c80d-4256-a356-8855d2a99d1f tempest-VolumesDeleteCascade-897627988 None] Lock "cinder-8f6b627b-f93e-445e-9cb2-ece44ec08246-delete_volume" released by "delete_volume" :: held 3.215s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7d99be90-76f9-4d86-8fe3-b184f939c6e1 tempest-VolumesDeleteCascade-897627988 None] Acquiring lock "cinder-49cfaac4-45b2-4cf3-ac38-1510b7b8134f-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7d99be90-76f9-4d86-8fe3-b184f939c6e1 tempest-VolumesDeleteCascade-897627988 None] Lock "cinder-49cfaac4-45b2-4cf3-ac38-1510b7b8134f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7d99be90-76f9-4d86-8fe3-b184f939c6e1 tempest-VolumesDeleteCascade-897627988 None] Acquiring lock "cinder-quobyte-49cfaac4-45b2-4cf3-ac38-1510b7b8134f" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7d99be90-76f9-4d86-8fe3-b184f939c6e1 tempest-VolumesDeleteCascade-897627988 None] Lock "cinder-quobyte-49cfaac4-45b2-4cf3-ac38-1510b7b8134f" acquired by "delete_volume" :: waited 0.017s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:32 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[30af8dd3-a9c4-49f3-8b3e-cb6d642c9f25]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7d99be90-76f9-4d86-8fe3-b184f939c6e1 tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-49cfaac4-45b2-4cf3-ac38-1510b7b8134f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:32 devstack sudo[102619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-49cfaac4-45b2-4cf3-ac38-1510b7b8134f Nov 02 12:38:32 devstack sudo[102619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-031f548c-a44d-486e-b497-29d12c9097a2 req-bb40aabf-aaf7-4a2b-b782-7352d7ebf1bb tempest-TestShelveInstance-2111934223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-031f548c-a44d-486e-b497-29d12c9097a2 req-bb40aabf-aaf7-4a2b-b782-7352d7ebf1bb tempest-TestShelveInstance-2111934223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-031f548c-a44d-486e-b497-29d12c9097a2 req-bb40aabf-aaf7-4a2b-b782-7352d7ebf1bb tempest-TestShelveInstance-2111934223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:32 devstack sudo[102619]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7d99be90-76f9-4d86-8fe3-b184f939c6e1 tempest-VolumesDeleteCascade-897627988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-49cfaac4-45b2-4cf3-ac38-1510b7b8134f" returned: 0 in 0.409s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7d99be90-76f9-4d86-8fe3-b184f939c6e1 tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-49cfaac4-45b2-4cf3-ac38-1510b7b8134f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:32 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-031f548c-a44d-486e-b497-29d12c9097a2 req-bb40aabf-aaf7-4a2b-b782-7352d7ebf1bb tempest-TestShelveInstance-2111934223 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae', 'name': 'volume-f59e28ae-e543-43ab-9559-ed2f3eb76d4f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e1db6e7a-c0bc-4819-957b-01c95d8bdc7f', 'enforce_multipath': True} {{(pid=86515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:38:32 devstack sudo[102632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-49cfaac4-45b2-4cf3-ac38-1510b7b8134f Nov 02 12:38:32 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:32 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-031f548c-a44d-486e-b497-29d12c9097a2 req-bb40aabf-aaf7-4a2b-b782-7352d7ebf1bb tempest-TestShelveInstance-2111934223 None] attachment_update completed successfully. Nov 02 12:38:32 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7d99be90-76f9-4d86-8fe3-b184f939c6e1 tempest-VolumesDeleteCascade-897627988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-49cfaac4-45b2-4cf3-ac38-1510b7b8134f" returned: 0 in 0.300s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7d99be90-76f9-4d86-8fe3-b184f939c6e1 tempest-VolumesDeleteCascade-897627988 None] Lock "cinder-quobyte-49cfaac4-45b2-4cf3-ac38-1510b7b8134f" released by "delete_volume" :: held 0.757s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:32 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-7d99be90-76f9-4d86-8fe3-b184f939c6e1 tempest-VolumesDeleteCascade-897627988 None] Created reservations ['a258f515-e33f-4e1b-9d72-09afd5b9bce2', 'f5ebbdc4-d21a-4613-9deb-8f26cb195f29', '1661ebec-6d6b-42f1-9e0d-78537df5fcc4', '6901df68-fb0c-42d1-93be-d03696e83801'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:38:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7d99be90-76f9-4d86-8fe3-b184f939c6e1 tempest-VolumesDeleteCascade-897627988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7d99be90-76f9-4d86-8fe3-b184f939c6e1 tempest-VolumesDeleteCascade-897627988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:32 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-7d99be90-76f9-4d86-8fe3-b184f939c6e1 tempest-VolumesDeleteCascade-897627988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:38:32 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-7d99be90-76f9-4d86-8fe3-b184f939c6e1 tempest-VolumesDeleteCascade-897627988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:38:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7d99be90-76f9-4d86-8fe3-b184f939c6e1 tempest-VolumesDeleteCascade-897627988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7d99be90-76f9-4d86-8fe3-b184f939c6e1 tempest-VolumesDeleteCascade-897627988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:33 devstack sudo[102635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:38:33 devstack sudo[102635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:33 devstack sudo[102635]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7d99be90-76f9-4d86-8fe3-b184f939c6e1 tempest-VolumesDeleteCascade-897627988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.267s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:33 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-7d99be90-76f9-4d86-8fe3-b184f939c6e1 tempest-VolumesDeleteCascade-897627988 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:38:33 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-7d99be90-76f9-4d86-8fe3-b184f939c6e1 tempest-VolumesDeleteCascade-897627988 None] Deleted volume successfully. Nov 02 12:38:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7d99be90-76f9-4d86-8fe3-b184f939c6e1 tempest-VolumesDeleteCascade-897627988 None] Lock "cinder-49cfaac4-45b2-4cf3-ac38-1510b7b8134f-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:37 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aeca9f6-f8d7-4051-b3ba-277a4d5e7f8f tempest-VolumesMetadataTest-101062616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:38:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3aeca9f6-f8d7-4051-b3ba-277a4d5e7f8f tempest-VolumesMetadataTest-101062616 None] Flow 'volume_create_manager' (bda64471-abb6-468f-8d5e-49d048260823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:38:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3aeca9f6-f8d7-4051-b3ba-277a4d5e7f8f tempest-VolumesMetadataTest-101062616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4165b8a-85d1-411e-a587-ebf920d39403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3aeca9f6-f8d7-4051-b3ba-277a4d5e7f8f tempest-VolumesMetadataTest-101062616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4165b8a-85d1-411e-a587-ebf920d39403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-628573409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed80e42f-ca1c-4960-8084-23d58b926d1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c8e95cfc9b43478f6401067df576d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:38:38Z,use_quota=True,user_id='5a72c29ad4524560bc5df20c96944200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3aeca9f6-f8d7-4051-b3ba-277a4d5e7f8f tempest-VolumesMetadataTest-101062616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f2b8289-8fda-4c73-b334-480274e8ab79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3aeca9f6-f8d7-4051-b3ba-277a4d5e7f8f tempest-VolumesMetadataTest-101062616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f2b8289-8fda-4c73-b334-480274e8ab79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3aeca9f6-f8d7-4051-b3ba-277a4d5e7f8f tempest-VolumesMetadataTest-101062616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c401493-4250-4207-90e0-c449d2ac96c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3aeca9f6-f8d7-4051-b3ba-277a4d5e7f8f tempest-VolumesMetadataTest-101062616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c401493-4250-4207-90e0-c449d2ac96c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed80e42f-ca1c-4960-8084-23d58b926d1d', 'volume_name': 'volume-ed80e42f-ca1c-4960-8084-23d58b926d1d', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3aeca9f6-f8d7-4051-b3ba-277a4d5e7f8f tempest-VolumesMetadataTest-101062616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e46e6d3-50dc-47f0-ad19-38c6276fa788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3aeca9f6-f8d7-4051-b3ba-277a4d5e7f8f tempest-VolumesMetadataTest-101062616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e46e6d3-50dc-47f0-ad19-38c6276fa788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3aeca9f6-f8d7-4051-b3ba-277a4d5e7f8f tempest-VolumesMetadataTest-101062616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1e991b6-6b20-472d-b16e-45f0616e4f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:37 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-3aeca9f6-f8d7-4051-b3ba-277a4d5e7f8f tempest-VolumesMetadataTest-101062616 None] Volume ed80e42f-ca1c-4960-8084-23d58b926d1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed80e42f-ca1c-4960-8084-23d58b926d1d', 'volume_size': 1} Nov 02 12:38:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3aeca9f6-f8d7-4051-b3ba-277a4d5e7f8f tempest-VolumesMetadataTest-101062616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3aeca9f6-f8d7-4051-b3ba-277a4d5e7f8f tempest-VolumesMetadataTest-101062616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:37 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3aeca9f6-f8d7-4051-b3ba-277a4d5e7f8f tempest-VolumesMetadataTest-101062616 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-628573409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed80e42f-ca1c-4960-8084-23d58b926d1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c8e95cfc9b43478f6401067df576d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:38:38Z,use_quota=True,user_id='5a72c29ad4524560bc5df20c96944200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:38:37 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-3aeca9f6-f8d7-4051-b3ba-277a4d5e7f8f tempest-VolumesMetadataTest-101062616 None] Creating volume ed80e42f-ca1c-4960-8084-23d58b926d1d {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:38:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3aeca9f6-f8d7-4051-b3ba-277a4d5e7f8f tempest-VolumesMetadataTest-101062616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3aeca9f6-f8d7-4051-b3ba-277a4d5e7f8f tempest-VolumesMetadataTest-101062616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:37 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3aeca9f6-f8d7-4051-b3ba-277a4d5e7f8f tempest-VolumesMetadataTest-101062616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:38:37 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3aeca9f6-f8d7-4051-b3ba-277a4d5e7f8f tempest-VolumesMetadataTest-101062616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:38:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3aeca9f6-f8d7-4051-b3ba-277a4d5e7f8f tempest-VolumesMetadataTest-101062616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:37 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3aeca9f6-f8d7-4051-b3ba-277a4d5e7f8f tempest-VolumesMetadataTest-101062616 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:38:37 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-3aeca9f6-f8d7-4051-b3ba-277a4d5e7f8f tempest-VolumesMetadataTest-101062616 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:38:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3aeca9f6-f8d7-4051-b3ba-277a4d5e7f8f tempest-VolumesMetadataTest-101062616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ed80e42f-ca1c-4960-8084-23d58b926d1d 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:37 devstack sudo[103118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ed80e42f-ca1c-4960-8084-23d58b926d1d 1073741824 Nov 02 12:38:37 devstack sudo[103118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:38 devstack sudo[103118]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3aeca9f6-f8d7-4051-b3ba-277a4d5e7f8f tempest-VolumesMetadataTest-101062616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ed80e42f-ca1c-4960-8084-23d58b926d1d 1073741824" returned: 0 in 0.436s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3aeca9f6-f8d7-4051-b3ba-277a4d5e7f8f tempest-VolumesMetadataTest-101062616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ed80e42f-ca1c-4960-8084-23d58b926d1d {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:38 devstack sudo[103125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ed80e42f-ca1c-4960-8084-23d58b926d1d Nov 02 12:38:38 devstack sudo[103125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:38 devstack sudo[103125]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3aeca9f6-f8d7-4051-b3ba-277a4d5e7f8f tempest-VolumesMetadataTest-101062616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ed80e42f-ca1c-4960-8084-23d58b926d1d" returned: 0 in 0.294s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:38 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3aeca9f6-f8d7-4051-b3ba-277a4d5e7f8f tempest-VolumesMetadataTest-101062616 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:38:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3aeca9f6-f8d7-4051-b3ba-277a4d5e7f8f tempest-VolumesMetadataTest-101062616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:38 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3aeca9f6-f8d7-4051-b3ba-277a4d5e7f8f tempest-VolumesMetadataTest-101062616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1e991b6-6b20-472d-b16e-45f0616e4f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed80e42f-ca1c-4960-8084-23d58b926d1d', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:38 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3aeca9f6-f8d7-4051-b3ba-277a4d5e7f8f tempest-VolumesMetadataTest-101062616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d2b9973-f6da-4057-94a9-56e0578b9a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:38 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-3aeca9f6-f8d7-4051-b3ba-277a4d5e7f8f tempest-VolumesMetadataTest-101062616 None] Volume volume-ed80e42f-ca1c-4960-8084-23d58b926d1d (ed80e42f-ca1c-4960-8084-23d58b926d1d): created successfully Nov 02 12:38:38 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3aeca9f6-f8d7-4051-b3ba-277a4d5e7f8f tempest-VolumesMetadataTest-101062616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d2b9973-f6da-4057-94a9-56e0578b9a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:38 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3aeca9f6-f8d7-4051-b3ba-277a4d5e7f8f tempest-VolumesMetadataTest-101062616 None] Flow 'volume_create_manager' (bda64471-abb6-468f-8d5e-49d048260823) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:38:38 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-3aeca9f6-f8d7-4051-b3ba-277a4d5e7f8f tempest-VolumesMetadataTest-101062616 None] Created volume successfully. Nov 02 12:38:40 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-68a4acdd-4434-415b-b2e4-9d7a1f4c7666 tempest-VolumesMetadataTest-101062616 None] Acquiring lock "cinder-ed80e42f-ca1c-4960-8084-23d58b926d1d-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:40 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-68a4acdd-4434-415b-b2e4-9d7a1f4c7666 tempest-VolumesMetadataTest-101062616 None] Lock "cinder-ed80e42f-ca1c-4960-8084-23d58b926d1d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:40 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-68a4acdd-4434-415b-b2e4-9d7a1f4c7666 tempest-VolumesMetadataTest-101062616 None] Acquiring lock "cinder-quobyte-ed80e42f-ca1c-4960-8084-23d58b926d1d" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:40 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-68a4acdd-4434-415b-b2e4-9d7a1f4c7666 tempest-VolumesMetadataTest-101062616 None] Lock "cinder-quobyte-ed80e42f-ca1c-4960-8084-23d58b926d1d" acquired by "delete_volume" :: waited 0.023s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:40 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee82cec-bfac-4582-b543-338d30afaa26]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-68a4acdd-4434-415b-b2e4-9d7a1f4c7666 tempest-VolumesMetadataTest-101062616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ed80e42f-ca1c-4960-8084-23d58b926d1d {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:40 devstack sudo[103128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ed80e42f-ca1c-4960-8084-23d58b926d1d Nov 02 12:38:40 devstack sudo[103128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:41 devstack sudo[103128]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-68a4acdd-4434-415b-b2e4-9d7a1f4c7666 tempest-VolumesMetadataTest-101062616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ed80e42f-ca1c-4960-8084-23d58b926d1d" returned: 0 in 0.363s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-68a4acdd-4434-415b-b2e4-9d7a1f4c7666 tempest-VolumesMetadataTest-101062616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ed80e42f-ca1c-4960-8084-23d58b926d1d {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:41 devstack sudo[103133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ed80e42f-ca1c-4960-8084-23d58b926d1d Nov 02 12:38:41 devstack sudo[103133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:41 devstack sudo[103133]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-68a4acdd-4434-415b-b2e4-9d7a1f4c7666 tempest-VolumesMetadataTest-101062616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ed80e42f-ca1c-4960-8084-23d58b926d1d" returned: 0 in 0.247s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:41 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-68a4acdd-4434-415b-b2e4-9d7a1f4c7666 tempest-VolumesMetadataTest-101062616 None] Lock "cinder-quobyte-ed80e42f-ca1c-4960-8084-23d58b926d1d" released by "delete_volume" :: held 0.656s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:41 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-68a4acdd-4434-415b-b2e4-9d7a1f4c7666 tempest-VolumesMetadataTest-101062616 None] Created reservations ['bb464996-83e0-4423-96de-ac5ac261bfd1', 'b0cba98a-0128-4fae-b862-26e15c74ac19', '5e7c6b6b-694b-4195-a1f2-036c82220c6d', '04d32689-abff-499d-b387-860a05de52b9'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:38:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-68a4acdd-4434-415b-b2e4-9d7a1f4c7666 tempest-VolumesMetadataTest-101062616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-68a4acdd-4434-415b-b2e4-9d7a1f4c7666 tempest-VolumesMetadataTest-101062616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:41 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-68a4acdd-4434-415b-b2e4-9d7a1f4c7666 tempest-VolumesMetadataTest-101062616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:38:41 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-68a4acdd-4434-415b-b2e4-9d7a1f4c7666 tempest-VolumesMetadataTest-101062616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:38:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-68a4acdd-4434-415b-b2e4-9d7a1f4c7666 tempest-VolumesMetadataTest-101062616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-68a4acdd-4434-415b-b2e4-9d7a1f4c7666 tempest-VolumesMetadataTest-101062616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:41 devstack sudo[103137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:38:41 devstack sudo[103137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:41 devstack sudo[103137]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-68a4acdd-4434-415b-b2e4-9d7a1f4c7666 tempest-VolumesMetadataTest-101062616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.259s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:41 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-68a4acdd-4434-415b-b2e4-9d7a1f4c7666 tempest-VolumesMetadataTest-101062616 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:38:41 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-68a4acdd-4434-415b-b2e4-9d7a1f4c7666 tempest-VolumesMetadataTest-101062616 None] Deleted volume successfully. Nov 02 12:38:41 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-68a4acdd-4434-415b-b2e4-9d7a1f4c7666 tempest-VolumesMetadataTest-101062616 None] Lock "cinder-ed80e42f-ca1c-4960-8084-23d58b926d1d-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:43 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:38:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:38:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:38:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:43 devstack sudo[103177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:38:43 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:44 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.272s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:44 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:38:44 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager._thread_info {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:38:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread count: 28 {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:38:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread info: [<_MainThread(MainThread, started 129944084402304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:38:45 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-0376d8ac-7741-40a9-9a81-7815027e4e80 tempest-VolumesCloneNegativeTest-721012161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:38:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0376d8ac-7741-40a9-9a81-7815027e4e80 tempest-VolumesCloneNegativeTest-721012161 None] Flow 'volume_create_manager' (bf6e2cce-ac44-441c-bc60-da10d4913967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:38:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0376d8ac-7741-40a9-9a81-7815027e4e80 tempest-VolumesCloneNegativeTest-721012161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38dfedaf-af64-43ae-87d5-222c129b609c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0376d8ac-7741-40a9-9a81-7815027e4e80 tempest-VolumesCloneNegativeTest-721012161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38dfedaf-af64-43ae-87d5-222c129b609c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-503724236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0549851d-8029-43d3-9c40-a1f090a3a918,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbfa80a44650476797f4d59538073d28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:38:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:38:46Z,use_quota=True,user_id='506dd6775ca04080aa98e8e20779326d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0376d8ac-7741-40a9-9a81-7815027e4e80 tempest-VolumesCloneNegativeTest-721012161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff0867f-0584-4ad2-95a7-13dd43fe84fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0376d8ac-7741-40a9-9a81-7815027e4e80 tempest-VolumesCloneNegativeTest-721012161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff0867f-0584-4ad2-95a7-13dd43fe84fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0376d8ac-7741-40a9-9a81-7815027e4e80 tempest-VolumesCloneNegativeTest-721012161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bfb4142-2513-48ec-bd08-bba806f01a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0376d8ac-7741-40a9-9a81-7815027e4e80 tempest-VolumesCloneNegativeTest-721012161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bfb4142-2513-48ec-bd08-bba806f01a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0549851d-8029-43d3-9c40-a1f090a3a918', 'volume_name': 'volume-0549851d-8029-43d3-9c40-a1f090a3a918', 'volume_size': 2}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0376d8ac-7741-40a9-9a81-7815027e4e80 tempest-VolumesCloneNegativeTest-721012161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62fe2510-f80b-49c0-b1c8-24f836419a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0376d8ac-7741-40a9-9a81-7815027e4e80 tempest-VolumesCloneNegativeTest-721012161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62fe2510-f80b-49c0-b1c8-24f836419a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0376d8ac-7741-40a9-9a81-7815027e4e80 tempest-VolumesCloneNegativeTest-721012161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54964a70-8f13-49ff-acce-09733d4425e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:45 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-0376d8ac-7741-40a9-9a81-7815027e4e80 tempest-VolumesCloneNegativeTest-721012161 None] Volume 0549851d-8029-43d3-9c40-a1f090a3a918: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0549851d-8029-43d3-9c40-a1f090a3a918', 'volume_size': 2} Nov 02 12:38:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0376d8ac-7741-40a9-9a81-7815027e4e80 tempest-VolumesCloneNegativeTest-721012161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0376d8ac-7741-40a9-9a81-7815027e4e80 tempest-VolumesCloneNegativeTest-721012161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:45 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0376d8ac-7741-40a9-9a81-7815027e4e80 tempest-VolumesCloneNegativeTest-721012161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-503724236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0549851d-8029-43d3-9c40-a1f090a3a918,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbfa80a44650476797f4d59538073d28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:38:46Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:38:46Z,use_quota=True,user_id='506dd6775ca04080aa98e8e20779326d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:38:45 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-0376d8ac-7741-40a9-9a81-7815027e4e80 tempest-VolumesCloneNegativeTest-721012161 None] Creating volume 0549851d-8029-43d3-9c40-a1f090a3a918 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:38:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0376d8ac-7741-40a9-9a81-7815027e4e80 tempest-VolumesCloneNegativeTest-721012161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0376d8ac-7741-40a9-9a81-7815027e4e80 tempest-VolumesCloneNegativeTest-721012161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:45 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0376d8ac-7741-40a9-9a81-7815027e4e80 tempest-VolumesCloneNegativeTest-721012161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:38:45 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0376d8ac-7741-40a9-9a81-7815027e4e80 tempest-VolumesCloneNegativeTest-721012161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:38:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0376d8ac-7741-40a9-9a81-7815027e4e80 tempest-VolumesCloneNegativeTest-721012161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:45 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0376d8ac-7741-40a9-9a81-7815027e4e80 tempest-VolumesCloneNegativeTest-721012161 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:38:45 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-0376d8ac-7741-40a9-9a81-7815027e4e80 tempest-VolumesCloneNegativeTest-721012161 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:38:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0376d8ac-7741-40a9-9a81-7815027e4e80 tempest-VolumesCloneNegativeTest-721012161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0549851d-8029-43d3-9c40-a1f090a3a918 2147483648 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:45 devstack sudo[103183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0549851d-8029-43d3-9c40-a1f090a3a918 2147483648 Nov 02 12:38:45 devstack sudo[103183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:46 devstack sudo[103183]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0376d8ac-7741-40a9-9a81-7815027e4e80 tempest-VolumesCloneNegativeTest-721012161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0549851d-8029-43d3-9c40-a1f090a3a918 2147483648" returned: 0 in 0.541s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0376d8ac-7741-40a9-9a81-7815027e4e80 tempest-VolumesCloneNegativeTest-721012161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0549851d-8029-43d3-9c40-a1f090a3a918 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:46 devstack sudo[103194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0549851d-8029-43d3-9c40-a1f090a3a918 Nov 02 12:38:46 devstack sudo[103194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:46 devstack sudo[103194]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0376d8ac-7741-40a9-9a81-7815027e4e80 tempest-VolumesCloneNegativeTest-721012161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0549851d-8029-43d3-9c40-a1f090a3a918" returned: 0 in 0.295s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:46 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0376d8ac-7741-40a9-9a81-7815027e4e80 tempest-VolumesCloneNegativeTest-721012161 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:38:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0376d8ac-7741-40a9-9a81-7815027e4e80 tempest-VolumesCloneNegativeTest-721012161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0376d8ac-7741-40a9-9a81-7815027e4e80 tempest-VolumesCloneNegativeTest-721012161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54964a70-8f13-49ff-acce-09733d4425e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0549851d-8029-43d3-9c40-a1f090a3a918', 'volume_size': 2}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0376d8ac-7741-40a9-9a81-7815027e4e80 tempest-VolumesCloneNegativeTest-721012161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c313b8-308e-45ed-88d8-5dcb4922dc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:46 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-0376d8ac-7741-40a9-9a81-7815027e4e80 tempest-VolumesCloneNegativeTest-721012161 None] Volume volume-0549851d-8029-43d3-9c40-a1f090a3a918 (0549851d-8029-43d3-9c40-a1f090a3a918): created successfully Nov 02 12:38:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0376d8ac-7741-40a9-9a81-7815027e4e80 tempest-VolumesCloneNegativeTest-721012161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c313b8-308e-45ed-88d8-5dcb4922dc8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0376d8ac-7741-40a9-9a81-7815027e4e80 tempest-VolumesCloneNegativeTest-721012161 None] Flow 'volume_create_manager' (bf6e2cce-ac44-441c-bc60-da10d4913967) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:38:46 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-0376d8ac-7741-40a9-9a81-7815027e4e80 tempest-VolumesCloneNegativeTest-721012161 None] Created volume successfully. Nov 02 12:38:47 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8a36d34c-71a4-4557-8408-89fab3df4599 tempest-VolumesCloneNegativeTest-721012161 None] Acquiring lock "cinder-0549851d-8029-43d3-9c40-a1f090a3a918-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:47 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8a36d34c-71a4-4557-8408-89fab3df4599 tempest-VolumesCloneNegativeTest-721012161 None] Lock "cinder-0549851d-8029-43d3-9c40-a1f090a3a918-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:47 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8a36d34c-71a4-4557-8408-89fab3df4599 tempest-VolumesCloneNegativeTest-721012161 None] Acquiring lock "cinder-quobyte-0549851d-8029-43d3-9c40-a1f090a3a918" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:47 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8a36d34c-71a4-4557-8408-89fab3df4599 tempest-VolumesCloneNegativeTest-721012161 None] Lock "cinder-quobyte-0549851d-8029-43d3-9c40-a1f090a3a918" acquired by "delete_volume" :: waited 0.014s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:48 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd84194f-7f7b-4f5c-a972-139f6cb5923b]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8a36d34c-71a4-4557-8408-89fab3df4599 tempest-VolumesCloneNegativeTest-721012161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0549851d-8029-43d3-9c40-a1f090a3a918 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:48 devstack sudo[103197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0549851d-8029-43d3-9c40-a1f090a3a918 Nov 02 12:38:48 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:48 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8a36d34c-71a4-4557-8408-89fab3df4599 tempest-VolumesCloneNegativeTest-721012161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0549851d-8029-43d3-9c40-a1f090a3a918" returned: 0 in 0.363s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8a36d34c-71a4-4557-8408-89fab3df4599 tempest-VolumesCloneNegativeTest-721012161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0549851d-8029-43d3-9c40-a1f090a3a918 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:48 devstack sudo[103202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0549851d-8029-43d3-9c40-a1f090a3a918 Nov 02 12:38:48 devstack sudo[103202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:48 devstack sudo[103202]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8a36d34c-71a4-4557-8408-89fab3df4599 tempest-VolumesCloneNegativeTest-721012161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0549851d-8029-43d3-9c40-a1f090a3a918" returned: 0 in 0.247s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:48 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8a36d34c-71a4-4557-8408-89fab3df4599 tempest-VolumesCloneNegativeTest-721012161 None] Lock "cinder-quobyte-0549851d-8029-43d3-9c40-a1f090a3a918" released by "delete_volume" :: held 0.665s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:48 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-8a36d34c-71a4-4557-8408-89fab3df4599 tempest-VolumesCloneNegativeTest-721012161 None] Created reservations ['0b4ac7a9-c5d5-4269-9573-b85d15c8e6b0', 'b30b04aa-a4c1-4812-a936-7c8abce989f8', 'c62ffc78-154d-4538-b7dd-ac093c91787a', '2df2287f-3480-4a76-9013-08b910d9dcb4'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:38:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8a36d34c-71a4-4557-8408-89fab3df4599 tempest-VolumesCloneNegativeTest-721012161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8a36d34c-71a4-4557-8408-89fab3df4599 tempest-VolumesCloneNegativeTest-721012161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8a36d34c-71a4-4557-8408-89fab3df4599 tempest-VolumesCloneNegativeTest-721012161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:38:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8a36d34c-71a4-4557-8408-89fab3df4599 tempest-VolumesCloneNegativeTest-721012161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:38:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8a36d34c-71a4-4557-8408-89fab3df4599 tempest-VolumesCloneNegativeTest-721012161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8a36d34c-71a4-4557-8408-89fab3df4599 tempest-VolumesCloneNegativeTest-721012161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:48 devstack sudo[103205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:38:48 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:49 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8a36d34c-71a4-4557-8408-89fab3df4599 tempest-VolumesCloneNegativeTest-721012161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.249s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:49 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-8a36d34c-71a4-4557-8408-89fab3df4599 tempest-VolumesCloneNegativeTest-721012161 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:38:49 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-8a36d34c-71a4-4557-8408-89fab3df4599 tempest-VolumesCloneNegativeTest-721012161 None] Deleted volume successfully. Nov 02 12:38:49 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8a36d34c-71a4-4557-8408-89fab3df4599 tempest-VolumesCloneNegativeTest-721012161 None] Lock "cinder-0549851d-8029-43d3-9c40-a1f090a3a918-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:52 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-c158c48f-ae33-41a0-a14a-9c9dd5de87ed tempest-VolumesListTestJSON-1593504829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:38:52 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-c158c48f-ae33-41a0-a14a-9c9dd5de87ed tempest-VolumesListTestJSON-1593504829 None] Flow 'volume_create_manager' (d1c270d8-1580-47e2-9e14-c10d20f83fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:38:52 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-c158c48f-ae33-41a0-a14a-9c9dd5de87ed tempest-VolumesListTestJSON-1593504829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc310d0b-48f6-419f-8c58-572cd1afb4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:52 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-c158c48f-ae33-41a0-a14a-9c9dd5de87ed tempest-VolumesListTestJSON-1593504829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc310d0b-48f6-419f-8c58-572cd1afb4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2121723688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=202a507f-5616-4202-aaaa-a507598c8f55,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a74b9e066974de390091d579bf5da0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:38:53Z,use_quota=True,user_id='3c803bc7cacf452386b978a1a03f28d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:52 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-c158c48f-ae33-41a0-a14a-9c9dd5de87ed tempest-VolumesListTestJSON-1593504829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58b1a6d4-acc5-4727-b337-c53deb691a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:52 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-c158c48f-ae33-41a0-a14a-9c9dd5de87ed tempest-VolumesListTestJSON-1593504829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58b1a6d4-acc5-4727-b337-c53deb691a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:52 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-c158c48f-ae33-41a0-a14a-9c9dd5de87ed tempest-VolumesListTestJSON-1593504829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cf1707b-402f-4a25-bb5d-023d5b8e2fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:52 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-c158c48f-ae33-41a0-a14a-9c9dd5de87ed tempest-VolumesListTestJSON-1593504829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cf1707b-402f-4a25-bb5d-023d5b8e2fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '202a507f-5616-4202-aaaa-a507598c8f55', 'volume_name': 'volume-202a507f-5616-4202-aaaa-a507598c8f55', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:52 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-c158c48f-ae33-41a0-a14a-9c9dd5de87ed tempest-VolumesListTestJSON-1593504829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b9f9317-129d-4735-acba-a9608dc0491b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:52 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-c158c48f-ae33-41a0-a14a-9c9dd5de87ed tempest-VolumesListTestJSON-1593504829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b9f9317-129d-4735-acba-a9608dc0491b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:52 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-c158c48f-ae33-41a0-a14a-9c9dd5de87ed tempest-VolumesListTestJSON-1593504829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a49bc928-ea51-4e06-ae75-0b7cedb71b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:52 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-c158c48f-ae33-41a0-a14a-9c9dd5de87ed tempest-VolumesListTestJSON-1593504829 None] Volume 202a507f-5616-4202-aaaa-a507598c8f55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-202a507f-5616-4202-aaaa-a507598c8f55', 'volume_size': 1} Nov 02 12:38:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c158c48f-ae33-41a0-a14a-9c9dd5de87ed tempest-VolumesListTestJSON-1593504829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c158c48f-ae33-41a0-a14a-9c9dd5de87ed tempest-VolumesListTestJSON-1593504829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:52 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-c158c48f-ae33-41a0-a14a-9c9dd5de87ed tempest-VolumesListTestJSON-1593504829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2121723688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=202a507f-5616-4202-aaaa-a507598c8f55,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a74b9e066974de390091d579bf5da0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:38:53Z,use_quota=True,user_id='3c803bc7cacf452386b978a1a03f28d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:38:52 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-c158c48f-ae33-41a0-a14a-9c9dd5de87ed tempest-VolumesListTestJSON-1593504829 None] Creating volume 202a507f-5616-4202-aaaa-a507598c8f55 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:38:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c158c48f-ae33-41a0-a14a-9c9dd5de87ed tempest-VolumesListTestJSON-1593504829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c158c48f-ae33-41a0-a14a-9c9dd5de87ed tempest-VolumesListTestJSON-1593504829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:52 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-c158c48f-ae33-41a0-a14a-9c9dd5de87ed tempest-VolumesListTestJSON-1593504829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:38:52 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-c158c48f-ae33-41a0-a14a-9c9dd5de87ed tempest-VolumesListTestJSON-1593504829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:38:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c158c48f-ae33-41a0-a14a-9c9dd5de87ed tempest-VolumesListTestJSON-1593504829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:52 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-c158c48f-ae33-41a0-a14a-9c9dd5de87ed tempest-VolumesListTestJSON-1593504829 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:38:52 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-c158c48f-ae33-41a0-a14a-9c9dd5de87ed tempest-VolumesListTestJSON-1593504829 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:38:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c158c48f-ae33-41a0-a14a-9c9dd5de87ed tempest-VolumesListTestJSON-1593504829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-202a507f-5616-4202-aaaa-a507598c8f55 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:52 devstack sudo[103215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-202a507f-5616-4202-aaaa-a507598c8f55 1073741824 Nov 02 12:38:52 devstack sudo[103215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:53 devstack sudo[103215]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c158c48f-ae33-41a0-a14a-9c9dd5de87ed tempest-VolumesListTestJSON-1593504829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-202a507f-5616-4202-aaaa-a507598c8f55 1073741824" returned: 0 in 0.411s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c158c48f-ae33-41a0-a14a-9c9dd5de87ed tempest-VolumesListTestJSON-1593504829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-202a507f-5616-4202-aaaa-a507598c8f55 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:53 devstack sudo[103220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-202a507f-5616-4202-aaaa-a507598c8f55 Nov 02 12:38:53 devstack sudo[103220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:53 devstack sudo[103220]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c158c48f-ae33-41a0-a14a-9c9dd5de87ed tempest-VolumesListTestJSON-1593504829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-202a507f-5616-4202-aaaa-a507598c8f55" returned: 0 in 0.227s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:53 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-c158c48f-ae33-41a0-a14a-9c9dd5de87ed tempest-VolumesListTestJSON-1593504829 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:38:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c158c48f-ae33-41a0-a14a-9c9dd5de87ed tempest-VolumesListTestJSON-1593504829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-c158c48f-ae33-41a0-a14a-9c9dd5de87ed tempest-VolumesListTestJSON-1593504829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a49bc928-ea51-4e06-ae75-0b7cedb71b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-202a507f-5616-4202-aaaa-a507598c8f55', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-c158c48f-ae33-41a0-a14a-9c9dd5de87ed tempest-VolumesListTestJSON-1593504829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea5c927-1858-4c9c-b877-93402214b64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:53 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-c158c48f-ae33-41a0-a14a-9c9dd5de87ed tempest-VolumesListTestJSON-1593504829 None] Volume volume-202a507f-5616-4202-aaaa-a507598c8f55 (202a507f-5616-4202-aaaa-a507598c8f55): created successfully Nov 02 12:38:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-c158c48f-ae33-41a0-a14a-9c9dd5de87ed tempest-VolumesListTestJSON-1593504829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ea5c927-1858-4c9c-b877-93402214b64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-c158c48f-ae33-41a0-a14a-9c9dd5de87ed tempest-VolumesListTestJSON-1593504829 None] Flow 'volume_create_manager' (d1c270d8-1580-47e2-9e14-c10d20f83fe8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:38:53 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-c158c48f-ae33-41a0-a14a-9c9dd5de87ed tempest-VolumesListTestJSON-1593504829 None] Created volume successfully. Nov 02 12:38:54 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb030d6e-1406-4141-8bc0-9ba481b8c52c tempest-VolumesListTestJSON-1593504829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:38:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fb030d6e-1406-4141-8bc0-9ba481b8c52c tempest-VolumesListTestJSON-1593504829 None] Flow 'volume_create_manager' (61bc8507-8061-4b05-89ec-c8e988a8d09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:38:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fb030d6e-1406-4141-8bc0-9ba481b8c52c tempest-VolumesListTestJSON-1593504829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68eb664d-1aab-4515-a5d5-d1c7c3ea65de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fb030d6e-1406-4141-8bc0-9ba481b8c52c tempest-VolumesListTestJSON-1593504829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68eb664d-1aab-4515-a5d5-d1c7c3ea65de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-647284343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bee5a74-abd9-4882-b7e4-244ca132f52d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a74b9e066974de390091d579bf5da0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:38:54Z,use_quota=True,user_id='3c803bc7cacf452386b978a1a03f28d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fb030d6e-1406-4141-8bc0-9ba481b8c52c tempest-VolumesListTestJSON-1593504829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5943f815-2ed7-4eaf-9259-832b83831db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fb030d6e-1406-4141-8bc0-9ba481b8c52c tempest-VolumesListTestJSON-1593504829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5943f815-2ed7-4eaf-9259-832b83831db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fb030d6e-1406-4141-8bc0-9ba481b8c52c tempest-VolumesListTestJSON-1593504829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a11d8539-1dca-411a-ae5d-4d1bb88e8264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fb030d6e-1406-4141-8bc0-9ba481b8c52c tempest-VolumesListTestJSON-1593504829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a11d8539-1dca-411a-ae5d-4d1bb88e8264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bee5a74-abd9-4882-b7e4-244ca132f52d', 'volume_name': 'volume-6bee5a74-abd9-4882-b7e4-244ca132f52d', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fb030d6e-1406-4141-8bc0-9ba481b8c52c tempest-VolumesListTestJSON-1593504829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02a4e51e-b563-4783-a829-a9a8c48ff34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fb030d6e-1406-4141-8bc0-9ba481b8c52c tempest-VolumesListTestJSON-1593504829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02a4e51e-b563-4783-a829-a9a8c48ff34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fb030d6e-1406-4141-8bc0-9ba481b8c52c tempest-VolumesListTestJSON-1593504829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (142ad504-dcf7-4425-aae9-1c59a9421ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:54 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-fb030d6e-1406-4141-8bc0-9ba481b8c52c tempest-VolumesListTestJSON-1593504829 None] Volume 6bee5a74-abd9-4882-b7e4-244ca132f52d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bee5a74-abd9-4882-b7e4-244ca132f52d', 'volume_size': 1} Nov 02 12:38:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fb030d6e-1406-4141-8bc0-9ba481b8c52c tempest-VolumesListTestJSON-1593504829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fb030d6e-1406-4141-8bc0-9ba481b8c52c tempest-VolumesListTestJSON-1593504829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-fb030d6e-1406-4141-8bc0-9ba481b8c52c tempest-VolumesListTestJSON-1593504829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-647284343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bee5a74-abd9-4882-b7e4-244ca132f52d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a74b9e066974de390091d579bf5da0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:38:54Z,use_quota=True,user_id='3c803bc7cacf452386b978a1a03f28d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:38:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-fb030d6e-1406-4141-8bc0-9ba481b8c52c tempest-VolumesListTestJSON-1593504829 None] Creating volume 6bee5a74-abd9-4882-b7e4-244ca132f52d {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:38:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fb030d6e-1406-4141-8bc0-9ba481b8c52c tempest-VolumesListTestJSON-1593504829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fb030d6e-1406-4141-8bc0-9ba481b8c52c tempest-VolumesListTestJSON-1593504829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-fb030d6e-1406-4141-8bc0-9ba481b8c52c tempest-VolumesListTestJSON-1593504829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:38:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-fb030d6e-1406-4141-8bc0-9ba481b8c52c tempest-VolumesListTestJSON-1593504829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:38:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fb030d6e-1406-4141-8bc0-9ba481b8c52c tempest-VolumesListTestJSON-1593504829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-fb030d6e-1406-4141-8bc0-9ba481b8c52c tempest-VolumesListTestJSON-1593504829 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:38:54 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-fb030d6e-1406-4141-8bc0-9ba481b8c52c tempest-VolumesListTestJSON-1593504829 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:38:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fb030d6e-1406-4141-8bc0-9ba481b8c52c tempest-VolumesListTestJSON-1593504829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6bee5a74-abd9-4882-b7e4-244ca132f52d 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:54 devstack sudo[103223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6bee5a74-abd9-4882-b7e4-244ca132f52d 1073741824 Nov 02 12:38:54 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:54 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fb030d6e-1406-4141-8bc0-9ba481b8c52c tempest-VolumesListTestJSON-1593504829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6bee5a74-abd9-4882-b7e4-244ca132f52d 1073741824" returned: 0 in 0.381s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fb030d6e-1406-4141-8bc0-9ba481b8c52c tempest-VolumesListTestJSON-1593504829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6bee5a74-abd9-4882-b7e4-244ca132f52d {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:54 devstack sudo[103229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6bee5a74-abd9-4882-b7e4-244ca132f52d Nov 02 12:38:54 devstack sudo[103229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:54 devstack sudo[103229]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fb030d6e-1406-4141-8bc0-9ba481b8c52c tempest-VolumesListTestJSON-1593504829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6bee5a74-abd9-4882-b7e4-244ca132f52d" returned: 0 in 0.232s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-fb030d6e-1406-4141-8bc0-9ba481b8c52c tempest-VolumesListTestJSON-1593504829 None] <== create_volume: return (650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:38:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fb030d6e-1406-4141-8bc0-9ba481b8c52c tempest-VolumesListTestJSON-1593504829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.652s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fb030d6e-1406-4141-8bc0-9ba481b8c52c tempest-VolumesListTestJSON-1593504829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (142ad504-dcf7-4425-aae9-1c59a9421ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bee5a74-abd9-4882-b7e4-244ca132f52d', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fb030d6e-1406-4141-8bc0-9ba481b8c52c tempest-VolumesListTestJSON-1593504829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46aae967-eaf9-46ee-a4c8-81078ed4a22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:54 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-fb030d6e-1406-4141-8bc0-9ba481b8c52c tempest-VolumesListTestJSON-1593504829 None] Volume volume-6bee5a74-abd9-4882-b7e4-244ca132f52d (6bee5a74-abd9-4882-b7e4-244ca132f52d): created successfully Nov 02 12:38:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fb030d6e-1406-4141-8bc0-9ba481b8c52c tempest-VolumesListTestJSON-1593504829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46aae967-eaf9-46ee-a4c8-81078ed4a22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fb030d6e-1406-4141-8bc0-9ba481b8c52c tempest-VolumesListTestJSON-1593504829 None] Flow 'volume_create_manager' (61bc8507-8061-4b05-89ec-c8e988a8d09a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:38:54 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-fb030d6e-1406-4141-8bc0-9ba481b8c52c tempest-VolumesListTestJSON-1593504829 None] Created volume successfully. Nov 02 12:38:55 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-791b4154-ef01-4efe-b49c-6e4f63fa70e3 tempest-VolumesListTestJSON-1593504829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:38:55 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-791b4154-ef01-4efe-b49c-6e4f63fa70e3 tempest-VolumesListTestJSON-1593504829 None] Flow 'volume_create_manager' (30cbf33a-5af3-4192-9dcd-4fdb945fbea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:38:55 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-791b4154-ef01-4efe-b49c-6e4f63fa70e3 tempest-VolumesListTestJSON-1593504829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60dc1499-e169-49eb-a096-18df6189acfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:55 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-791b4154-ef01-4efe-b49c-6e4f63fa70e3 tempest-VolumesListTestJSON-1593504829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60dc1499-e169-49eb-a096-18df6189acfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1751241802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c32242cf-91b7-4683-ba8b-32579745aca1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a74b9e066974de390091d579bf5da0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:38:56Z,use_quota=True,user_id='3c803bc7cacf452386b978a1a03f28d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:55 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-791b4154-ef01-4efe-b49c-6e4f63fa70e3 tempest-VolumesListTestJSON-1593504829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0566f882-5bd8-4a13-844f-60cf7b589937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:55 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-791b4154-ef01-4efe-b49c-6e4f63fa70e3 tempest-VolumesListTestJSON-1593504829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0566f882-5bd8-4a13-844f-60cf7b589937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:55 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-791b4154-ef01-4efe-b49c-6e4f63fa70e3 tempest-VolumesListTestJSON-1593504829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcde6370-df0d-419e-98ff-daf68e66dd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:55 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-791b4154-ef01-4efe-b49c-6e4f63fa70e3 tempest-VolumesListTestJSON-1593504829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcde6370-df0d-419e-98ff-daf68e66dd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c32242cf-91b7-4683-ba8b-32579745aca1', 'volume_name': 'volume-c32242cf-91b7-4683-ba8b-32579745aca1', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:55 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-791b4154-ef01-4efe-b49c-6e4f63fa70e3 tempest-VolumesListTestJSON-1593504829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dce7151d-48bb-4af4-8599-aab160956b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:55 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-791b4154-ef01-4efe-b49c-6e4f63fa70e3 tempest-VolumesListTestJSON-1593504829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dce7151d-48bb-4af4-8599-aab160956b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:55 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-791b4154-ef01-4efe-b49c-6e4f63fa70e3 tempest-VolumesListTestJSON-1593504829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b842932b-8ddb-4faf-9dc5-cd391713d34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:55 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-791b4154-ef01-4efe-b49c-6e4f63fa70e3 tempest-VolumesListTestJSON-1593504829 None] Volume c32242cf-91b7-4683-ba8b-32579745aca1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c32242cf-91b7-4683-ba8b-32579745aca1', 'volume_size': 1} Nov 02 12:38:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-791b4154-ef01-4efe-b49c-6e4f63fa70e3 tempest-VolumesListTestJSON-1593504829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-791b4154-ef01-4efe-b49c-6e4f63fa70e3 tempest-VolumesListTestJSON-1593504829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:55 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-791b4154-ef01-4efe-b49c-6e4f63fa70e3 tempest-VolumesListTestJSON-1593504829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1751241802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c32242cf-91b7-4683-ba8b-32579745aca1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a74b9e066974de390091d579bf5da0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:38:56Z,use_quota=True,user_id='3c803bc7cacf452386b978a1a03f28d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:38:55 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-791b4154-ef01-4efe-b49c-6e4f63fa70e3 tempest-VolumesListTestJSON-1593504829 None] Creating volume c32242cf-91b7-4683-ba8b-32579745aca1 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:38:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-791b4154-ef01-4efe-b49c-6e4f63fa70e3 tempest-VolumesListTestJSON-1593504829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-791b4154-ef01-4efe-b49c-6e4f63fa70e3 tempest-VolumesListTestJSON-1593504829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:55 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-791b4154-ef01-4efe-b49c-6e4f63fa70e3 tempest-VolumesListTestJSON-1593504829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:38:55 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-791b4154-ef01-4efe-b49c-6e4f63fa70e3 tempest-VolumesListTestJSON-1593504829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:38:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-791b4154-ef01-4efe-b49c-6e4f63fa70e3 tempest-VolumesListTestJSON-1593504829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:55 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-791b4154-ef01-4efe-b49c-6e4f63fa70e3 tempest-VolumesListTestJSON-1593504829 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:38:55 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-791b4154-ef01-4efe-b49c-6e4f63fa70e3 tempest-VolumesListTestJSON-1593504829 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:38:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-791b4154-ef01-4efe-b49c-6e4f63fa70e3 tempest-VolumesListTestJSON-1593504829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c32242cf-91b7-4683-ba8b-32579745aca1 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:55 devstack sudo[103258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c32242cf-91b7-4683-ba8b-32579745aca1 1073741824 Nov 02 12:38:55 devstack sudo[103258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:56 devstack sudo[103258]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-791b4154-ef01-4efe-b49c-6e4f63fa70e3 tempest-VolumesListTestJSON-1593504829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c32242cf-91b7-4683-ba8b-32579745aca1 1073741824" returned: 0 in 0.393s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-791b4154-ef01-4efe-b49c-6e4f63fa70e3 tempest-VolumesListTestJSON-1593504829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c32242cf-91b7-4683-ba8b-32579745aca1 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:56 devstack sudo[103263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c32242cf-91b7-4683-ba8b-32579745aca1 Nov 02 12:38:56 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:56 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-791b4154-ef01-4efe-b49c-6e4f63fa70e3 tempest-VolumesListTestJSON-1593504829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c32242cf-91b7-4683-ba8b-32579745aca1" returned: 0 in 0.232s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:56 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-791b4154-ef01-4efe-b49c-6e4f63fa70e3 tempest-VolumesListTestJSON-1593504829 None] <== create_volume: return (665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:38:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-791b4154-ef01-4efe-b49c-6e4f63fa70e3 tempest-VolumesListTestJSON-1593504829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.667s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:56 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-791b4154-ef01-4efe-b49c-6e4f63fa70e3 tempest-VolumesListTestJSON-1593504829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b842932b-8ddb-4faf-9dc5-cd391713d34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c32242cf-91b7-4683-ba8b-32579745aca1', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:56 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-791b4154-ef01-4efe-b49c-6e4f63fa70e3 tempest-VolumesListTestJSON-1593504829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46e6fcc8-69b4-46b4-9071-29a505a085b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:38:56 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-791b4154-ef01-4efe-b49c-6e4f63fa70e3 tempest-VolumesListTestJSON-1593504829 None] Volume volume-c32242cf-91b7-4683-ba8b-32579745aca1 (c32242cf-91b7-4683-ba8b-32579745aca1): created successfully Nov 02 12:38:56 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-791b4154-ef01-4efe-b49c-6e4f63fa70e3 tempest-VolumesListTestJSON-1593504829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46e6fcc8-69b4-46b4-9071-29a505a085b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:38:56 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-791b4154-ef01-4efe-b49c-6e4f63fa70e3 tempest-VolumesListTestJSON-1593504829 None] Flow 'volume_create_manager' (30cbf33a-5af3-4192-9dcd-4fdb945fbea6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:38:56 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-791b4154-ef01-4efe-b49c-6e4f63fa70e3 tempest-VolumesListTestJSON-1593504829 None] Created volume successfully. Nov 02 12:38:58 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d63bcf49-2685-41ce-b997-18367fc2b00e tempest-VolumesListTestJSON-1593504829 None] Acquiring lock "cinder-c32242cf-91b7-4683-ba8b-32579745aca1-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:58 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d63bcf49-2685-41ce-b997-18367fc2b00e tempest-VolumesListTestJSON-1593504829 None] Lock "cinder-c32242cf-91b7-4683-ba8b-32579745aca1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:58 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d63bcf49-2685-41ce-b997-18367fc2b00e tempest-VolumesListTestJSON-1593504829 None] Acquiring lock "cinder-quobyte-c32242cf-91b7-4683-ba8b-32579745aca1" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:38:58 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d63bcf49-2685-41ce-b997-18367fc2b00e tempest-VolumesListTestJSON-1593504829 None] Lock "cinder-quobyte-c32242cf-91b7-4683-ba8b-32579745aca1" acquired by "delete_volume" :: waited 0.013s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:38:58 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[649d7426-85c1-42fc-9646-26cbfdb0fa3e]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:38:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d63bcf49-2685-41ce-b997-18367fc2b00e tempest-VolumesListTestJSON-1593504829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c32242cf-91b7-4683-ba8b-32579745aca1 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:58 devstack sudo[103270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c32242cf-91b7-4683-ba8b-32579745aca1 Nov 02 12:38:58 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:59 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d63bcf49-2685-41ce-b997-18367fc2b00e tempest-VolumesListTestJSON-1593504829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c32242cf-91b7-4683-ba8b-32579745aca1" returned: 0 in 0.397s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d63bcf49-2685-41ce-b997-18367fc2b00e tempest-VolumesListTestJSON-1593504829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c32242cf-91b7-4683-ba8b-32579745aca1 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:59 devstack sudo[103276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c32242cf-91b7-4683-ba8b-32579745aca1 Nov 02 12:38:59 devstack sudo[103276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:38:59 devstack sudo[103276]: pam_unix(sudo:session): session closed for user root Nov 02 12:38:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d63bcf49-2685-41ce-b997-18367fc2b00e tempest-VolumesListTestJSON-1593504829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c32242cf-91b7-4683-ba8b-32579745aca1" returned: 0 in 0.307s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:38:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d63bcf49-2685-41ce-b997-18367fc2b00e tempest-VolumesListTestJSON-1593504829 None] Lock "cinder-quobyte-c32242cf-91b7-4683-ba8b-32579745aca1" released by "delete_volume" :: held 0.757s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:38:59 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-d63bcf49-2685-41ce-b997-18367fc2b00e tempest-VolumesListTestJSON-1593504829 None] Created reservations ['461999ed-7d94-45a3-9358-3710103d0305', 'd95b0e9b-9fbc-456c-8be5-7e2cf47abf0a', '0b98de77-8d63-489c-954b-0dc3f3ad7d26', '5c9a337f-cf2b-4469-ae49-e22cac3b0b2b'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:38:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d63bcf49-2685-41ce-b997-18367fc2b00e tempest-VolumesListTestJSON-1593504829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:38:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d63bcf49-2685-41ce-b997-18367fc2b00e tempest-VolumesListTestJSON-1593504829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:38:59 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d63bcf49-2685-41ce-b997-18367fc2b00e tempest-VolumesListTestJSON-1593504829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:38:59 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d63bcf49-2685-41ce-b997-18367fc2b00e tempest-VolumesListTestJSON-1593504829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:38:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d63bcf49-2685-41ce-b997-18367fc2b00e tempest-VolumesListTestJSON-1593504829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:38:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d63bcf49-2685-41ce-b997-18367fc2b00e tempest-VolumesListTestJSON-1593504829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:38:59 devstack sudo[103282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:38:59 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:00 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8ca30b4c-d2e5-4270-b163-a46ade1b21be tempest-VolumesListTestJSON-1593504829 None] Acquiring lock "cinder-6bee5a74-abd9-4882-b7e4-244ca132f52d-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:00 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8ca30b4c-d2e5-4270-b163-a46ade1b21be tempest-VolumesListTestJSON-1593504829 None] Lock "cinder-6bee5a74-abd9-4882-b7e4-244ca132f52d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:00 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d63bcf49-2685-41ce-b997-18367fc2b00e tempest-VolumesListTestJSON-1593504829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.508s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:00 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-d63bcf49-2685-41ce-b997-18367fc2b00e tempest-VolumesListTestJSON-1593504829 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:39:00 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-d63bcf49-2685-41ce-b997-18367fc2b00e tempest-VolumesListTestJSON-1593504829 None] Deleted volume successfully. Nov 02 12:39:00 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8ca30b4c-d2e5-4270-b163-a46ade1b21be tempest-VolumesListTestJSON-1593504829 None] Acquiring lock "cinder-quobyte-6bee5a74-abd9-4882-b7e4-244ca132f52d" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:00 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d63bcf49-2685-41ce-b997-18367fc2b00e tempest-VolumesListTestJSON-1593504829 None] Lock "cinder-c32242cf-91b7-4683-ba8b-32579745aca1-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:00 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8ca30b4c-d2e5-4270-b163-a46ade1b21be tempest-VolumesListTestJSON-1593504829 None] Lock "cinder-quobyte-6bee5a74-abd9-4882-b7e4-244ca132f52d" acquired by "delete_volume" :: waited 0.025s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:00 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b6f401-e8d7-4529-82d3-85aa2eae36e1]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8ca30b4c-d2e5-4270-b163-a46ade1b21be tempest-VolumesListTestJSON-1593504829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6bee5a74-abd9-4882-b7e4-244ca132f52d {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:00 devstack sudo[103303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6bee5a74-abd9-4882-b7e4-244ca132f52d Nov 02 12:39:00 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:00 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8ca30b4c-d2e5-4270-b163-a46ade1b21be tempest-VolumesListTestJSON-1593504829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6bee5a74-abd9-4882-b7e4-244ca132f52d" returned: 0 in 0.412s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8ca30b4c-d2e5-4270-b163-a46ade1b21be tempest-VolumesListTestJSON-1593504829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6bee5a74-abd9-4882-b7e4-244ca132f52d {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:00 devstack sudo[103309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6bee5a74-abd9-4882-b7e4-244ca132f52d Nov 02 12:39:00 devstack sudo[103309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:01 devstack sudo[103309]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8ca30b4c-d2e5-4270-b163-a46ade1b21be tempest-VolumesListTestJSON-1593504829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6bee5a74-abd9-4882-b7e4-244ca132f52d" returned: 0 in 0.267s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8ca30b4c-d2e5-4270-b163-a46ade1b21be tempest-VolumesListTestJSON-1593504829 None] Lock "cinder-quobyte-6bee5a74-abd9-4882-b7e4-244ca132f52d" released by "delete_volume" :: held 0.742s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:01 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-8ca30b4c-d2e5-4270-b163-a46ade1b21be tempest-VolumesListTestJSON-1593504829 None] Created reservations ['88dd49d3-5032-47af-87c5-4f501f29f768', '74a023ea-1c91-4bae-aa6c-71bd3b78b87b', '708a7c79-a449-41db-b644-3e3c9dbd0655', 'dd0081e9-64c8-40f5-8243-d7c118ac06e4'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:39:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8ca30b4c-d2e5-4270-b163-a46ade1b21be tempest-VolumesListTestJSON-1593504829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8ca30b4c-d2e5-4270-b163-a46ade1b21be tempest-VolumesListTestJSON-1593504829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:01 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8ca30b4c-d2e5-4270-b163-a46ade1b21be tempest-VolumesListTestJSON-1593504829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:01 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8ca30b4c-d2e5-4270-b163-a46ade1b21be tempest-VolumesListTestJSON-1593504829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8ca30b4c-d2e5-4270-b163-a46ade1b21be tempest-VolumesListTestJSON-1593504829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8ca30b4c-d2e5-4270-b163-a46ade1b21be tempest-VolumesListTestJSON-1593504829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:01 devstack sudo[103314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:39:01 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:01 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-1bd52330-660f-414d-8b5f-8ecdf21d98c4 req-2947389c-7caa-4fc2-a7ee-da2658e047ba tempest-TestShelveInstance-2111934223 None] Terminate volume connection completed successfully. Nov 02 12:39:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-1bd52330-660f-414d-8b5f-8ecdf21d98c4 req-2947389c-7caa-4fc2-a7ee-da2658e047ba tempest-TestShelveInstance-2111934223 None] Deleting attachment e1db6e7a-c0bc-4819-957b-01c95d8bdc7f. {{(pid=86515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:39:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-48b1770f-efc0-469b-b4b5-89a666e24e9e tempest-VolumesListTestJSON-1593504829 None] Acquiring lock "cinder-202a507f-5616-4202-aaaa-a507598c8f55-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-48b1770f-efc0-469b-b4b5-89a666e24e9e tempest-VolumesListTestJSON-1593504829 None] Lock "cinder-202a507f-5616-4202-aaaa-a507598c8f55-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:01 devstack sudo[103314]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8ca30b4c-d2e5-4270-b163-a46ade1b21be tempest-VolumesListTestJSON-1593504829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.281s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:01 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-8ca30b4c-d2e5-4270-b163-a46ade1b21be tempest-VolumesListTestJSON-1593504829 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:39:01 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-8ca30b4c-d2e5-4270-b163-a46ade1b21be tempest-VolumesListTestJSON-1593504829 None] Deleted volume successfully. Nov 02 12:39:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [req-1bd52330-660f-414d-8b5f-8ecdf21d98c4 req-1b939d69-e58e-49a2-9b01-2c3a8e6bcc27 tempest-TestShelveInstance-2111934223 None] Acquiring lock "cinder-f59e28ae-e543-43ab-9559-ed2f3eb76d4f-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [req-1bd52330-660f-414d-8b5f-8ecdf21d98c4 req-1b939d69-e58e-49a2-9b01-2c3a8e6bcc27 tempest-TestShelveInstance-2111934223 None] Lock "cinder-f59e28ae-e543-43ab-9559-ed2f3eb76d4f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8ca30b4c-d2e5-4270-b163-a46ade1b21be tempest-VolumesListTestJSON-1593504829 None] Lock "cinder-6bee5a74-abd9-4882-b7e4-244ca132f52d-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-48b1770f-efc0-469b-b4b5-89a666e24e9e tempest-VolumesListTestJSON-1593504829 None] Acquiring lock "cinder-quobyte-202a507f-5616-4202-aaaa-a507598c8f55" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-48b1770f-efc0-469b-b4b5-89a666e24e9e tempest-VolumesListTestJSON-1593504829 None] Lock "cinder-quobyte-202a507f-5616-4202-aaaa-a507598c8f55" acquired by "delete_volume" :: waited 0.020s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [req-1bd52330-660f-414d-8b5f-8ecdf21d98c4 req-1b939d69-e58e-49a2-9b01-2c3a8e6bcc27 tempest-TestShelveInstance-2111934223 None] Acquiring lock "cinder-quobyte-f59e28ae-e543-43ab-9559-ed2f3eb76d4f" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:01 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[c635fad7-0e93-4f81-be8f-5c533ba8c9cd]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-48b1770f-efc0-469b-b4b5-89a666e24e9e tempest-VolumesListTestJSON-1593504829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-202a507f-5616-4202-aaaa-a507598c8f55 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [req-1bd52330-660f-414d-8b5f-8ecdf21d98c4 req-1b939d69-e58e-49a2-9b01-2c3a8e6bcc27 tempest-TestShelveInstance-2111934223 None] Lock "cinder-quobyte-f59e28ae-e543-43ab-9559-ed2f3eb76d4f" acquired by "delete_volume" :: waited 0.029s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:01 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6b01c5-fc08-4d07-848b-a09290d31526]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-1bd52330-660f-414d-8b5f-8ecdf21d98c4 req-1b939d69-e58e-49a2-9b01-2c3a8e6bcc27 tempest-TestShelveInstance-2111934223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f59e28ae-e543-43ab-9559-ed2f3eb76d4f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:01 devstack sudo[103318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-202a507f-5616-4202-aaaa-a507598c8f55 Nov 02 12:39:01 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:01 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f59e28ae-e543-43ab-9559-ed2f3eb76d4f Nov 02 12:39:01 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:02 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-48b1770f-efc0-469b-b4b5-89a666e24e9e tempest-VolumesListTestJSON-1593504829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-202a507f-5616-4202-aaaa-a507598c8f55" returned: 0 in 0.415s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-48b1770f-efc0-469b-b4b5-89a666e24e9e tempest-VolumesListTestJSON-1593504829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-202a507f-5616-4202-aaaa-a507598c8f55 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:02 devstack sudo[103327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-202a507f-5616-4202-aaaa-a507598c8f55 Nov 02 12:39:02 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:02 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-1bd52330-660f-414d-8b5f-8ecdf21d98c4 req-1b939d69-e58e-49a2-9b01-2c3a8e6bcc27 tempest-TestShelveInstance-2111934223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f59e28ae-e543-43ab-9559-ed2f3eb76d4f" returned: 0 in 0.432s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-1bd52330-660f-414d-8b5f-8ecdf21d98c4 req-1b939d69-e58e-49a2-9b01-2c3a8e6bcc27 tempest-TestShelveInstance-2111934223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f59e28ae-e543-43ab-9559-ed2f3eb76d4f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:02 devstack sudo[103330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f59e28ae-e543-43ab-9559-ed2f3eb76d4f Nov 02 12:39:02 devstack sudo[103330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:02 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-48b1770f-efc0-469b-b4b5-89a666e24e9e tempest-VolumesListTestJSON-1593504829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-202a507f-5616-4202-aaaa-a507598c8f55" returned: 0 in 0.292s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:02 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-48b1770f-efc0-469b-b4b5-89a666e24e9e tempest-VolumesListTestJSON-1593504829 None] Lock "cinder-quobyte-202a507f-5616-4202-aaaa-a507598c8f55" released by "delete_volume" :: held 0.769s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:02 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-48b1770f-efc0-469b-b4b5-89a666e24e9e tempest-VolumesListTestJSON-1593504829 None] Created reservations ['88eda998-3312-4ca8-bafa-ad6e84db7ec4', '6b44560f-8c7a-43b7-b548-b74a1c6f3513', '0944b419-3662-42bf-b265-fd9cb479b294', 'ca69ea45-d35b-4719-9d45-b1a84cf5b456'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:39:02 devstack sudo[103330]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-1bd52330-660f-414d-8b5f-8ecdf21d98c4 req-1b939d69-e58e-49a2-9b01-2c3a8e6bcc27 tempest-TestShelveInstance-2111934223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f59e28ae-e543-43ab-9559-ed2f3eb76d4f" returned: 0 in 0.333s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:02 devstack cinder-volume[86515]: DEBUG cinder.coordination [req-1bd52330-660f-414d-8b5f-8ecdf21d98c4 req-1b939d69-e58e-49a2-9b01-2c3a8e6bcc27 tempest-TestShelveInstance-2111934223 None] Lock "cinder-quobyte-f59e28ae-e543-43ab-9559-ed2f3eb76d4f" released by "delete_volume" :: held 0.845s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-48b1770f-efc0-469b-b4b5-89a666e24e9e tempest-VolumesListTestJSON-1593504829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-48b1770f-efc0-469b-b4b5-89a666e24e9e tempest-VolumesListTestJSON-1593504829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-48b1770f-efc0-469b-b4b5-89a666e24e9e tempest-VolumesListTestJSON-1593504829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-48b1770f-efc0-469b-b4b5-89a666e24e9e tempest-VolumesListTestJSON-1593504829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-48b1770f-efc0-469b-b4b5-89a666e24e9e tempest-VolumesListTestJSON-1593504829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-48b1770f-efc0-469b-b4b5-89a666e24e9e tempest-VolumesListTestJSON-1593504829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:02 devstack cinder-volume[86515]: DEBUG cinder.quota [req-1bd52330-660f-414d-8b5f-8ecdf21d98c4 req-1b939d69-e58e-49a2-9b01-2c3a8e6bcc27 tempest-TestShelveInstance-2111934223 None] Created reservations ['ed55df2a-d23f-4ee8-8986-f5d942e095c8', 'b48b0a8f-a6b4-4a74-9c8e-36ba798048c3', 'c3b5b148-ecf4-4d25-a781-7756ddd5ef96', 'bae503a0-b6ff-48c3-ac3e-e6ee2b33bc62'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:39:02 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:39:02 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-1bd52330-660f-414d-8b5f-8ecdf21d98c4 req-1b939d69-e58e-49a2-9b01-2c3a8e6bcc27 tempest-TestShelveInstance-2111934223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-1bd52330-660f-414d-8b5f-8ecdf21d98c4 req-1b939d69-e58e-49a2-9b01-2c3a8e6bcc27 tempest-TestShelveInstance-2111934223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [req-1bd52330-660f-414d-8b5f-8ecdf21d98c4 req-1b939d69-e58e-49a2-9b01-2c3a8e6bcc27 tempest-TestShelveInstance-2111934223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [req-1bd52330-660f-414d-8b5f-8ecdf21d98c4 req-1b939d69-e58e-49a2-9b01-2c3a8e6bcc27 tempest-TestShelveInstance-2111934223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-1bd52330-660f-414d-8b5f-8ecdf21d98c4 req-1b939d69-e58e-49a2-9b01-2c3a8e6bcc27 tempest-TestShelveInstance-2111934223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-1bd52330-660f-414d-8b5f-8ecdf21d98c4 req-1b939d69-e58e-49a2-9b01-2c3a8e6bcc27 tempest-TestShelveInstance-2111934223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:02 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:39:02 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:02 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-48b1770f-efc0-469b-b4b5-89a666e24e9e tempest-VolumesListTestJSON-1593504829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.336s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:02 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-48b1770f-efc0-469b-b4b5-89a666e24e9e tempest-VolumesListTestJSON-1593504829 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:39:02 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-48b1770f-efc0-469b-b4b5-89a666e24e9e tempest-VolumesListTestJSON-1593504829 None] Deleted volume successfully. Nov 02 12:39:02 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-48b1770f-efc0-469b-b4b5-89a666e24e9e tempest-VolumesListTestJSON-1593504829 None] Lock "cinder-202a507f-5616-4202-aaaa-a507598c8f55-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:03 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [req-1bd52330-660f-414d-8b5f-8ecdf21d98c4 req-1b939d69-e58e-49a2-9b01-2c3a8e6bcc27 tempest-TestShelveInstance-2111934223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.330s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:03 devstack cinder-volume[86515]: DEBUG cinder.manager [req-1bd52330-660f-414d-8b5f-8ecdf21d98c4 req-1b939d69-e58e-49a2-9b01-2c3a8e6bcc27 tempest-TestShelveInstance-2111934223 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:39:03 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-1bd52330-660f-414d-8b5f-8ecdf21d98c4 req-1b939d69-e58e-49a2-9b01-2c3a8e6bcc27 tempest-TestShelveInstance-2111934223 None] Deleted volume successfully. Nov 02 12:39:03 devstack cinder-volume[86515]: DEBUG cinder.coordination [req-1bd52330-660f-414d-8b5f-8ecdf21d98c4 req-1b939d69-e58e-49a2-9b01-2c3a8e6bcc27 tempest-TestShelveInstance-2111934223 None] Lock "cinder-f59e28ae-e543-43ab-9559-ed2f3eb76d4f-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:12 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=101,cinder:UPDATE=114,cinder:INSERT=24,cinder:DELETE=8 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:39:13 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:UPDATE=123,cinder:SELECT=93,cinder:INSERT=34,cinder:DELETE=12 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:39:16 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f322505-6716-41ad-a742-2339d6e30f4a tempest-VolumesSnapshotTestJSON-130675119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:39:16 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7f322505-6716-41ad-a742-2339d6e30f4a tempest-VolumesSnapshotTestJSON-130675119 None] Flow 'volume_create_manager' (8f59a09d-6735-42ae-bc77-f1cce64a9fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:16 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7f322505-6716-41ad-a742-2339d6e30f4a tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (320535f2-3195-4487-9c77-224016806d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:16 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7f322505-6716-41ad-a742-2339d6e30f4a tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (320535f2-3195-4487-9c77-224016806d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1749911308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=309ed49d-bba9-4265-b601-48fce1e56e1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7060abc179094b93999584088c8e776a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:17Z,use_quota=True,user_id='a5e6e4e9ce4b4c9e82fb48b98cbaf73d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:16 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7f322505-6716-41ad-a742-2339d6e30f4a tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c72fe8-9544-48e5-bf27-f9facbe3c042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:16 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7f322505-6716-41ad-a742-2339d6e30f4a tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c72fe8-9544-48e5-bf27-f9facbe3c042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:16 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7f322505-6716-41ad-a742-2339d6e30f4a tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28bd25fe-264b-4a65-94ba-5560a5d01abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:16 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7f322505-6716-41ad-a742-2339d6e30f4a tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28bd25fe-264b-4a65-94ba-5560a5d01abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '309ed49d-bba9-4265-b601-48fce1e56e1a', 'volume_name': 'volume-309ed49d-bba9-4265-b601-48fce1e56e1a', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:16 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7f322505-6716-41ad-a742-2339d6e30f4a tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (196093b3-d417-4f68-a729-ed719e572267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:16 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7f322505-6716-41ad-a742-2339d6e30f4a tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (196093b3-d417-4f68-a729-ed719e572267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:16 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7f322505-6716-41ad-a742-2339d6e30f4a tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (356da8f8-3985-49e5-b309-298a6852cf91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:16 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-7f322505-6716-41ad-a742-2339d6e30f4a tempest-VolumesSnapshotTestJSON-130675119 None] Volume 309ed49d-bba9-4265-b601-48fce1e56e1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-309ed49d-bba9-4265-b601-48fce1e56e1a', 'volume_size': 1} Nov 02 12:39:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7f322505-6716-41ad-a742-2339d6e30f4a tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7f322505-6716-41ad-a742-2339d6e30f4a tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:16 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-7f322505-6716-41ad-a742-2339d6e30f4a tempest-VolumesSnapshotTestJSON-130675119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1749911308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=309ed49d-bba9-4265-b601-48fce1e56e1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7060abc179094b93999584088c8e776a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:17Z,use_quota=True,user_id='a5e6e4e9ce4b4c9e82fb48b98cbaf73d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:39:16 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-7f322505-6716-41ad-a742-2339d6e30f4a tempest-VolumesSnapshotTestJSON-130675119 None] Creating volume 309ed49d-bba9-4265-b601-48fce1e56e1a {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:39:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7f322505-6716-41ad-a742-2339d6e30f4a tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7f322505-6716-41ad-a742-2339d6e30f4a tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:16 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-7f322505-6716-41ad-a742-2339d6e30f4a tempest-VolumesSnapshotTestJSON-130675119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:16 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-7f322505-6716-41ad-a742-2339d6e30f4a tempest-VolumesSnapshotTestJSON-130675119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7f322505-6716-41ad-a742-2339d6e30f4a tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:16 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-7f322505-6716-41ad-a742-2339d6e30f4a tempest-VolumesSnapshotTestJSON-130675119 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:39:16 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-7f322505-6716-41ad-a742-2339d6e30f4a tempest-VolumesSnapshotTestJSON-130675119 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:39:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7f322505-6716-41ad-a742-2339d6e30f4a tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:16 devstack sudo[103345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a 1073741824 Nov 02 12:39:16 devstack sudo[103345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:17 devstack sudo[103345]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7f322505-6716-41ad-a742-2339d6e30f4a tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a 1073741824" returned: 0 in 0.475s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e55f881-bfd2-4f14-88dd-d49ebf392887 tempest-CreateVolumesFromImageTest-837240110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0e55f881-bfd2-4f14-88dd-d49ebf392887 tempest-CreateVolumesFromImageTest-837240110 None] Flow 'volume_create_manager' (14941ea1-84ad-421c-b61f-ca6f087a7df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0e55f881-bfd2-4f14-88dd-d49ebf392887 tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec1fc8ee-7bf2-4c2e-82b9-cb2b07faff54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7f322505-6716-41ad-a742-2339d6e30f4a tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0e55f881-bfd2-4f14-88dd-d49ebf392887 tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec1fc8ee-7bf2-4c2e-82b9-cb2b07faff54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1377551014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=060b7b57-e244-437b-9347-bc3860038dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='686468b19eb44c1ba61bec2e6d28ae59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:17Z,use_quota=True,user_id='891e45b45e3849aaa87831cf65c39f1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:17 devstack sudo[103351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a Nov 02 12:39:17 devstack sudo[103351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0e55f881-bfd2-4f14-88dd-d49ebf392887 tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (805c7efb-9c77-4d65-a39b-81422ee1647a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0e55f881-bfd2-4f14-88dd-d49ebf392887 tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (805c7efb-9c77-4d65-a39b-81422ee1647a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0e55f881-bfd2-4f14-88dd-d49ebf392887 tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8011e830-685c-4b8b-9abd-ec6c7d835dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0e55f881-bfd2-4f14-88dd-d49ebf392887 tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8011e830-685c-4b8b-9abd-ec6c7d835dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '060b7b57-e244-437b-9347-bc3860038dfe', 'volume_name': 'volume-060b7b57-e244-437b-9347-bc3860038dfe', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0e55f881-bfd2-4f14-88dd-d49ebf392887 tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc5e3081-f3d2-42fe-840e-768e78db5dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0e55f881-bfd2-4f14-88dd-d49ebf392887 tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc5e3081-f3d2-42fe-840e-768e78db5dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0e55f881-bfd2-4f14-88dd-d49ebf392887 tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed6b5230-81b7-4891-a451-9fa0632768de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:17 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-0e55f881-bfd2-4f14-88dd-d49ebf392887 tempest-CreateVolumesFromImageTest-837240110 None] Volume 060b7b57-e244-437b-9347-bc3860038dfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-060b7b57-e244-437b-9347-bc3860038dfe', 'volume_size': 1} Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0e55f881-bfd2-4f14-88dd-d49ebf392887 tempest-CreateVolumesFromImageTest-837240110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:17 devstack sudo[103351]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7f322505-6716-41ad-a742-2339d6e30f4a tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a" returned: 0 in 0.252s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-7f322505-6716-41ad-a742-2339d6e30f4a tempest-VolumesSnapshotTestJSON-130675119 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7f322505-6716-41ad-a742-2339d6e30f4a tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0e55f881-bfd2-4f14-88dd-d49ebf392887 tempest-CreateVolumesFromImageTest-837240110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.198s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0e55f881-bfd2-4f14-88dd-d49ebf392887 tempest-CreateVolumesFromImageTest-837240110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1377551014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=060b7b57-e244-437b-9347-bc3860038dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='686468b19eb44c1ba61bec2e6d28ae59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:17Z,use_quota=True,user_id='891e45b45e3849aaa87831cf65c39f1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-0e55f881-bfd2-4f14-88dd-d49ebf392887 tempest-CreateVolumesFromImageTest-837240110 None] Creating volume 060b7b57-e244-437b-9347-bc3860038dfe {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0e55f881-bfd2-4f14-88dd-d49ebf392887 tempest-CreateVolumesFromImageTest-837240110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0e55f881-bfd2-4f14-88dd-d49ebf392887 tempest-CreateVolumesFromImageTest-837240110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0e55f881-bfd2-4f14-88dd-d49ebf392887 tempest-CreateVolumesFromImageTest-837240110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0e55f881-bfd2-4f14-88dd-d49ebf392887 tempest-CreateVolumesFromImageTest-837240110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0e55f881-bfd2-4f14-88dd-d49ebf392887 tempest-CreateVolumesFromImageTest-837240110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0e55f881-bfd2-4f14-88dd-d49ebf392887 tempest-CreateVolumesFromImageTest-837240110 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:39:17 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-0e55f881-bfd2-4f14-88dd-d49ebf392887 tempest-CreateVolumesFromImageTest-837240110 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0e55f881-bfd2-4f14-88dd-d49ebf392887 tempest-CreateVolumesFromImageTest-837240110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-060b7b57-e244-437b-9347-bc3860038dfe 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:17 devstack sudo[103354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-060b7b57-e244-437b-9347-bc3860038dfe 1073741824 Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7f322505-6716-41ad-a742-2339d6e30f4a tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (356da8f8-3985-49e5-b309-298a6852cf91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-309ed49d-bba9-4265-b601-48fce1e56e1a', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:17 devstack sudo[103354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7f322505-6716-41ad-a742-2339d6e30f4a tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (924e3152-3ff1-42bb-89e5-b3a92f35c5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:17 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-7f322505-6716-41ad-a742-2339d6e30f4a tempest-VolumesSnapshotTestJSON-130675119 None] Volume volume-309ed49d-bba9-4265-b601-48fce1e56e1a (309ed49d-bba9-4265-b601-48fce1e56e1a): created successfully Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7f322505-6716-41ad-a742-2339d6e30f4a tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (924e3152-3ff1-42bb-89e5-b3a92f35c5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7f322505-6716-41ad-a742-2339d6e30f4a tempest-VolumesSnapshotTestJSON-130675119 None] Flow 'volume_create_manager' (8f59a09d-6735-42ae-bc77-f1cce64a9fbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-454b51ba-60fb-414b-9f9e-e509e4a8da64 tempest-CreateVolumesFromImageTest-837240110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-454b51ba-60fb-414b-9f9e-e509e4a8da64 tempest-CreateVolumesFromImageTest-837240110 None] Flow 'volume_create_manager' (dd6b644d-6af1-4ce0-9f5a-6a67b11e2593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-454b51ba-60fb-414b-9f9e-e509e4a8da64 tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee7ac95b-71e4-4fb4-8dc6-006b2f6f3815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:17 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-7f322505-6716-41ad-a742-2339d6e30f4a tempest-VolumesSnapshotTestJSON-130675119 None] Created volume successfully. Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-454b51ba-60fb-414b-9f9e-e509e4a8da64 tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee7ac95b-71e4-4fb4-8dc6-006b2f6f3815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1582434083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b419fb3a-852b-4124-aaab-a80fc0f1fe37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='686468b19eb44c1ba61bec2e6d28ae59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:18Z,use_quota=True,user_id='891e45b45e3849aaa87831cf65c39f1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-454b51ba-60fb-414b-9f9e-e509e4a8da64 tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (372f05a0-fbf6-4141-bcda-fe9e7125c1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-454b51ba-60fb-414b-9f9e-e509e4a8da64 tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (372f05a0-fbf6-4141-bcda-fe9e7125c1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-454b51ba-60fb-414b-9f9e-e509e4a8da64 tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60689ab9-9d4e-4295-b85b-2f17c2afc665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-454b51ba-60fb-414b-9f9e-e509e4a8da64 tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60689ab9-9d4e-4295-b85b-2f17c2afc665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b419fb3a-852b-4124-aaab-a80fc0f1fe37', 'volume_name': 'volume-b419fb3a-852b-4124-aaab-a80fc0f1fe37', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-454b51ba-60fb-414b-9f9e-e509e4a8da64 tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18dac6ad-b5dd-4b7c-93c5-1bb639eecfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-454b51ba-60fb-414b-9f9e-e509e4a8da64 tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18dac6ad-b5dd-4b7c-93c5-1bb639eecfb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-454b51ba-60fb-414b-9f9e-e509e4a8da64 tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (605b49a6-f1ee-4d02-95ac-ef3e394c21ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:17 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-454b51ba-60fb-414b-9f9e-e509e4a8da64 tempest-CreateVolumesFromImageTest-837240110 None] Volume b419fb3a-852b-4124-aaab-a80fc0f1fe37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b419fb3a-852b-4124-aaab-a80fc0f1fe37', 'volume_size': 1} Nov 02 12:39:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-454b51ba-60fb-414b-9f9e-e509e4a8da64 tempest-CreateVolumesFromImageTest-837240110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-03e86299-199b-4260-9437-8a437829890c tempest-CreateVolumesFromImageTest-837240110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-03e86299-199b-4260-9437-8a437829890c tempest-CreateVolumesFromImageTest-837240110 None] Flow 'volume_create_manager' (d99771b0-37bf-4061-a204-d7b34d4c9f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:18 devstack sudo[103354]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-03e86299-199b-4260-9437-8a437829890c tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e0beca-89a6-4299-a89b-b86e95ee24a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0e55f881-bfd2-4f14-88dd-d49ebf392887 tempest-CreateVolumesFromImageTest-837240110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-060b7b57-e244-437b-9347-bc3860038dfe 1073741824" returned: 0 in 0.530s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-03e86299-199b-4260-9437-8a437829890c tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e0beca-89a6-4299-a89b-b86e95ee24a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1386461041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b41b3e1-7a30-4f7d-bc27-2d11e96ca873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='686468b19eb44c1ba61bec2e6d28ae59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:18Z,use_quota=True,user_id='891e45b45e3849aaa87831cf65c39f1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-03e86299-199b-4260-9437-8a437829890c tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca24b67b-6f85-4bba-99d5-a9d7e5f3df14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-03e86299-199b-4260-9437-8a437829890c tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca24b67b-6f85-4bba-99d5-a9d7e5f3df14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-03e86299-199b-4260-9437-8a437829890c tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (982463d5-8db4-4037-a161-3f54da281cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-03e86299-199b-4260-9437-8a437829890c tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (982463d5-8db4-4037-a161-3f54da281cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b41b3e1-7a30-4f7d-bc27-2d11e96ca873', 'volume_name': 'volume-7b41b3e1-7a30-4f7d-bc27-2d11e96ca873', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-03e86299-199b-4260-9437-8a437829890c tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0090bb8e-af82-4379-bf0d-44ae60b13b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-03e86299-199b-4260-9437-8a437829890c tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0090bb8e-af82-4379-bf0d-44ae60b13b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-03e86299-199b-4260-9437-8a437829890c tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef14ccb-412a-4cd8-b50d-a62f343ee611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:18 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-03e86299-199b-4260-9437-8a437829890c tempest-CreateVolumesFromImageTest-837240110 None] Volume 7b41b3e1-7a30-4f7d-bc27-2d11e96ca873: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b41b3e1-7a30-4f7d-bc27-2d11e96ca873', 'volume_size': 1} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-03e86299-199b-4260-9437-8a437829890c tempest-CreateVolumesFromImageTest-837240110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0e55f881-bfd2-4f14-88dd-d49ebf392887 tempest-CreateVolumesFromImageTest-837240110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-060b7b57-e244-437b-9347-bc3860038dfe {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:18 devstack sudo[103360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-060b7b57-e244-437b-9347-bc3860038dfe Nov 02 12:39:18 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:18 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0e55f881-bfd2-4f14-88dd-d49ebf392887 tempest-CreateVolumesFromImageTest-837240110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-060b7b57-e244-437b-9347-bc3860038dfe" returned: 0 in 0.266s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0e55f881-bfd2-4f14-88dd-d49ebf392887 tempest-CreateVolumesFromImageTest-837240110 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0e55f881-bfd2-4f14-88dd-d49ebf392887 tempest-CreateVolumesFromImageTest-837240110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-454b51ba-60fb-414b-9f9e-e509e4a8da64 tempest-CreateVolumesFromImageTest-837240110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.691s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-454b51ba-60fb-414b-9f9e-e509e4a8da64 tempest-CreateVolumesFromImageTest-837240110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1582434083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b419fb3a-852b-4124-aaab-a80fc0f1fe37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='686468b19eb44c1ba61bec2e6d28ae59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:18Z,use_quota=True,user_id='891e45b45e3849aaa87831cf65c39f1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-454b51ba-60fb-414b-9f9e-e509e4a8da64 tempest-CreateVolumesFromImageTest-837240110 None] Creating volume b419fb3a-852b-4124-aaab-a80fc0f1fe37 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-454b51ba-60fb-414b-9f9e-e509e4a8da64 tempest-CreateVolumesFromImageTest-837240110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-454b51ba-60fb-414b-9f9e-e509e4a8da64 tempest-CreateVolumesFromImageTest-837240110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-454b51ba-60fb-414b-9f9e-e509e4a8da64 tempest-CreateVolumesFromImageTest-837240110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-454b51ba-60fb-414b-9f9e-e509e4a8da64 tempest-CreateVolumesFromImageTest-837240110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-454b51ba-60fb-414b-9f9e-e509e4a8da64 tempest-CreateVolumesFromImageTest-837240110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-454b51ba-60fb-414b-9f9e-e509e4a8da64 tempest-CreateVolumesFromImageTest-837240110 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:39:18 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-454b51ba-60fb-414b-9f9e-e509e4a8da64 tempest-CreateVolumesFromImageTest-837240110 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-454b51ba-60fb-414b-9f9e-e509e4a8da64 tempest-CreateVolumesFromImageTest-837240110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-b419fb3a-852b-4124-aaab-a80fc0f1fe37 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdf77953-3296-44af-8525-6cc1fd32f817 tempest-CreateVolumesFromImageTest-837240110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:39:18 devstack sudo[103363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-b419fb3a-852b-4124-aaab-a80fc0f1fe37 1073741824 Nov 02 12:39:18 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fdf77953-3296-44af-8525-6cc1fd32f817 tempest-CreateVolumesFromImageTest-837240110 None] Flow 'volume_create_manager' (8a960619-62c2-41d0-9697-fe3431b48d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fdf77953-3296-44af-8525-6cc1fd32f817 tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d9e860b-e3aa-4e9b-adf8-fbac1a6e9d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0e55f881-bfd2-4f14-88dd-d49ebf392887 tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed6b5230-81b7-4891-a451-9fa0632768de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-060b7b57-e244-437b-9347-bc3860038dfe', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0e55f881-bfd2-4f14-88dd-d49ebf392887 tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c0109d-054a-40b1-82c5-466dc4e3588d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fdf77953-3296-44af-8525-6cc1fd32f817 tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d9e860b-e3aa-4e9b-adf8-fbac1a6e9d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1270733287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df06173d-3467-4330-8652-6629ad214a57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='686468b19eb44c1ba61bec2e6d28ae59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:18Z,use_quota=True,user_id='891e45b45e3849aaa87831cf65c39f1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fdf77953-3296-44af-8525-6cc1fd32f817 tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7658af6-04c3-483b-8abf-b34383f13f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fdf77953-3296-44af-8525-6cc1fd32f817 tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7658af6-04c3-483b-8abf-b34383f13f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fdf77953-3296-44af-8525-6cc1fd32f817 tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e8f2c46-f9e1-48ff-9aaa-6b0718ae608a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fdf77953-3296-44af-8525-6cc1fd32f817 tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e8f2c46-f9e1-48ff-9aaa-6b0718ae608a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df06173d-3467-4330-8652-6629ad214a57', 'volume_name': 'volume-df06173d-3467-4330-8652-6629ad214a57', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fdf77953-3296-44af-8525-6cc1fd32f817 tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (831add3d-335c-450e-8399-faabf2739045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fdf77953-3296-44af-8525-6cc1fd32f817 tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (831add3d-335c-450e-8399-faabf2739045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fdf77953-3296-44af-8525-6cc1fd32f817 tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6cb547-4692-4204-947e-753fb62784e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:18 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-fdf77953-3296-44af-8525-6cc1fd32f817 tempest-CreateVolumesFromImageTest-837240110 None] Volume df06173d-3467-4330-8652-6629ad214a57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df06173d-3467-4330-8652-6629ad214a57', 'volume_size': 1} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fdf77953-3296-44af-8525-6cc1fd32f817 tempest-CreateVolumesFromImageTest-837240110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:18 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-0e55f881-bfd2-4f14-88dd-d49ebf392887 tempest-CreateVolumesFromImageTest-837240110 None] Volume volume-060b7b57-e244-437b-9347-bc3860038dfe (060b7b57-e244-437b-9347-bc3860038dfe): created successfully Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0e55f881-bfd2-4f14-88dd-d49ebf392887 tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c0109d-054a-40b1-82c5-466dc4e3588d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0e55f881-bfd2-4f14-88dd-d49ebf392887 tempest-CreateVolumesFromImageTest-837240110 None] Flow 'volume_create_manager' (14941ea1-84ad-421c-b61f-ca6f087a7df6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:18 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-0e55f881-bfd2-4f14-88dd-d49ebf392887 tempest-CreateVolumesFromImageTest-837240110 None] Created volume successfully. Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-de736d3d-5009-4055-9112-f78b202b1a1e tempest-CreateVolumesFromImageTest-837240110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-de736d3d-5009-4055-9112-f78b202b1a1e tempest-CreateVolumesFromImageTest-837240110 None] Flow 'volume_create_manager' (fab93975-f7c9-4555-ae86-df93c8d3a9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-de736d3d-5009-4055-9112-f78b202b1a1e tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6ef1877-3163-4ced-80c0-410864b068e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-de736d3d-5009-4055-9112-f78b202b1a1e tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6ef1877-3163-4ced-80c0-410864b068e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-827166635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d369173-e338-48f4-a654-021b9b564f9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='686468b19eb44c1ba61bec2e6d28ae59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:19Z,use_quota=True,user_id='891e45b45e3849aaa87831cf65c39f1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:19 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-de736d3d-5009-4055-9112-f78b202b1a1e tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df2de08-4131-4e0f-b65e-2be46f0cde26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:19 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-de736d3d-5009-4055-9112-f78b202b1a1e tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df2de08-4131-4e0f-b65e-2be46f0cde26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:19 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-de736d3d-5009-4055-9112-f78b202b1a1e tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af85e2a0-7de8-443d-9bfc-1bc66ccb516c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:19 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-de736d3d-5009-4055-9112-f78b202b1a1e tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af85e2a0-7de8-443d-9bfc-1bc66ccb516c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d369173-e338-48f4-a654-021b9b564f9e', 'volume_name': 'volume-5d369173-e338-48f4-a654-021b9b564f9e', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:19 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-de736d3d-5009-4055-9112-f78b202b1a1e tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47d00952-33e1-4dfe-b3ba-a834381211d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:19 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-de736d3d-5009-4055-9112-f78b202b1a1e tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47d00952-33e1-4dfe-b3ba-a834381211d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:19 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-de736d3d-5009-4055-9112-f78b202b1a1e tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b4c33b5-3d9a-48ab-800e-525b4877f26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:19 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-de736d3d-5009-4055-9112-f78b202b1a1e tempest-CreateVolumesFromImageTest-837240110 None] Volume 5d369173-e338-48f4-a654-021b9b564f9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d369173-e338-48f4-a654-021b9b564f9e', 'volume_size': 1} Nov 02 12:39:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-de736d3d-5009-4055-9112-f78b202b1a1e tempest-CreateVolumesFromImageTest-837240110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:19 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-454b51ba-60fb-414b-9f9e-e509e4a8da64 tempest-CreateVolumesFromImageTest-837240110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-b419fb3a-852b-4124-aaab-a80fc0f1fe37 1073741824" returned: 0 in 0.576s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-454b51ba-60fb-414b-9f9e-e509e4a8da64 tempest-CreateVolumesFromImageTest-837240110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-b419fb3a-852b-4124-aaab-a80fc0f1fe37 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:19 devstack sudo[103369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-b419fb3a-852b-4124-aaab-a80fc0f1fe37 Nov 02 12:39:19 devstack sudo[103369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7f2d5eba-2ff2-4129-b19a-f3d5f8c9b765 tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:19 devstack sudo[103369]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-454b51ba-60fb-414b-9f9e-e509e4a8da64 tempest-CreateVolumesFromImageTest-837240110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-b419fb3a-852b-4124-aaab-a80fc0f1fe37" returned: 0 in 0.268s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:19 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-454b51ba-60fb-414b-9f9e-e509e4a8da64 tempest-CreateVolumesFromImageTest-837240110 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:39:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-454b51ba-60fb-414b-9f9e-e509e4a8da64 tempest-CreateVolumesFromImageTest-837240110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-03e86299-199b-4260-9437-8a437829890c tempest-CreateVolumesFromImageTest-837240110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.203s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:19 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-03e86299-199b-4260-9437-8a437829890c tempest-CreateVolumesFromImageTest-837240110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1386461041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b41b3e1-7a30-4f7d-bc27-2d11e96ca873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='686468b19eb44c1ba61bec2e6d28ae59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:18Z,use_quota=True,user_id='891e45b45e3849aaa87831cf65c39f1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:39:19 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-03e86299-199b-4260-9437-8a437829890c tempest-CreateVolumesFromImageTest-837240110 None] Creating volume 7b41b3e1-7a30-4f7d-bc27-2d11e96ca873 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:39:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-03e86299-199b-4260-9437-8a437829890c tempest-CreateVolumesFromImageTest-837240110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-03e86299-199b-4260-9437-8a437829890c tempest-CreateVolumesFromImageTest-837240110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:19 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-03e86299-199b-4260-9437-8a437829890c tempest-CreateVolumesFromImageTest-837240110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:19 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-03e86299-199b-4260-9437-8a437829890c tempest-CreateVolumesFromImageTest-837240110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-03e86299-199b-4260-9437-8a437829890c tempest-CreateVolumesFromImageTest-837240110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:19 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-03e86299-199b-4260-9437-8a437829890c tempest-CreateVolumesFromImageTest-837240110 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:39:19 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-03e86299-199b-4260-9437-8a437829890c tempest-CreateVolumesFromImageTest-837240110 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:39:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-03e86299-199b-4260-9437-8a437829890c tempest-CreateVolumesFromImageTest-837240110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7b41b3e1-7a30-4f7d-bc27-2d11e96ca873 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:19 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-454b51ba-60fb-414b-9f9e-e509e4a8da64 tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (605b49a6-f1ee-4d02-95ac-ef3e394c21ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b419fb3a-852b-4124-aaab-a80fc0f1fe37', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:19 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-454b51ba-60fb-414b-9f9e-e509e4a8da64 tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b10b90f3-7141-4cf1-8690-af80b5bc6277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:19 devstack sudo[103372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7b41b3e1-7a30-4f7d-bc27-2d11e96ca873 1073741824 Nov 02 12:39:19 devstack sudo[103372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:19 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-454b51ba-60fb-414b-9f9e-e509e4a8da64 tempest-CreateVolumesFromImageTest-837240110 None] Volume volume-b419fb3a-852b-4124-aaab-a80fc0f1fe37 (b419fb3a-852b-4124-aaab-a80fc0f1fe37): created successfully Nov 02 12:39:19 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-454b51ba-60fb-414b-9f9e-e509e4a8da64 tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b10b90f3-7141-4cf1-8690-af80b5bc6277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:19 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-454b51ba-60fb-414b-9f9e-e509e4a8da64 tempest-CreateVolumesFromImageTest-837240110 None] Flow 'volume_create_manager' (dd6b644d-6af1-4ce0-9f5a-6a67b11e2593) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:19 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-454b51ba-60fb-414b-9f9e-e509e4a8da64 tempest-CreateVolumesFromImageTest-837240110 None] Created volume successfully. Nov 02 12:39:19 devstack sudo[103372]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-03e86299-199b-4260-9437-8a437829890c tempest-CreateVolumesFromImageTest-837240110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7b41b3e1-7a30-4f7d-bc27-2d11e96ca873 1073741824" returned: 0 in 0.425s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-03e86299-199b-4260-9437-8a437829890c tempest-CreateVolumesFromImageTest-837240110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7b41b3e1-7a30-4f7d-bc27-2d11e96ca873 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:19 devstack sudo[103378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7b41b3e1-7a30-4f7d-bc27-2d11e96ca873 Nov 02 12:39:19 devstack sudo[103378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:20 devstack sudo[103378]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-03e86299-199b-4260-9437-8a437829890c tempest-CreateVolumesFromImageTest-837240110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7b41b3e1-7a30-4f7d-bc27-2d11e96ca873" returned: 0 in 0.238s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-03e86299-199b-4260-9437-8a437829890c tempest-CreateVolumesFromImageTest-837240110 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:39:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-03e86299-199b-4260-9437-8a437829890c tempest-CreateVolumesFromImageTest-837240110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fdf77953-3296-44af-8525-6cc1fd32f817 tempest-CreateVolumesFromImageTest-837240110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.461s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-fdf77953-3296-44af-8525-6cc1fd32f817 tempest-CreateVolumesFromImageTest-837240110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1270733287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df06173d-3467-4330-8652-6629ad214a57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='686468b19eb44c1ba61bec2e6d28ae59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:18Z,use_quota=True,user_id='891e45b45e3849aaa87831cf65c39f1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:39:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-fdf77953-3296-44af-8525-6cc1fd32f817 tempest-CreateVolumesFromImageTest-837240110 None] Creating volume df06173d-3467-4330-8652-6629ad214a57 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:39:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fdf77953-3296-44af-8525-6cc1fd32f817 tempest-CreateVolumesFromImageTest-837240110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fdf77953-3296-44af-8525-6cc1fd32f817 tempest-CreateVolumesFromImageTest-837240110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-fdf77953-3296-44af-8525-6cc1fd32f817 tempest-CreateVolumesFromImageTest-837240110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-fdf77953-3296-44af-8525-6cc1fd32f817 tempest-CreateVolumesFromImageTest-837240110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fdf77953-3296-44af-8525-6cc1fd32f817 tempest-CreateVolumesFromImageTest-837240110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-fdf77953-3296-44af-8525-6cc1fd32f817 tempest-CreateVolumesFromImageTest-837240110 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:39:20 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-fdf77953-3296-44af-8525-6cc1fd32f817 tempest-CreateVolumesFromImageTest-837240110 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:39:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fdf77953-3296-44af-8525-6cc1fd32f817 tempest-CreateVolumesFromImageTest-837240110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-df06173d-3467-4330-8652-6629ad214a57 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-03e86299-199b-4260-9437-8a437829890c tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef14ccb-412a-4cd8-b50d-a62f343ee611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b41b3e1-7a30-4f7d-bc27-2d11e96ca873', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:20 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-df06173d-3467-4330-8652-6629ad214a57 1073741824 Nov 02 12:39:20 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-03e86299-199b-4260-9437-8a437829890c tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a567030-ad98-4e3b-9666-3681eff16360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:20 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-03e86299-199b-4260-9437-8a437829890c tempest-CreateVolumesFromImageTest-837240110 None] Volume volume-7b41b3e1-7a30-4f7d-bc27-2d11e96ca873 (7b41b3e1-7a30-4f7d-bc27-2d11e96ca873): created successfully Nov 02 12:39:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-03e86299-199b-4260-9437-8a437829890c tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a567030-ad98-4e3b-9666-3681eff16360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-03e86299-199b-4260-9437-8a437829890c tempest-CreateVolumesFromImageTest-837240110 None] Flow 'volume_create_manager' (d99771b0-37bf-4061-a204-d7b34d4c9f38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:20 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-03e86299-199b-4260-9437-8a437829890c tempest-CreateVolumesFromImageTest-837240110 None] Created volume successfully. Nov 02 12:39:20 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fdf77953-3296-44af-8525-6cc1fd32f817 tempest-CreateVolumesFromImageTest-837240110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-df06173d-3467-4330-8652-6629ad214a57 1073741824" returned: 0 in 0.433s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fdf77953-3296-44af-8525-6cc1fd32f817 tempest-CreateVolumesFromImageTest-837240110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-df06173d-3467-4330-8652-6629ad214a57 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:20 devstack sudo[103387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-df06173d-3467-4330-8652-6629ad214a57 Nov 02 12:39:20 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:20 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fdf77953-3296-44af-8525-6cc1fd32f817 tempest-CreateVolumesFromImageTest-837240110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-df06173d-3467-4330-8652-6629ad214a57" returned: 0 in 0.258s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-fdf77953-3296-44af-8525-6cc1fd32f817 tempest-CreateVolumesFromImageTest-837240110 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:39:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fdf77953-3296-44af-8525-6cc1fd32f817 tempest-CreateVolumesFromImageTest-837240110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-de736d3d-5009-4055-9112-f78b202b1a1e tempest-CreateVolumesFromImageTest-837240110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.812s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-de736d3d-5009-4055-9112-f78b202b1a1e tempest-CreateVolumesFromImageTest-837240110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-827166635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d369173-e338-48f4-a654-021b9b564f9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='686468b19eb44c1ba61bec2e6d28ae59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:19Z,use_quota=True,user_id='891e45b45e3849aaa87831cf65c39f1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:39:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-de736d3d-5009-4055-9112-f78b202b1a1e tempest-CreateVolumesFromImageTest-837240110 None] Creating volume 5d369173-e338-48f4-a654-021b9b564f9e {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:39:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-de736d3d-5009-4055-9112-f78b202b1a1e tempest-CreateVolumesFromImageTest-837240110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-de736d3d-5009-4055-9112-f78b202b1a1e tempest-CreateVolumesFromImageTest-837240110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-de736d3d-5009-4055-9112-f78b202b1a1e tempest-CreateVolumesFromImageTest-837240110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-de736d3d-5009-4055-9112-f78b202b1a1e tempest-CreateVolumesFromImageTest-837240110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-de736d3d-5009-4055-9112-f78b202b1a1e tempest-CreateVolumesFromImageTest-837240110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-de736d3d-5009-4055-9112-f78b202b1a1e tempest-CreateVolumesFromImageTest-837240110 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:39:20 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-de736d3d-5009-4055-9112-f78b202b1a1e tempest-CreateVolumesFromImageTest-837240110 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:39:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-de736d3d-5009-4055-9112-f78b202b1a1e tempest-CreateVolumesFromImageTest-837240110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5d369173-e338-48f4-a654-021b9b564f9e 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fdf77953-3296-44af-8525-6cc1fd32f817 tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6cb547-4692-4204-947e-753fb62784e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df06173d-3467-4330-8652-6629ad214a57', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fdf77953-3296-44af-8525-6cc1fd32f817 tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae7c06b1-c225-4a2e-a9a2-bf9825e7c9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:20 devstack sudo[103390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5d369173-e338-48f4-a654-021b9b564f9e 1073741824 Nov 02 12:39:20 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:20 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-fdf77953-3296-44af-8525-6cc1fd32f817 tempest-CreateVolumesFromImageTest-837240110 None] Volume volume-df06173d-3467-4330-8652-6629ad214a57 (df06173d-3467-4330-8652-6629ad214a57): created successfully Nov 02 12:39:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fdf77953-3296-44af-8525-6cc1fd32f817 tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae7c06b1-c225-4a2e-a9a2-bf9825e7c9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fdf77953-3296-44af-8525-6cc1fd32f817 tempest-CreateVolumesFromImageTest-837240110 None] Flow 'volume_create_manager' (8a960619-62c2-41d0-9697-fe3431b48d59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:20 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-fdf77953-3296-44af-8525-6cc1fd32f817 tempest-CreateVolumesFromImageTest-837240110 None] Created volume successfully. Nov 02 12:39:21 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-de736d3d-5009-4055-9112-f78b202b1a1e tempest-CreateVolumesFromImageTest-837240110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5d369173-e338-48f4-a654-021b9b564f9e 1073741824" returned: 0 in 0.468s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-de736d3d-5009-4055-9112-f78b202b1a1e tempest-CreateVolumesFromImageTest-837240110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5d369173-e338-48f4-a654-021b9b564f9e {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:21 devstack sudo[103396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5d369173-e338-48f4-a654-021b9b564f9e Nov 02 12:39:21 devstack sudo[103396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:21 devstack sudo[103396]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-de736d3d-5009-4055-9112-f78b202b1a1e tempest-CreateVolumesFromImageTest-837240110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5d369173-e338-48f4-a654-021b9b564f9e" returned: 0 in 0.260s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:21 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-de736d3d-5009-4055-9112-f78b202b1a1e tempest-CreateVolumesFromImageTest-837240110 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:39:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-de736d3d-5009-4055-9112-f78b202b1a1e tempest-CreateVolumesFromImageTest-837240110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7f2d5eba-2ff2-4129-b19a-f3d5f8c9b765 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.333s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:21 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-7f2d5eba-2ff2-4129-b19a-f3d5f8c9b765 tempest-VolumesSnapshotTestJSON-130675119 None] Creating offline snapshot 64ac2612-5a27-4f9a-a396-3e44698d4cdc of volume 309ed49d-bba9-4265-b601-48fce1e56e1a {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:39:21 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f73e5ad-30c2-43be-85db-b4c85bac2cbf]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7f2d5eba-2ff2-4129-b19a-f3d5f8c9b765 tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-de736d3d-5009-4055-9112-f78b202b1a1e tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b4c33b5-3d9a-48ab-800e-525b4877f26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d369173-e338-48f4-a654-021b9b564f9e', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-de736d3d-5009-4055-9112-f78b202b1a1e tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff174e3-c0da-4777-acbc-2fab3d496757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:21 devstack sudo[103400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a Nov 02 12:39:21 devstack sudo[103400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:21 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-de736d3d-5009-4055-9112-f78b202b1a1e tempest-CreateVolumesFromImageTest-837240110 None] Volume volume-5d369173-e338-48f4-a654-021b9b564f9e (5d369173-e338-48f4-a654-021b9b564f9e): created successfully Nov 02 12:39:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-de736d3d-5009-4055-9112-f78b202b1a1e tempest-CreateVolumesFromImageTest-837240110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff174e3-c0da-4777-acbc-2fab3d496757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-de736d3d-5009-4055-9112-f78b202b1a1e tempest-CreateVolumesFromImageTest-837240110 None] Flow 'volume_create_manager' (fab93975-f7c9-4555-ae86-df93c8d3a9d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:21 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-de736d3d-5009-4055-9112-f78b202b1a1e tempest-CreateVolumesFromImageTest-837240110 None] Created volume successfully. Nov 02 12:39:22 devstack sudo[103400]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7f2d5eba-2ff2-4129-b19a-f3d5f8c9b765 tempest-VolumesSnapshotTestJSON-130675119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a" returned: 0 in 0.378s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7f2d5eba-2ff2-4129-b19a-f3d5f8c9b765 tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a.64ac2612-5a27-4f9a-a396-3e44698d4cdc 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:22 devstack sudo[103405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a.64ac2612-5a27-4f9a-a396-3e44698d4cdc 1G Nov 02 12:39:22 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:22 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-35928089-3dd7-48ff-ac6b-adb660f5d8b8 tempest-CreateVolumesFromImageTest-837240110 None] Acquiring lock "cinder-5d369173-e338-48f4-a654-021b9b564f9e-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:22 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-35928089-3dd7-48ff-ac6b-adb660f5d8b8 tempest-CreateVolumesFromImageTest-837240110 None] Lock "cinder-5d369173-e338-48f4-a654-021b9b564f9e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:22 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-35928089-3dd7-48ff-ac6b-adb660f5d8b8 tempest-CreateVolumesFromImageTest-837240110 None] Acquiring lock "cinder-quobyte-5d369173-e338-48f4-a654-021b9b564f9e" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:22 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-35928089-3dd7-48ff-ac6b-adb660f5d8b8 tempest-CreateVolumesFromImageTest-837240110 None] Lock "cinder-quobyte-5d369173-e338-48f4-a654-021b9b564f9e" acquired by "delete_volume" :: waited 0.013s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:22 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c53ce1-a972-4ecc-86be-f71b04c0e74f]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-35928089-3dd7-48ff-ac6b-adb660f5d8b8 tempest-CreateVolumesFromImageTest-837240110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5d369173-e338-48f4-a654-021b9b564f9e {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:22 devstack sudo[103410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5d369173-e338-48f4-a654-021b9b564f9e Nov 02 12:39:22 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:22 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7f2d5eba-2ff2-4129-b19a-f3d5f8c9b765 tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a.64ac2612-5a27-4f9a-a396-3e44698d4cdc 1G" returned: 0 in 0.449s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7f2d5eba-2ff2-4129-b19a-f3d5f8c9b765 tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-309ed49d-bba9-4265-b601-48fce1e56e1a -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a.64ac2612-5a27-4f9a-a396-3e44698d4cdc {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:22 devstack sudo[103412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-309ed49d-bba9-4265-b601-48fce1e56e1a -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a.64ac2612-5a27-4f9a-a396-3e44698d4cdc Nov 02 12:39:22 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:22 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:22 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7f2d5eba-2ff2-4129-b19a-f3d5f8c9b765 tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-309ed49d-bba9-4265-b601-48fce1e56e1a -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a.64ac2612-5a27-4f9a-a396-3e44698d4cdc" returned: 0 in 0.277s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:22 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-7f2d5eba-2ff2-4129-b19a-f3d5f8c9b765 tempest-VolumesSnapshotTestJSON-130675119 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a.64ac2612-5a27-4f9a-a396-3e44698d4cdc is being set with open permissions: ugo+rw Nov 02 12:39:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7f2d5eba-2ff2-4129-b19a-f3d5f8c9b765 tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a.64ac2612-5a27-4f9a-a396-3e44698d4cdc {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-35928089-3dd7-48ff-ac6b-adb660f5d8b8 tempest-CreateVolumesFromImageTest-837240110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5d369173-e338-48f4-a654-021b9b564f9e" returned: 0 in 0.408s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-35928089-3dd7-48ff-ac6b-adb660f5d8b8 tempest-CreateVolumesFromImageTest-837240110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5d369173-e338-48f4-a654-021b9b564f9e {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:22 devstack sudo[103421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a.64ac2612-5a27-4f9a-a396-3e44698d4cdc Nov 02 12:39:22 devstack sudo[103421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:22 devstack sudo[103422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5d369173-e338-48f4-a654-021b9b564f9e Nov 02 12:39:22 devstack sudo[103422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:23 devstack sudo[103422]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-35928089-3dd7-48ff-ac6b-adb660f5d8b8 tempest-CreateVolumesFromImageTest-837240110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5d369173-e338-48f4-a654-021b9b564f9e" returned: 0 in 0.242s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:23 devstack sudo[103421]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7f2d5eba-2ff2-4129-b19a-f3d5f8c9b765 tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a.64ac2612-5a27-4f9a-a396-3e44698d4cdc" returned: 0 in 0.266s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:23 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-35928089-3dd7-48ff-ac6b-adb660f5d8b8 tempest-CreateVolumesFromImageTest-837240110 None] Lock "cinder-quobyte-5d369173-e338-48f4-a654-021b9b564f9e" released by "delete_volume" :: held 0.704s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7f2d5eba-2ff2-4129-b19a-f3d5f8c9b765 tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:23 devstack sudo[103427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a.info Nov 02 12:39:23 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:23 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-35928089-3dd7-48ff-ac6b-adb660f5d8b8 tempest-CreateVolumesFromImageTest-837240110 None] Created reservations ['717022bd-13e3-488d-88f8-4e9afdb8431c', '609d9656-85e0-45d6-9fa0-8b8371f5df41', 'a84fcd1b-089d-4df6-9a03-302c78137373', 'a225b0c6-c5b9-4e98-959a-a350fb35293b'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:39:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-35928089-3dd7-48ff-ac6b-adb660f5d8b8 tempest-CreateVolumesFromImageTest-837240110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-35928089-3dd7-48ff-ac6b-adb660f5d8b8 tempest-CreateVolumesFromImageTest-837240110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:23 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-35928089-3dd7-48ff-ac6b-adb660f5d8b8 tempest-CreateVolumesFromImageTest-837240110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:23 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-35928089-3dd7-48ff-ac6b-adb660f5d8b8 tempest-CreateVolumesFromImageTest-837240110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-35928089-3dd7-48ff-ac6b-adb660f5d8b8 tempest-CreateVolumesFromImageTest-837240110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-35928089-3dd7-48ff-ac6b-adb660f5d8b8 tempest-CreateVolumesFromImageTest-837240110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:23 devstack sudo[103429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:39:23 devstack sudo[103429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:23 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7f2d5eba-2ff2-4129-b19a-f3d5f8c9b765 tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a.info" returned: 0 in 0.257s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:23 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-7f2d5eba-2ff2-4129-b19a-f3d5f8c9b765 tempest-VolumesSnapshotTestJSON-130675119 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a.info is being set with open permissions: ugo+rw Nov 02 12:39:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7f2d5eba-2ff2-4129-b19a-f3d5f8c9b765 tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:23 devstack sudo[103432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a.info Nov 02 12:39:23 devstack sudo[103432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:23 devstack sudo[103429]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-35928089-3dd7-48ff-ac6b-adb660f5d8b8 tempest-CreateVolumesFromImageTest-837240110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.270s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:23 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-35928089-3dd7-48ff-ac6b-adb660f5d8b8 tempest-CreateVolumesFromImageTest-837240110 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:39:23 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-35928089-3dd7-48ff-ac6b-adb660f5d8b8 tempest-CreateVolumesFromImageTest-837240110 None] Deleted volume successfully. Nov 02 12:39:23 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-eb955296-bfc5-4965-ac65-8d6190aafa09 tempest-CreateVolumesFromImageTest-837240110 None] Acquiring lock "cinder-df06173d-3467-4330-8652-6629ad214a57-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:23 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-35928089-3dd7-48ff-ac6b-adb660f5d8b8 tempest-CreateVolumesFromImageTest-837240110 None] Lock "cinder-5d369173-e338-48f4-a654-021b9b564f9e-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:23 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-eb955296-bfc5-4965-ac65-8d6190aafa09 tempest-CreateVolumesFromImageTest-837240110 None] Lock "cinder-df06173d-3467-4330-8652-6629ad214a57-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:23 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-eb955296-bfc5-4965-ac65-8d6190aafa09 tempest-CreateVolumesFromImageTest-837240110 None] Acquiring lock "cinder-quobyte-df06173d-3467-4330-8652-6629ad214a57" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:23 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-eb955296-bfc5-4965-ac65-8d6190aafa09 tempest-CreateVolumesFromImageTest-837240110 None] Lock "cinder-quobyte-df06173d-3467-4330-8652-6629ad214a57" acquired by "delete_volume" :: waited 0.021s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:23 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[826a39c2-29f5-40ba-8271-469b1b426473]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eb955296-bfc5-4965-ac65-8d6190aafa09 tempest-CreateVolumesFromImageTest-837240110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-df06173d-3467-4330-8652-6629ad214a57 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:23 devstack sudo[103432]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7f2d5eba-2ff2-4129-b19a-f3d5f8c9b765 tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a.info" returned: 0 in 0.277s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7f2d5eba-2ff2-4129-b19a-f3d5f8c9b765 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.020s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:23 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-7f2d5eba-2ff2-4129-b19a-f3d5f8c9b765 tempest-VolumesSnapshotTestJSON-130675119 None] Create snapshot completed successfully Nov 02 12:39:23 devstack sudo[103436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-df06173d-3467-4330-8652-6629ad214a57 Nov 02 12:39:23 devstack sudo[103436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:23 devstack sudo[103436]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eb955296-bfc5-4965-ac65-8d6190aafa09 tempest-CreateVolumesFromImageTest-837240110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-df06173d-3467-4330-8652-6629ad214a57" returned: 0 in 0.369s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eb955296-bfc5-4965-ac65-8d6190aafa09 tempest-CreateVolumesFromImageTest-837240110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-df06173d-3467-4330-8652-6629ad214a57 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:24 devstack sudo[103441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-df06173d-3467-4330-8652-6629ad214a57 Nov 02 12:39:24 devstack sudo[103441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:24 devstack sudo[103441]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eb955296-bfc5-4965-ac65-8d6190aafa09 tempest-CreateVolumesFromImageTest-837240110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-df06173d-3467-4330-8652-6629ad214a57" returned: 0 in 0.247s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:24 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-eb955296-bfc5-4965-ac65-8d6190aafa09 tempest-CreateVolumesFromImageTest-837240110 None] Lock "cinder-quobyte-df06173d-3467-4330-8652-6629ad214a57" released by "delete_volume" :: held 0.657s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:24 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-eb955296-bfc5-4965-ac65-8d6190aafa09 tempest-CreateVolumesFromImageTest-837240110 None] Created reservations ['bae2ec6d-b189-49ee-b9bc-ff107cb8890f', '8969daca-bf46-48b9-9fe1-2843eaf1f6a3', '6a4897ba-a75c-4ad9-a0d0-8e026fe4d2c2', 'ba38c91b-46f1-43f0-99d2-772c611c93b0'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:39:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-eb955296-bfc5-4965-ac65-8d6190aafa09 tempest-CreateVolumesFromImageTest-837240110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-eb955296-bfc5-4965-ac65-8d6190aafa09 tempest-CreateVolumesFromImageTest-837240110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:24 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-eb955296-bfc5-4965-ac65-8d6190aafa09 tempest-CreateVolumesFromImageTest-837240110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:24 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-eb955296-bfc5-4965-ac65-8d6190aafa09 tempest-CreateVolumesFromImageTest-837240110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-eb955296-bfc5-4965-ac65-8d6190aafa09 tempest-CreateVolumesFromImageTest-837240110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eb955296-bfc5-4965-ac65-8d6190aafa09 tempest-CreateVolumesFromImageTest-837240110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:24 devstack sudo[103444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:39:24 devstack sudo[103444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:24 devstack sudo[103444]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eb955296-bfc5-4965-ac65-8d6190aafa09 tempest-CreateVolumesFromImageTest-837240110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.278s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:24 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-eb955296-bfc5-4965-ac65-8d6190aafa09 tempest-CreateVolumesFromImageTest-837240110 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:39:24 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-eb955296-bfc5-4965-ac65-8d6190aafa09 tempest-CreateVolumesFromImageTest-837240110 None] Deleted volume successfully. Nov 02 12:39:24 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-eb955296-bfc5-4965-ac65-8d6190aafa09 tempest-CreateVolumesFromImageTest-837240110 None] Lock "cinder-df06173d-3467-4330-8652-6629ad214a57-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:24 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-237b77a1-4a9d-4c8e-aa2e-4ed9e83f141a tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "cinder-64ac2612-5a27-4f9a-a396-3e44698d4cdc-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:24 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7cde3486-1614-4f68-bb12-ab75c2e4ac27 tempest-CreateVolumesFromImageTest-837240110 None] Acquiring lock "cinder-7b41b3e1-7a30-4f7d-bc27-2d11e96ca873-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:24 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-237b77a1-4a9d-4c8e-aa2e-4ed9e83f141a tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-64ac2612-5a27-4f9a-a396-3e44698d4cdc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:24 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7cde3486-1614-4f68-bb12-ab75c2e4ac27 tempest-CreateVolumesFromImageTest-837240110 None] Lock "cinder-7b41b3e1-7a30-4f7d-bc27-2d11e96ca873-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:24 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7cde3486-1614-4f68-bb12-ab75c2e4ac27 tempest-CreateVolumesFromImageTest-837240110 None] Acquiring lock "cinder-quobyte-7b41b3e1-7a30-4f7d-bc27-2d11e96ca873" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:24 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-237b77a1-4a9d-4c8e-aa2e-4ed9e83f141a tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "cinder-quobyte-309ed49d-bba9-4265-b601-48fce1e56e1a" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:24 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7cde3486-1614-4f68-bb12-ab75c2e4ac27 tempest-CreateVolumesFromImageTest-837240110 None] Lock "cinder-quobyte-7b41b3e1-7a30-4f7d-bc27-2d11e96ca873" acquired by "delete_volume" :: waited 0.020s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:24 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-237b77a1-4a9d-4c8e-aa2e-4ed9e83f141a tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-quobyte-309ed49d-bba9-4265-b601-48fce1e56e1a" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:24 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-237b77a1-4a9d-4c8e-aa2e-4ed9e83f141a tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "cinder-quobyte-64ac2612-5a27-4f9a-a396-3e44698d4cdc" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:24 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fbf73a-2664-405b-96fd-62e97d0199ae]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7cde3486-1614-4f68-bb12-ab75c2e4ac27 tempest-CreateVolumesFromImageTest-837240110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7b41b3e1-7a30-4f7d-bc27-2d11e96ca873 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:24 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-237b77a1-4a9d-4c8e-aa2e-4ed9e83f141a tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-quobyte-64ac2612-5a27-4f9a-a396-3e44698d4cdc" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:24 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-237b77a1-4a9d-4c8e-aa2e-4ed9e83f141a tempest-VolumesSnapshotTestJSON-130675119 None] Deleting offline snapshot 64ac2612-5a27-4f9a-a396-3e44698d4cdc of volume 309ed49d-bba9-4265-b601-48fce1e56e1a {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:39:24 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-237b77a1-4a9d-4c8e-aa2e-4ed9e83f141a tempest-VolumesSnapshotTestJSON-130675119 None] snapshot_file for this snap is: volume-309ed49d-bba9-4265-b601-48fce1e56e1a.64ac2612-5a27-4f9a-a396-3e44698d4cdc {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:39:24 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[27787b1d-db95-4577-a7e4-e879a35da007]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-237b77a1-4a9d-4c8e-aa2e-4ed9e83f141a tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a.64ac2612-5a27-4f9a-a396-3e44698d4cdc {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:24 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7b41b3e1-7a30-4f7d-bc27-2d11e96ca873 Nov 02 12:39:24 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:24 devstack sudo[103448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a.64ac2612-5a27-4f9a-a396-3e44698d4cdc Nov 02 12:39:24 devstack sudo[103448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:25 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7cde3486-1614-4f68-bb12-ab75c2e4ac27 tempest-CreateVolumesFromImageTest-837240110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7b41b3e1-7a30-4f7d-bc27-2d11e96ca873" returned: 0 in 0.365s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7cde3486-1614-4f68-bb12-ab75c2e4ac27 tempest-CreateVolumesFromImageTest-837240110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7b41b3e1-7a30-4f7d-bc27-2d11e96ca873 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:25 devstack sudo[103457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7b41b3e1-7a30-4f7d-bc27-2d11e96ca873 Nov 02 12:39:25 devstack sudo[103457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:25 devstack sudo[103448]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-237b77a1-4a9d-4c8e-aa2e-4ed9e83f141a tempest-VolumesSnapshotTestJSON-130675119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a.64ac2612-5a27-4f9a-a396-3e44698d4cdc" returned: 0 in 0.382s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:25 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-237b77a1-4a9d-4c8e-aa2e-4ed9e83f141a tempest-VolumesSnapshotTestJSON-130675119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-309ed49d-bba9-4265-b601-48fce1e56e1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:39:25 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[192fa64e-eb73-444a-a2d0-e84fa9334d35]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-237b77a1-4a9d-4c8e-aa2e-4ed9e83f141a tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:25 devstack sudo[103459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a Nov 02 12:39:25 devstack sudo[103459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:25 devstack sudo[103457]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7cde3486-1614-4f68-bb12-ab75c2e4ac27 tempest-CreateVolumesFromImageTest-837240110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-7b41b3e1-7a30-4f7d-bc27-2d11e96ca873" returned: 0 in 0.267s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:25 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7cde3486-1614-4f68-bb12-ab75c2e4ac27 tempest-CreateVolumesFromImageTest-837240110 None] Lock "cinder-quobyte-7b41b3e1-7a30-4f7d-bc27-2d11e96ca873" released by "delete_volume" :: held 0.682s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:25 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-7cde3486-1614-4f68-bb12-ab75c2e4ac27 tempest-CreateVolumesFromImageTest-837240110 None] Created reservations ['c7937831-c689-49b2-86b2-224b50119563', 'cccbfb83-fdd8-451f-856a-dc5149b02eea', '2be4c15e-669b-4955-a88d-c55626b6845e', 'dcb5493f-7b51-4877-99ce-2a99dca3f12f'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:39:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7cde3486-1614-4f68-bb12-ab75c2e4ac27 tempest-CreateVolumesFromImageTest-837240110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7cde3486-1614-4f68-bb12-ab75c2e4ac27 tempest-CreateVolumesFromImageTest-837240110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:25 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-7cde3486-1614-4f68-bb12-ab75c2e4ac27 tempest-CreateVolumesFromImageTest-837240110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:25 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-7cde3486-1614-4f68-bb12-ab75c2e4ac27 tempest-CreateVolumesFromImageTest-837240110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7cde3486-1614-4f68-bb12-ab75c2e4ac27 tempest-CreateVolumesFromImageTest-837240110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7cde3486-1614-4f68-bb12-ab75c2e4ac27 tempest-CreateVolumesFromImageTest-837240110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:25 devstack sudo[103464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:39:25 devstack sudo[103464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:25 devstack sudo[103459]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-237b77a1-4a9d-4c8e-aa2e-4ed9e83f141a tempest-VolumesSnapshotTestJSON-130675119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a" returned: 0 in 0.390s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-237b77a1-4a9d-4c8e-aa2e-4ed9e83f141a tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a.64ac2612-5a27-4f9a-a396-3e44698d4cdc {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:25 devstack sudo[103467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a.64ac2612-5a27-4f9a-a396-3e44698d4cdc Nov 02 12:39:25 devstack sudo[103467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:25 devstack sudo[103464]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:25 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b0d6132e-1acc-449c-8026-08af67d262d8 tempest-CreateVolumesFromImageTest-837240110 None] Acquiring lock "cinder-b419fb3a-852b-4124-aaab-a80fc0f1fe37-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7cde3486-1614-4f68-bb12-ab75c2e4ac27 tempest-CreateVolumesFromImageTest-837240110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.269s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:25 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-7cde3486-1614-4f68-bb12-ab75c2e4ac27 tempest-CreateVolumesFromImageTest-837240110 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:39:25 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-7cde3486-1614-4f68-bb12-ab75c2e4ac27 tempest-CreateVolumesFromImageTest-837240110 None] Deleted volume successfully. Nov 02 12:39:25 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b0d6132e-1acc-449c-8026-08af67d262d8 tempest-CreateVolumesFromImageTest-837240110 None] Lock "cinder-b419fb3a-852b-4124-aaab-a80fc0f1fe37-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:25 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7cde3486-1614-4f68-bb12-ab75c2e4ac27 tempest-CreateVolumesFromImageTest-837240110 None] Lock "cinder-7b41b3e1-7a30-4f7d-bc27-2d11e96ca873-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:25 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b0d6132e-1acc-449c-8026-08af67d262d8 tempest-CreateVolumesFromImageTest-837240110 None] Acquiring lock "cinder-quobyte-b419fb3a-852b-4124-aaab-a80fc0f1fe37" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:25 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b0d6132e-1acc-449c-8026-08af67d262d8 tempest-CreateVolumesFromImageTest-837240110 None] Lock "cinder-quobyte-b419fb3a-852b-4124-aaab-a80fc0f1fe37" acquired by "delete_volume" :: waited 0.018s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:25 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7f29d1-4a02-4a4b-882a-762a57917554]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b0d6132e-1acc-449c-8026-08af67d262d8 tempest-CreateVolumesFromImageTest-837240110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-b419fb3a-852b-4124-aaab-a80fc0f1fe37 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:26 devstack sudo[103467]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-237b77a1-4a9d-4c8e-aa2e-4ed9e83f141a tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a.64ac2612-5a27-4f9a-a396-3e44698d4cdc" returned: 0 in 0.420s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-237b77a1-4a9d-4c8e-aa2e-4ed9e83f141a tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a.64ac2612-5a27-4f9a-a396-3e44698d4cdc {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:26 devstack sudo[103475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a.64ac2612-5a27-4f9a-a396-3e44698d4cdc Nov 02 12:39:26 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:26 devstack sudo[103473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-b419fb3a-852b-4124-aaab-a80fc0f1fe37 Nov 02 12:39:26 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:26 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-237b77a1-4a9d-4c8e-aa2e-4ed9e83f141a tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a.64ac2612-5a27-4f9a-a396-3e44698d4cdc" returned: 0 in 0.274s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:26 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:26 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-237b77a1-4a9d-4c8e-aa2e-4ed9e83f141a tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-quobyte-64ac2612-5a27-4f9a-a396-3e44698d4cdc" released by "_delete_snapshot" :: held 1.576s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b0d6132e-1acc-449c-8026-08af67d262d8 tempest-CreateVolumesFromImageTest-837240110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-b419fb3a-852b-4124-aaab-a80fc0f1fe37" returned: 0 in 0.410s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b0d6132e-1acc-449c-8026-08af67d262d8 tempest-CreateVolumesFromImageTest-837240110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-b419fb3a-852b-4124-aaab-a80fc0f1fe37 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:26 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-237b77a1-4a9d-4c8e-aa2e-4ed9e83f141a tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-quobyte-309ed49d-bba9-4265-b601-48fce1e56e1a" released by "delete_snapshot" :: held 1.613s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:26 devstack sudo[103482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-b419fb3a-852b-4124-aaab-a80fc0f1fe37 Nov 02 12:39:26 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:26 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-237b77a1-4a9d-4c8e-aa2e-4ed9e83f141a tempest-VolumesSnapshotTestJSON-130675119 None] Created reservations ['1d37b20f-f5fb-4064-923f-8e8349f8e21a', 'b7e384d5-503e-4329-8f78-109aececf781', 'f010b402-388e-4ae6-a265-a75e811fd96e', '603cdbf8-0ca1-4aa3-8ee2-e41844b74047'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:39:26 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-237b77a1-4a9d-4c8e-aa2e-4ed9e83f141a tempest-VolumesSnapshotTestJSON-130675119 None] Delete snapshot completed successfully. Nov 02 12:39:26 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-237b77a1-4a9d-4c8e-aa2e-4ed9e83f141a tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-64ac2612-5a27-4f9a-a396-3e44698d4cdc-delete_snapshot" released by "delete_snapshot" :: held 1.831s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:26 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b0d6132e-1acc-449c-8026-08af67d262d8 tempest-CreateVolumesFromImageTest-837240110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-b419fb3a-852b-4124-aaab-a80fc0f1fe37" returned: 0 in 0.291s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:26 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b0d6132e-1acc-449c-8026-08af67d262d8 tempest-CreateVolumesFromImageTest-837240110 None] Lock "cinder-quobyte-b419fb3a-852b-4124-aaab-a80fc0f1fe37" released by "delete_volume" :: held 0.740s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:26 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-b0d6132e-1acc-449c-8026-08af67d262d8 tempest-CreateVolumesFromImageTest-837240110 None] Created reservations ['329a604e-265e-48fd-aa5b-48de98af9b02', '23a87f78-21b7-4217-a553-bb6311aef560', '9af100f2-8486-49d3-8083-ddd87918ecf8', 'f5f8567c-e2be-4923-b66c-9b4ef779422f'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:39:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b0d6132e-1acc-449c-8026-08af67d262d8 tempest-CreateVolumesFromImageTest-837240110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b0d6132e-1acc-449c-8026-08af67d262d8 tempest-CreateVolumesFromImageTest-837240110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:26 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b0d6132e-1acc-449c-8026-08af67d262d8 tempest-CreateVolumesFromImageTest-837240110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:26 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b0d6132e-1acc-449c-8026-08af67d262d8 tempest-CreateVolumesFromImageTest-837240110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b0d6132e-1acc-449c-8026-08af67d262d8 tempest-CreateVolumesFromImageTest-837240110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b0d6132e-1acc-449c-8026-08af67d262d8 tempest-CreateVolumesFromImageTest-837240110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:26 devstack sudo[103485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:39:26 devstack sudo[103485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a4d9ff60-5501-4b01-a787-11505f1d5c2f tempest-CreateVolumesFromImageTest-837240110 None] Acquiring lock "cinder-060b7b57-e244-437b-9347-bc3860038dfe-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a4d9ff60-5501-4b01-a787-11505f1d5c2f tempest-CreateVolumesFromImageTest-837240110 None] Lock "cinder-060b7b57-e244-437b-9347-bc3860038dfe-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:27 devstack sudo[103485]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b0d6132e-1acc-449c-8026-08af67d262d8 tempest-CreateVolumesFromImageTest-837240110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.280s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-b0d6132e-1acc-449c-8026-08af67d262d8 tempest-CreateVolumesFromImageTest-837240110 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:39:27 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-b0d6132e-1acc-449c-8026-08af67d262d8 tempest-CreateVolumesFromImageTest-837240110 None] Deleted volume successfully. Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a4d9ff60-5501-4b01-a787-11505f1d5c2f tempest-CreateVolumesFromImageTest-837240110 None] Acquiring lock "cinder-quobyte-060b7b57-e244-437b-9347-bc3860038dfe" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a4d9ff60-5501-4b01-a787-11505f1d5c2f tempest-CreateVolumesFromImageTest-837240110 None] Lock "cinder-quobyte-060b7b57-e244-437b-9347-bc3860038dfe" acquired by "delete_volume" :: waited 0.025s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b0d6132e-1acc-449c-8026-08af67d262d8 tempest-CreateVolumesFromImageTest-837240110 None] Lock "cinder-b419fb3a-852b-4124-aaab-a80fc0f1fe37-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1c23da-2ed5-4c06-a162-31ff21d678e9]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a4d9ff60-5501-4b01-a787-11505f1d5c2f tempest-CreateVolumesFromImageTest-837240110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-060b7b57-e244-437b-9347-bc3860038dfe {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:27 devstack sudo[103488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-060b7b57-e244-437b-9347-bc3860038dfe Nov 02 12:39:27 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7bce580-f2f5-4bc2-8bb3-0b13dbcff387 tempest-VolumesSnapshotTestJSON-130675119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b7bce580-f2f5-4bc2-8bb3-0b13dbcff387 tempest-VolumesSnapshotTestJSON-130675119 None] Flow 'volume_create_manager' (d38df771-1e3b-4880-9074-d60b5409ec83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b7bce580-f2f5-4bc2-8bb3-0b13dbcff387 tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (911261de-a017-466c-a0a4-5362ed650a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b7bce580-f2f5-4bc2-8bb3-0b13dbcff387 tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (911261de-a017-466c-a0a4-5362ed650a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2102425187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c1853d6-9212-4987-9502-3b887d2b9f4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7060abc179094b93999584088c8e776a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:27Z,use_quota=True,user_id='a5e6e4e9ce4b4c9e82fb48b98cbaf73d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b7bce580-f2f5-4bc2-8bb3-0b13dbcff387 tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df89482c-75ad-4bba-8378-f67ca799c2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b7bce580-f2f5-4bc2-8bb3-0b13dbcff387 tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df89482c-75ad-4bba-8378-f67ca799c2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b7bce580-f2f5-4bc2-8bb3-0b13dbcff387 tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a2eab4-7c97-4414-9e14-5385d26013df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b7bce580-f2f5-4bc2-8bb3-0b13dbcff387 tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a2eab4-7c97-4414-9e14-5385d26013df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c1853d6-9212-4987-9502-3b887d2b9f4f', 'volume_name': 'volume-0c1853d6-9212-4987-9502-3b887d2b9f4f', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b7bce580-f2f5-4bc2-8bb3-0b13dbcff387 tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5031946-2473-41d6-93af-b3e26600ea30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b7bce580-f2f5-4bc2-8bb3-0b13dbcff387 tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5031946-2473-41d6-93af-b3e26600ea30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b7bce580-f2f5-4bc2-8bb3-0b13dbcff387 tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1e36923-0a62-418b-8e6c-35de7c22e809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:27 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-b7bce580-f2f5-4bc2-8bb3-0b13dbcff387 tempest-VolumesSnapshotTestJSON-130675119 None] Volume 0c1853d6-9212-4987-9502-3b887d2b9f4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c1853d6-9212-4987-9502-3b887d2b9f4f', 'volume_size': 1} Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b7bce580-f2f5-4bc2-8bb3-0b13dbcff387 tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b7bce580-f2f5-4bc2-8bb3-0b13dbcff387 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b7bce580-f2f5-4bc2-8bb3-0b13dbcff387 tempest-VolumesSnapshotTestJSON-130675119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2102425187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c1853d6-9212-4987-9502-3b887d2b9f4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7060abc179094b93999584088c8e776a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:27Z,use_quota=True,user_id='a5e6e4e9ce4b4c9e82fb48b98cbaf73d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-b7bce580-f2f5-4bc2-8bb3-0b13dbcff387 tempest-VolumesSnapshotTestJSON-130675119 None] Creating volume 0c1853d6-9212-4987-9502-3b887d2b9f4f {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b7bce580-f2f5-4bc2-8bb3-0b13dbcff387 tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b7bce580-f2f5-4bc2-8bb3-0b13dbcff387 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b7bce580-f2f5-4bc2-8bb3-0b13dbcff387 tempest-VolumesSnapshotTestJSON-130675119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b7bce580-f2f5-4bc2-8bb3-0b13dbcff387 tempest-VolumesSnapshotTestJSON-130675119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b7bce580-f2f5-4bc2-8bb3-0b13dbcff387 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b7bce580-f2f5-4bc2-8bb3-0b13dbcff387 tempest-VolumesSnapshotTestJSON-130675119 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:39:27 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-b7bce580-f2f5-4bc2-8bb3-0b13dbcff387 tempest-VolumesSnapshotTestJSON-130675119 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b7bce580-f2f5-4bc2-8bb3-0b13dbcff387 tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:27 devstack sudo[103493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f 1073741824 Nov 02 12:39:27 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:27 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a4d9ff60-5501-4b01-a787-11505f1d5c2f tempest-CreateVolumesFromImageTest-837240110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-060b7b57-e244-437b-9347-bc3860038dfe" returned: 0 in 0.402s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a4d9ff60-5501-4b01-a787-11505f1d5c2f tempest-CreateVolumesFromImageTest-837240110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-060b7b57-e244-437b-9347-bc3860038dfe {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:27 devstack sudo[103496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-060b7b57-e244-437b-9347-bc3860038dfe Nov 02 12:39:27 devstack sudo[103496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:27 devstack sudo[103496]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a4d9ff60-5501-4b01-a787-11505f1d5c2f tempest-CreateVolumesFromImageTest-837240110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-060b7b57-e244-437b-9347-bc3860038dfe" returned: 0 in 0.297s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a4d9ff60-5501-4b01-a787-11505f1d5c2f tempest-CreateVolumesFromImageTest-837240110 None] Lock "cinder-quobyte-060b7b57-e244-437b-9347-bc3860038dfe" released by "delete_volume" :: held 0.756s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-a4d9ff60-5501-4b01-a787-11505f1d5c2f tempest-CreateVolumesFromImageTest-837240110 None] Created reservations ['6da7a4a8-9ecf-448e-a8a7-c9af0ec7ba22', '41448117-54d7-4be4-98d0-f9a7cffeb383', '5063f154-4529-4bff-a5fd-07ada031214f', '9d300508-720c-41a0-bc24-1578142827a6'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:39:27 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b7bce580-f2f5-4bc2-8bb3-0b13dbcff387 tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f 1073741824" returned: 0 in 0.442s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b7bce580-f2f5-4bc2-8bb3-0b13dbcff387 tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a4d9ff60-5501-4b01-a787-11505f1d5c2f tempest-CreateVolumesFromImageTest-837240110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a4d9ff60-5501-4b01-a787-11505f1d5c2f tempest-CreateVolumesFromImageTest-837240110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:28 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a4d9ff60-5501-4b01-a787-11505f1d5c2f tempest-CreateVolumesFromImageTest-837240110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:28 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a4d9ff60-5501-4b01-a787-11505f1d5c2f tempest-CreateVolumesFromImageTest-837240110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a4d9ff60-5501-4b01-a787-11505f1d5c2f tempest-CreateVolumesFromImageTest-837240110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a4d9ff60-5501-4b01-a787-11505f1d5c2f tempest-CreateVolumesFromImageTest-837240110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:28 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f Nov 02 12:39:28 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:28 devstack sudo[103505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:39:28 devstack sudo[103505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:28 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b7bce580-f2f5-4bc2-8bb3-0b13dbcff387 tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f" returned: 0 in 0.287s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:28 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b7bce580-f2f5-4bc2-8bb3-0b13dbcff387 tempest-VolumesSnapshotTestJSON-130675119 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:39:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b7bce580-f2f5-4bc2-8bb3-0b13dbcff387 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:28 devstack sudo[103505]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a4d9ff60-5501-4b01-a787-11505f1d5c2f tempest-CreateVolumesFromImageTest-837240110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.271s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:28 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-a4d9ff60-5501-4b01-a787-11505f1d5c2f tempest-CreateVolumesFromImageTest-837240110 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:39:28 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-a4d9ff60-5501-4b01-a787-11505f1d5c2f tempest-CreateVolumesFromImageTest-837240110 None] Deleted volume successfully. Nov 02 12:39:28 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b7bce580-f2f5-4bc2-8bb3-0b13dbcff387 tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1e36923-0a62-418b-8e6c-35de7c22e809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c1853d6-9212-4987-9502-3b887d2b9f4f', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:28 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b7bce580-f2f5-4bc2-8bb3-0b13dbcff387 tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263bab02-3259-4ebc-8d5e-e489532b2b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a4d9ff60-5501-4b01-a787-11505f1d5c2f tempest-CreateVolumesFromImageTest-837240110 None] Lock "cinder-060b7b57-e244-437b-9347-bc3860038dfe-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:28 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-b7bce580-f2f5-4bc2-8bb3-0b13dbcff387 tempest-VolumesSnapshotTestJSON-130675119 None] Volume volume-0c1853d6-9212-4987-9502-3b887d2b9f4f (0c1853d6-9212-4987-9502-3b887d2b9f4f): created successfully Nov 02 12:39:28 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b7bce580-f2f5-4bc2-8bb3-0b13dbcff387 tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263bab02-3259-4ebc-8d5e-e489532b2b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:28 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b7bce580-f2f5-4bc2-8bb3-0b13dbcff387 tempest-VolumesSnapshotTestJSON-130675119 None] Flow 'volume_create_manager' (d38df771-1e3b-4880-9074-d60b5409ec83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:28 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-b7bce580-f2f5-4bc2-8bb3-0b13dbcff387 tempest-VolumesSnapshotTestJSON-130675119 None] Created volume successfully. Nov 02 12:39:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-071dc495-1b22-43ec-81d0-0f8e8f9a8fbb tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-071dc495-1b22-43ec-81d0-0f8e8f9a8fbb tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:29 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-071dc495-1b22-43ec-81d0-0f8e8f9a8fbb tempest-VolumesSnapshotTestJSON-130675119 None] Creating offline snapshot 2eb26e42-02b9-4d31-ae46-945168ea12ee of volume 0c1853d6-9212-4987-9502-3b887d2b9f4f {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:39:29 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[e026be7e-35f2-446f-a53e-a9a0c61cd5f2]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-071dc495-1b22-43ec-81d0-0f8e8f9a8fbb tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:29 devstack sudo[103509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f Nov 02 12:39:29 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:30 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-071dc495-1b22-43ec-81d0-0f8e8f9a8fbb tempest-VolumesSnapshotTestJSON-130675119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f" returned: 0 in 0.363s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-071dc495-1b22-43ec-81d0-0f8e8f9a8fbb tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f.2eb26e42-02b9-4d31-ae46-945168ea12ee 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:30 devstack sudo[103514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f.2eb26e42-02b9-4d31-ae46-945168ea12ee 1G Nov 02 12:39:30 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:30 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-071dc495-1b22-43ec-81d0-0f8e8f9a8fbb tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f.2eb26e42-02b9-4d31-ae46-945168ea12ee 1G" returned: 0 in 0.429s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-071dc495-1b22-43ec-81d0-0f8e8f9a8fbb tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c1853d6-9212-4987-9502-3b887d2b9f4f -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f.2eb26e42-02b9-4d31-ae46-945168ea12ee {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:30 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c1853d6-9212-4987-9502-3b887d2b9f4f -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f.2eb26e42-02b9-4d31-ae46-945168ea12ee Nov 02 12:39:30 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:30 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-071dc495-1b22-43ec-81d0-0f8e8f9a8fbb tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c1853d6-9212-4987-9502-3b887d2b9f4f -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f.2eb26e42-02b9-4d31-ae46-945168ea12ee" returned: 0 in 0.302s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:30 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-071dc495-1b22-43ec-81d0-0f8e8f9a8fbb tempest-VolumesSnapshotTestJSON-130675119 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f.2eb26e42-02b9-4d31-ae46-945168ea12ee is being set with open permissions: ugo+rw Nov 02 12:39:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-071dc495-1b22-43ec-81d0-0f8e8f9a8fbb tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f.2eb26e42-02b9-4d31-ae46-945168ea12ee {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:30 devstack sudo[103525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f.2eb26e42-02b9-4d31-ae46-945168ea12ee Nov 02 12:39:30 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:31 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-071dc495-1b22-43ec-81d0-0f8e8f9a8fbb tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f.2eb26e42-02b9-4d31-ae46-945168ea12ee" returned: 0 in 0.283s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:31 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8c613b2-ab3a-4fd6-a965-0199b126ce8a tempest-VolumeDependencyTests-771631023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:39:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a8c613b2-ab3a-4fd6-a965-0199b126ce8a tempest-VolumeDependencyTests-771631023 None] Flow 'volume_create_manager' (a770922f-c61c-4c47-808b-7aa1ca12b242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a8c613b2-ab3a-4fd6-a965-0199b126ce8a tempest-VolumeDependencyTests-771631023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e4420b-57ca-4350-be21-186de46aa740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-071dc495-1b22-43ec-81d0-0f8e8f9a8fbb tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a8c613b2-ab3a-4fd6-a965-0199b126ce8a tempest-VolumeDependencyTests-771631023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e4420b-57ca-4350-be21-186de46aa740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-302929757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f380f92-f34e-49ba-992d-3aa77be97eda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70701dbe44d94f069217c71da971c9ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:31Z,use_quota=True,user_id='fad53a2d870842328b7f624f8105f403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:31 devstack sudo[103528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f.info Nov 02 12:39:31 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a8c613b2-ab3a-4fd6-a965-0199b126ce8a tempest-VolumeDependencyTests-771631023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d888553d-03d1-49eb-96f0-2a915dea116e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a8c613b2-ab3a-4fd6-a965-0199b126ce8a tempest-VolumeDependencyTests-771631023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d888553d-03d1-49eb-96f0-2a915dea116e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a8c613b2-ab3a-4fd6-a965-0199b126ce8a tempest-VolumeDependencyTests-771631023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba88764b-cc58-4dd1-bf04-122fe6bf8e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a8c613b2-ab3a-4fd6-a965-0199b126ce8a tempest-VolumeDependencyTests-771631023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba88764b-cc58-4dd1-bf04-122fe6bf8e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f380f92-f34e-49ba-992d-3aa77be97eda', 'volume_name': 'volume-5f380f92-f34e-49ba-992d-3aa77be97eda', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a8c613b2-ab3a-4fd6-a965-0199b126ce8a tempest-VolumeDependencyTests-771631023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79d47d79-3021-4870-b4b8-c24914b816a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a8c613b2-ab3a-4fd6-a965-0199b126ce8a tempest-VolumeDependencyTests-771631023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79d47d79-3021-4870-b4b8-c24914b816a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a8c613b2-ab3a-4fd6-a965-0199b126ce8a tempest-VolumeDependencyTests-771631023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2358bf98-a6d2-4c87-a447-58411888d99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:31 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-a8c613b2-ab3a-4fd6-a965-0199b126ce8a tempest-VolumeDependencyTests-771631023 None] Volume 5f380f92-f34e-49ba-992d-3aa77be97eda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f380f92-f34e-49ba-992d-3aa77be97eda', 'volume_size': 1} Nov 02 12:39:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a8c613b2-ab3a-4fd6-a965-0199b126ce8a tempest-VolumeDependencyTests-771631023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:31 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-071dc495-1b22-43ec-81d0-0f8e8f9a8fbb tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f.info" returned: 0 in 0.283s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:31 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-071dc495-1b22-43ec-81d0-0f8e8f9a8fbb tempest-VolumesSnapshotTestJSON-130675119 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f.info is being set with open permissions: ugo+rw Nov 02 12:39:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-071dc495-1b22-43ec-81d0-0f8e8f9a8fbb tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:31 devstack sudo[103532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f.info Nov 02 12:39:31 devstack sudo[103532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:31 devstack sudo[103532]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-071dc495-1b22-43ec-81d0-0f8e8f9a8fbb tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f.info" returned: 0 in 0.245s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-071dc495-1b22-43ec-81d0-0f8e8f9a8fbb tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.092s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a8c613b2-ab3a-4fd6-a965-0199b126ce8a tempest-VolumeDependencyTests-771631023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.478s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:31 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a8c613b2-ab3a-4fd6-a965-0199b126ce8a tempest-VolumeDependencyTests-771631023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-302929757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f380f92-f34e-49ba-992d-3aa77be97eda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70701dbe44d94f069217c71da971c9ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:31Z,use_quota=True,user_id='fad53a2d870842328b7f624f8105f403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:39:31 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-a8c613b2-ab3a-4fd6-a965-0199b126ce8a tempest-VolumeDependencyTests-771631023 None] Creating volume 5f380f92-f34e-49ba-992d-3aa77be97eda {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:39:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a8c613b2-ab3a-4fd6-a965-0199b126ce8a tempest-VolumeDependencyTests-771631023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a8c613b2-ab3a-4fd6-a965-0199b126ce8a tempest-VolumeDependencyTests-771631023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:31 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a8c613b2-ab3a-4fd6-a965-0199b126ce8a tempest-VolumeDependencyTests-771631023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:31 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a8c613b2-ab3a-4fd6-a965-0199b126ce8a tempest-VolumeDependencyTests-771631023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a8c613b2-ab3a-4fd6-a965-0199b126ce8a tempest-VolumeDependencyTests-771631023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:31 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a8c613b2-ab3a-4fd6-a965-0199b126ce8a tempest-VolumeDependencyTests-771631023 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:39:31 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-a8c613b2-ab3a-4fd6-a965-0199b126ce8a tempest-VolumeDependencyTests-771631023 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:39:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a8c613b2-ab3a-4fd6-a965-0199b126ce8a tempest-VolumeDependencyTests-771631023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:31 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda 1073741824 Nov 02 12:39:31 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:31 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-071dc495-1b22-43ec-81d0-0f8e8f9a8fbb tempest-VolumesSnapshotTestJSON-130675119 None] Create snapshot completed successfully Nov 02 12:39:32 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a8c613b2-ab3a-4fd6-a965-0199b126ce8a tempest-VolumeDependencyTests-771631023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda 1073741824" returned: 0 in 0.448s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a8c613b2-ab3a-4fd6-a965-0199b126ce8a tempest-VolumeDependencyTests-771631023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:32 devstack sudo[103540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda Nov 02 12:39:32 devstack sudo[103540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:32 devstack sudo[103540]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a8c613b2-ab3a-4fd6-a965-0199b126ce8a tempest-VolumeDependencyTests-771631023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda" returned: 0 in 0.236s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:32 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a8c613b2-ab3a-4fd6-a965-0199b126ce8a tempest-VolumeDependencyTests-771631023 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:39:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a8c613b2-ab3a-4fd6-a965-0199b126ce8a tempest-VolumeDependencyTests-771631023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:32 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a8c613b2-ab3a-4fd6-a965-0199b126ce8a tempest-VolumeDependencyTests-771631023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2358bf98-a6d2-4c87-a447-58411888d99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f380f92-f34e-49ba-992d-3aa77be97eda', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:32 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a8c613b2-ab3a-4fd6-a965-0199b126ce8a tempest-VolumeDependencyTests-771631023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21ee56ce-922e-4d08-be41-194c93d7d539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:32 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-a8c613b2-ab3a-4fd6-a965-0199b126ce8a tempest-VolumeDependencyTests-771631023 None] Volume volume-5f380f92-f34e-49ba-992d-3aa77be97eda (5f380f92-f34e-49ba-992d-3aa77be97eda): created successfully Nov 02 12:39:32 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a8c613b2-ab3a-4fd6-a965-0199b126ce8a tempest-VolumeDependencyTests-771631023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21ee56ce-922e-4d08-be41-194c93d7d539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:32 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a8c613b2-ab3a-4fd6-a965-0199b126ce8a tempest-VolumeDependencyTests-771631023 None] Flow 'volume_create_manager' (a770922f-c61c-4c47-808b-7aa1ca12b242) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:32 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-a8c613b2-ab3a-4fd6-a965-0199b126ce8a tempest-VolumeDependencyTests-771631023 None] Created volume successfully. Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Flow 'volume_create_manager' (08557acc-7802-407c-a5df-2bceb0220176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c66aace6-1574-4ff5-b9ec-90f7c3ad7a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c66aace6-1574-4ff5-b9ec-90f7c3ad7a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-791824086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8638938-8881-4e55-8663-62eed96d85c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7060abc179094b93999584088c8e776a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=2eb26e42-02b9-4d31-ae46-945168ea12ee,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:33Z,use_quota=True,user_id='a5e6e4e9ce4b4c9e82fb48b98cbaf73d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de5a2c70-1860-460d-82c5-8e02704a3b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de5a2c70-1860-460d-82c5-8e02704a3b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce86e2b5-1c4d-4191-bcb9-33b8080b3b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce86e2b5-1c4d-4191-bcb9-33b8080b3b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e8638938-8881-4e55-8663-62eed96d85c0', 'volume_name': 'volume-e8638938-8881-4e55-8663-62eed96d85c0', 'volume_size': 2, 'snapshot_id': '2eb26e42-02b9-4d31-ae46-945168ea12ee'}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bfb6fbf-d814-4466-8e68-52495c6dc6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bfb6fbf-d814-4466-8e68-52495c6dc6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (161f96c1-9be9-4fe6-bef5-fd11d62ab888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:33 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Volume e8638938-8881-4e55-8663-62eed96d85c0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e8638938-8881-4e55-8663-62eed96d85c0', 'volume_size': 2, 'snapshot_id': '2eb26e42-02b9-4d31-ae46-945168ea12ee'} Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "cinder-quobyte-2eb26e42-02b9-4d31-ae46-945168ea12ee-e8638938-8881-4e55-8663-62eed96d85c0" by "_create_volume_from_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d598c269-dae6-479f-b1b1-e030fef62ac9 tempest-VolumeDependencyTests-771631023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-quobyte-2eb26e42-02b9-4d31-ae46-945168ea12ee-e8638938-8881-4e55-8663-62eed96d85c0" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Creating volume e8638938-8881-4e55-8663-62eed96d85c0 from snapshot 2eb26e42-02b9-4d31-ae46-945168ea12ee {{(pid=86515) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "cinder-quobyte-e8638938-8881-4e55-8663-62eed96d85c0" by "_copy_volume_from_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-quobyte-e8638938-8881-4e55-8663-62eed96d85c0" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] snapshot: 2eb26e42-02b9-4d31-ae46-945168ea12ee, volume: e8638938-8881-4e55-8663-62eed96d85c0, {{(pid=86515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e578fe-9365-4982-91e0-5bc981b82c67]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f.2eb26e42-02b9-4d31-ae46-945168ea12ee {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:33 devstack sudo[103543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f.2eb26e42-02b9-4d31-ae46-945168ea12ee Nov 02 12:39:33 devstack sudo[103543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:33 devstack sudo[103543]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f.2eb26e42-02b9-4d31-ae46-945168ea12ee" returned: 0 in 0.338s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c1853d6-9212-4987-9502-3b887d2b9f4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22a09b8-80c3-4ac1-ac89-2f86105ee366]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:33 devstack sudo[103548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f Nov 02 12:39:33 devstack sudo[103548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:34 devstack sudo[103548]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f" returned: 0 in 0.345s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] will copy from snapshot at /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f {{(pid=86515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 12:39:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Creating direct copy from snapshot {{(pid=86515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 12:39:34 devstack cinder-volume[86515]: DEBUG cinder.utils [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Path /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e8638938-8881-4e55-8663-62eed96d85c0 not found in is_blk_device check {{(pid=86515) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 12:39:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e8638938-8881-4e55-8663-62eed96d85c0 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:34 devstack sudo[103553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e8638938-8881-4e55-8663-62eed96d85c0 Nov 02 12:39:34 devstack sudo[103553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:40 devstack sudo[103553]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e8638938-8881-4e55-8663-62eed96d85c0" returned: 0 in 6.083s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:40 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Image conversion details: src /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f, size 1024.00 MB, duration 6.08 sec, destination /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e8638938-8881-4e55-8663-62eed96d85c0 {{(pid=86515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 12:39:40 devstack cinder-volume[86515]: INFO cinder.image.image_utils [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Converted 1024.00 MB image at 168.31 MB/s Nov 02 12:39:40 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e8638938-8881-4e55-8663-62eed96d85c0 is being set with open permissions: ugo+rw Nov 02 12:39:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e8638938-8881-4e55-8663-62eed96d85c0 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:40 devstack sudo[103566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e8638938-8881-4e55-8663-62eed96d85c0 Nov 02 12:39:40 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:40 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e8638938-8881-4e55-8663-62eed96d85c0" returned: 0 in 0.250s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:40 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-quobyte-e8638938-8881-4e55-8663-62eed96d85c0" released by "_copy_volume_from_snapshot" :: held 7.092s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:40 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-quobyte-2eb26e42-02b9-4d31-ae46-945168ea12ee-e8638938-8881-4e55-8663-62eed96d85c0" released by "_create_volume_from_snapshot" :: held 7.156s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.174s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d598c269-dae6-479f-b1b1-e030fef62ac9 tempest-VolumeDependencyTests-771631023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.163s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:40 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-d598c269-dae6-479f-b1b1-e030fef62ac9 tempest-VolumeDependencyTests-771631023 None] Creating offline snapshot 0f815291-209d-4606-a3bd-e676ba668b03 of volume 5f380f92-f34e-49ba-992d-3aa77be97eda {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:39:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (161f96c1-9be9-4fe6-bef5-fd11d62ab888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8638938-8881-4e55-8663-62eed96d85c0', 'volume_size': 2, 'snapshot_id': '2eb26e42-02b9-4d31-ae46-945168ea12ee'}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (084340f6-edee-48e2-885c-aa348b89a10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:40 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[651a04d2-b7e8-44fc-ad1e-d4b3935f40f0]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d598c269-dae6-479f-b1b1-e030fef62ac9 tempest-VolumeDependencyTests-771631023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:40 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Volume volume-e8638938-8881-4e55-8663-62eed96d85c0 (e8638938-8881-4e55-8663-62eed96d85c0): created successfully Nov 02 12:39:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (084340f6-edee-48e2-885c-aa348b89a10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Flow 'volume_create_manager' (08557acc-7802-407c-a5df-2bceb0220176) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:40 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-7eef4f6b-d4b4-42df-8528-0b71efb8446d tempest-VolumesSnapshotTestJSON-130675119 None] Created volume successfully. Nov 02 12:39:40 devstack sudo[103569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda Nov 02 12:39:40 devstack sudo[103569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:41 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-343dc285-efad-4f45-b264-437545d68bd9 tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "cinder-e8638938-8881-4e55-8663-62eed96d85c0-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:41 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-343dc285-efad-4f45-b264-437545d68bd9 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-e8638938-8881-4e55-8663-62eed96d85c0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:41 devstack sudo[103569]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d598c269-dae6-479f-b1b1-e030fef62ac9 tempest-VolumeDependencyTests-771631023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda" returned: 0 in 0.390s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d598c269-dae6-479f-b1b1-e030fef62ac9 tempest-VolumeDependencyTests-771631023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda.0f815291-209d-4606-a3bd-e676ba668b03 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:41 devstack sudo[103574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda.0f815291-209d-4606-a3bd-e676ba668b03 1G Nov 02 12:39:41 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:41 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-343dc285-efad-4f45-b264-437545d68bd9 tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "cinder-quobyte-e8638938-8881-4e55-8663-62eed96d85c0" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:41 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-343dc285-efad-4f45-b264-437545d68bd9 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-quobyte-e8638938-8881-4e55-8663-62eed96d85c0" acquired by "delete_volume" :: waited 0.017s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:41 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cb9c4a-3f82-45ef-a0dc-a42d2bdb7851]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-343dc285-efad-4f45-b264-437545d68bd9 tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e8638938-8881-4e55-8663-62eed96d85c0 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:41 devstack sudo[103576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e8638938-8881-4e55-8663-62eed96d85c0 Nov 02 12:39:41 devstack sudo[103576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:41 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d598c269-dae6-479f-b1b1-e030fef62ac9 tempest-VolumeDependencyTests-771631023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda.0f815291-209d-4606-a3bd-e676ba668b03 1G" returned: 0 in 0.461s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d598c269-dae6-479f-b1b1-e030fef62ac9 tempest-VolumeDependencyTests-771631023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f380f92-f34e-49ba-992d-3aa77be97eda -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda.0f815291-209d-4606-a3bd-e676ba668b03 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:41 devstack sudo[103586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f380f92-f34e-49ba-992d-3aa77be97eda -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda.0f815291-209d-4606-a3bd-e676ba668b03 Nov 02 12:39:41 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:41 devstack sudo[103576]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-343dc285-efad-4f45-b264-437545d68bd9 tempest-VolumesSnapshotTestJSON-130675119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e8638938-8881-4e55-8663-62eed96d85c0" returned: 0 in 0.418s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-343dc285-efad-4f45-b264-437545d68bd9 tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e8638938-8881-4e55-8663-62eed96d85c0 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:41 devstack sudo[103588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e8638938-8881-4e55-8663-62eed96d85c0 Nov 02 12:39:41 devstack sudo[103588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:41 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d598c269-dae6-479f-b1b1-e030fef62ac9 tempest-VolumeDependencyTests-771631023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f380f92-f34e-49ba-992d-3aa77be97eda -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda.0f815291-209d-4606-a3bd-e676ba668b03" returned: 0 in 0.300s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:41 devstack sudo[103588]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:41 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-d598c269-dae6-479f-b1b1-e030fef62ac9 tempest-VolumeDependencyTests-771631023 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda.0f815291-209d-4606-a3bd-e676ba668b03 is being set with open permissions: ugo+rw Nov 02 12:39:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d598c269-dae6-479f-b1b1-e030fef62ac9 tempest-VolumeDependencyTests-771631023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda.0f815291-209d-4606-a3bd-e676ba668b03 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-343dc285-efad-4f45-b264-437545d68bd9 tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e8638938-8881-4e55-8663-62eed96d85c0" returned: 0 in 0.274s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:41 devstack sudo[103594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda.0f815291-209d-4606-a3bd-e676ba668b03 Nov 02 12:39:41 devstack sudo[103594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:41 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-343dc285-efad-4f45-b264-437545d68bd9 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-quobyte-e8638938-8881-4e55-8663-62eed96d85c0" released by "delete_volume" :: held 0.740s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:41 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-343dc285-efad-4f45-b264-437545d68bd9 tempest-VolumesSnapshotTestJSON-130675119 None] Created reservations ['d3c31f4f-b939-47c4-a49a-e5cb80848894', '854f4321-21bb-497c-8a79-a737e0f92e05', 'cbd55a68-597a-4a97-977a-4e67b3fef6fb', '2798a1d8-df80-43b3-a96f-51451dc69cc0'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:39:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-343dc285-efad-4f45-b264-437545d68bd9 tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-343dc285-efad-4f45-b264-437545d68bd9 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:41 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-343dc285-efad-4f45-b264-437545d68bd9 tempest-VolumesSnapshotTestJSON-130675119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:41 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-343dc285-efad-4f45-b264-437545d68bd9 tempest-VolumesSnapshotTestJSON-130675119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-343dc285-efad-4f45-b264-437545d68bd9 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-343dc285-efad-4f45-b264-437545d68bd9 tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:42 devstack sudo[103596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:39:42 devstack sudo[103596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:42 devstack sudo[103594]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d598c269-dae6-479f-b1b1-e030fef62ac9 tempest-VolumeDependencyTests-771631023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda.0f815291-209d-4606-a3bd-e676ba668b03" returned: 0 in 0.263s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d598c269-dae6-479f-b1b1-e030fef62ac9 tempest-VolumeDependencyTests-771631023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:42 devstack sudo[103599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda.info Nov 02 12:39:42 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:42 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0dfd99df-3e75-4013-bdf9-3e969ce52b5a tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "cinder-2eb26e42-02b9-4d31-ae46-945168ea12ee-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:42 devstack sudo[103596]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-343dc285-efad-4f45-b264-437545d68bd9 tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.302s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:42 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-343dc285-efad-4f45-b264-437545d68bd9 tempest-VolumesSnapshotTestJSON-130675119 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:39:42 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0dfd99df-3e75-4013-bdf9-3e969ce52b5a tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-2eb26e42-02b9-4d31-ae46-945168ea12ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:42 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0dfd99df-3e75-4013-bdf9-3e969ce52b5a tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "cinder-quobyte-0c1853d6-9212-4987-9502-3b887d2b9f4f" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:42 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-343dc285-efad-4f45-b264-437545d68bd9 tempest-VolumesSnapshotTestJSON-130675119 None] Deleted volume successfully. Nov 02 12:39:42 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0dfd99df-3e75-4013-bdf9-3e969ce52b5a tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-quobyte-0c1853d6-9212-4987-9502-3b887d2b9f4f" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:42 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0dfd99df-3e75-4013-bdf9-3e969ce52b5a tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "cinder-quobyte-2eb26e42-02b9-4d31-ae46-945168ea12ee" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:42 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-343dc285-efad-4f45-b264-437545d68bd9 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-e8638938-8881-4e55-8663-62eed96d85c0-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:42 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0dfd99df-3e75-4013-bdf9-3e969ce52b5a tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-quobyte-2eb26e42-02b9-4d31-ae46-945168ea12ee" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:42 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-0dfd99df-3e75-4013-bdf9-3e969ce52b5a tempest-VolumesSnapshotTestJSON-130675119 None] Deleting offline snapshot 2eb26e42-02b9-4d31-ae46-945168ea12ee of volume 0c1853d6-9212-4987-9502-3b887d2b9f4f {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:39:42 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-0dfd99df-3e75-4013-bdf9-3e969ce52b5a tempest-VolumesSnapshotTestJSON-130675119 None] snapshot_file for this snap is: volume-0c1853d6-9212-4987-9502-3b887d2b9f4f.2eb26e42-02b9-4d31-ae46-945168ea12ee {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:39:42 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[75671e63-a6d5-4d93-8156-06f780c73f1b]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0dfd99df-3e75-4013-bdf9-3e969ce52b5a tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f.2eb26e42-02b9-4d31-ae46-945168ea12ee {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:42 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d598c269-dae6-479f-b1b1-e030fef62ac9 tempest-VolumeDependencyTests-771631023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda.info" returned: 0 in 0.289s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:42 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-d598c269-dae6-479f-b1b1-e030fef62ac9 tempest-VolumeDependencyTests-771631023 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda.info is being set with open permissions: ugo+rw Nov 02 12:39:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d598c269-dae6-479f-b1b1-e030fef62ac9 tempest-VolumeDependencyTests-771631023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:42 devstack sudo[103638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda.info Nov 02 12:39:42 devstack sudo[103638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:42 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f.2eb26e42-02b9-4d31-ae46-945168ea12ee Nov 02 12:39:42 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:42 devstack sudo[103638]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d598c269-dae6-479f-b1b1-e030fef62ac9 tempest-VolumeDependencyTests-771631023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda.info" returned: 0 in 0.270s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d598c269-dae6-479f-b1b1-e030fef62ac9 tempest-VolumeDependencyTests-771631023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.083s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:42 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-d598c269-dae6-479f-b1b1-e030fef62ac9 tempest-VolumeDependencyTests-771631023 None] Create snapshot completed successfully Nov 02 12:39:42 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0dfd99df-3e75-4013-bdf9-3e969ce52b5a tempest-VolumesSnapshotTestJSON-130675119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f.2eb26e42-02b9-4d31-ae46-945168ea12ee" returned: 0 in 0.442s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:42 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-0dfd99df-3e75-4013-bdf9-3e969ce52b5a tempest-VolumesSnapshotTestJSON-130675119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c1853d6-9212-4987-9502-3b887d2b9f4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:39:42 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49b45da-1e88-47cf-bd0a-153a38cfd795]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0dfd99df-3e75-4013-bdf9-3e969ce52b5a tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:42 devstack sudo[103649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f Nov 02 12:39:42 devstack sudo[103649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Flow 'volume_create_manager' (35c2353c-6107-4672-85b0-85d4c95c78b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:43 devstack sudo[103649]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74e92546-d9d1-43f2-bfb9-6d23dde6044b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0dfd99df-3e75-4013-bdf9-3e969ce52b5a tempest-VolumesSnapshotTestJSON-130675119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f" returned: 0 in 0.584s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0dfd99df-3e75-4013-bdf9-3e969ce52b5a tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f.2eb26e42-02b9-4d31-ae46-945168ea12ee {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74e92546-d9d1-43f2-bfb9-6d23dde6044b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1645890438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89d5e5c9-f0cb-475d-8ab1-37826d9972f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70701dbe44d94f069217c71da971c9ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0f815291-209d-4606-a3bd-e676ba668b03,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:43Z,use_quota=True,user_id='fad53a2d870842328b7f624f8105f403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:43 devstack sudo[103654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f.2eb26e42-02b9-4d31-ae46-945168ea12ee Nov 02 12:39:43 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39f9d141-816f-4dfa-ab5f-2111eb1241b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39f9d141-816f-4dfa-ab5f-2111eb1241b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5138beb9-4732-4db4-9df7-79662aa8f35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5138beb9-4732-4db4-9df7-79662aa8f35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '89d5e5c9-f0cb-475d-8ab1-37826d9972f1', 'volume_name': 'volume-89d5e5c9-f0cb-475d-8ab1-37826d9972f1', 'volume_size': 1, 'snapshot_id': '0f815291-209d-4606-a3bd-e676ba668b03'}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (128b43c7-122c-44cd-a131-182fe0d09b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (128b43c7-122c-44cd-a131-182fe0d09b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2095bc10-eb3b-4a80-ad8b-5f91ae9ab48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:43 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Volume 89d5e5c9-f0cb-475d-8ab1-37826d9972f1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-89d5e5c9-f0cb-475d-8ab1-37826d9972f1', 'volume_size': 1, 'snapshot_id': '0f815291-209d-4606-a3bd-e676ba668b03'} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Acquiring lock "cinder-quobyte-0f815291-209d-4606-a3bd-e676ba668b03-89d5e5c9-f0cb-475d-8ab1-37826d9972f1" by "_create_volume_from_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Lock "cinder-quobyte-0f815291-209d-4606-a3bd-e676ba668b03-89d5e5c9-f0cb-475d-8ab1-37826d9972f1" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Creating volume 89d5e5c9-f0cb-475d-8ab1-37826d9972f1 from snapshot 0f815291-209d-4606-a3bd-e676ba668b03 {{(pid=86515) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Acquiring lock "cinder-quobyte-89d5e5c9-f0cb-475d-8ab1-37826d9972f1" by "_copy_volume_from_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Lock "cinder-quobyte-89d5e5c9-f0cb-475d-8ab1-37826d9972f1" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] snapshot: 0f815291-209d-4606-a3bd-e676ba668b03, volume: 89d5e5c9-f0cb-475d-8ab1-37826d9972f1, {{(pid=86515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b367ed-bbca-41c7-86ad-068fa391c966]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda.0f815291-209d-4606-a3bd-e676ba668b03 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:43 devstack sudo[103656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda.0f815291-209d-4606-a3bd-e676ba668b03 Nov 02 12:39:43 devstack sudo[103656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:43 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0dfd99df-3e75-4013-bdf9-3e969ce52b5a tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f.2eb26e42-02b9-4d31-ae46-945168ea12ee" returned: 0 in 0.363s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0dfd99df-3e75-4013-bdf9-3e969ce52b5a tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f.2eb26e42-02b9-4d31-ae46-945168ea12ee {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:43 devstack sudo[103661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f.2eb26e42-02b9-4d31-ae46-945168ea12ee Nov 02 12:39:43 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:43 devstack sudo[103663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:39:43 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:44 devstack sudo[103656]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda.0f815291-209d-4606-a3bd-e676ba668b03" returned: 0 in 0.416s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:44 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f380f92-f34e-49ba-992d-3aa77be97eda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:39:44 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d17da9-55ac-4992-9722-29f9c6f6b4aa]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:44 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0dfd99df-3e75-4013-bdf9-3e969ce52b5a tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f.2eb26e42-02b9-4d31-ae46-945168ea12ee" returned: 0 in 0.277s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:44 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0dfd99df-3e75-4013-bdf9-3e969ce52b5a tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-quobyte-2eb26e42-02b9-4d31-ae46-945168ea12ee" released by "_delete_snapshot" :: held 1.801s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:44 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0dfd99df-3e75-4013-bdf9-3e969ce52b5a tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-quobyte-0c1853d6-9212-4987-9502-3b887d2b9f4f" released by "delete_snapshot" :: held 1.832s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:44 devstack sudo[103670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda Nov 02 12:39:44 devstack sudo[103670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:44 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.309s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:44 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:39:44 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager._thread_info {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:39:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread count: 28 {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:39:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread info: [<_MainThread(MainThread, started 129944084402304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:39:44 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-0dfd99df-3e75-4013-bdf9-3e969ce52b5a tempest-VolumesSnapshotTestJSON-130675119 None] Created reservations ['cb8e378b-ae14-454b-a4a0-9be8c28ea308', '89315408-9b62-4ff4-af9e-7a5a66cdee34', '9cba3f3a-bc06-4d8b-a121-76d0f36adbfc', 'a4bf26a5-1c02-4ee0-9449-5f59b6ff901d'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:39:44 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-0dfd99df-3e75-4013-bdf9-3e969ce52b5a tempest-VolumesSnapshotTestJSON-130675119 None] Delete snapshot completed successfully. Nov 02 12:39:44 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0dfd99df-3e75-4013-bdf9-3e969ce52b5a tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-2eb26e42-02b9-4d31-ae46-945168ea12ee-delete_snapshot" released by "delete_snapshot" :: held 2.022s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:44 devstack sudo[103670]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda" returned: 0 in 0.424s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:44 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] will copy from snapshot at /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda {{(pid=86515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 12:39:44 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Creating direct copy from snapshot {{(pid=86515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 12:39:44 devstack cinder-volume[86515]: DEBUG cinder.utils [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Path /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-89d5e5c9-f0cb-475d-8ab1-37826d9972f1 not found in is_blk_device check {{(pid=86515) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 12:39:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-89d5e5c9-f0cb-475d-8ab1-37826d9972f1 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:44 devstack sudo[103676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-89d5e5c9-f0cb-475d-8ab1-37826d9972f1 Nov 02 12:39:44 devstack sudo[103676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:44 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-bdb79370-d2a1-4f8e-91d3-ea49abbfd919 tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "cinder-0c1853d6-9212-4987-9502-3b887d2b9f4f-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:44 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-bdb79370-d2a1-4f8e-91d3-ea49abbfd919 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-0c1853d6-9212-4987-9502-3b887d2b9f4f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:44 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-bdb79370-d2a1-4f8e-91d3-ea49abbfd919 tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "cinder-quobyte-0c1853d6-9212-4987-9502-3b887d2b9f4f" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:44 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-bdb79370-d2a1-4f8e-91d3-ea49abbfd919 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-quobyte-0c1853d6-9212-4987-9502-3b887d2b9f4f" acquired by "delete_volume" :: waited 0.015s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:44 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9585acc-4aef-49d1-b734-78d6f92a15e9]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bdb79370-d2a1-4f8e-91d3-ea49abbfd919 tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:44 devstack sudo[103678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f Nov 02 12:39:44 devstack sudo[103678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:45 devstack sudo[103678]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bdb79370-d2a1-4f8e-91d3-ea49abbfd919 tempest-VolumesSnapshotTestJSON-130675119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f" returned: 0 in 0.513s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bdb79370-d2a1-4f8e-91d3-ea49abbfd919 tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:45 devstack sudo[103693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f Nov 02 12:39:45 devstack sudo[103693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:45 devstack sudo[103693]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bdb79370-d2a1-4f8e-91d3-ea49abbfd919 tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0c1853d6-9212-4987-9502-3b887d2b9f4f" returned: 0 in 0.440s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:45 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-bdb79370-d2a1-4f8e-91d3-ea49abbfd919 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-quobyte-0c1853d6-9212-4987-9502-3b887d2b9f4f" released by "delete_volume" :: held 1.052s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:45 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-bdb79370-d2a1-4f8e-91d3-ea49abbfd919 tempest-VolumesSnapshotTestJSON-130675119 None] Created reservations ['902b2145-2bc0-4721-9bc5-aa3f34172dae', 'd185f623-c2e8-4e45-a7eb-f59911b0781d', '7dbd4c94-ac9d-4fe8-b8aa-5574e4cc2cbb', '338d02f0-4e31-4f61-8e19-5b8475da6f4f'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:39:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-bdb79370-d2a1-4f8e-91d3-ea49abbfd919 tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-bdb79370-d2a1-4f8e-91d3-ea49abbfd919 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:45 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-bdb79370-d2a1-4f8e-91d3-ea49abbfd919 tempest-VolumesSnapshotTestJSON-130675119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:45 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-bdb79370-d2a1-4f8e-91d3-ea49abbfd919 tempest-VolumesSnapshotTestJSON-130675119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-bdb79370-d2a1-4f8e-91d3-ea49abbfd919 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bdb79370-d2a1-4f8e-91d3-ea49abbfd919 tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:45 devstack sudo[103698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:39:45 devstack sudo[103698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:46 devstack sudo[103698]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bdb79370-d2a1-4f8e-91d3-ea49abbfd919 tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.368s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:46 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-bdb79370-d2a1-4f8e-91d3-ea49abbfd919 tempest-VolumesSnapshotTestJSON-130675119 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:39:46 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-bdb79370-d2a1-4f8e-91d3-ea49abbfd919 tempest-VolumesSnapshotTestJSON-130675119 None] Deleted volume successfully. Nov 02 12:39:46 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-bdb79370-d2a1-4f8e-91d3-ea49abbfd919 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-0c1853d6-9212-4987-9502-3b887d2b9f4f-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:47 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3046066-0002-4c37-928b-48ce704e7664 tempest-VolumesSnapshotTestJSON-130675119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:39:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f3046066-0002-4c37-928b-48ce704e7664 tempest-VolumesSnapshotTestJSON-130675119 None] Flow 'volume_create_manager' (72a1735d-287a-43ee-923b-ef8130ea434a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f3046066-0002-4c37-928b-48ce704e7664 tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03f34017-0473-46e7-975f-cde12b98d142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f3046066-0002-4c37-928b-48ce704e7664 tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03f34017-0473-46e7-975f-cde12b98d142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1087106430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77ce5316-e287-4515-8ab2-04f4ccbb52cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7060abc179094b93999584088c8e776a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:48Z,use_quota=True,user_id='a5e6e4e9ce4b4c9e82fb48b98cbaf73d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f3046066-0002-4c37-928b-48ce704e7664 tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (924851e3-7c68-4f8b-8546-28f1fed89c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f3046066-0002-4c37-928b-48ce704e7664 tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (924851e3-7c68-4f8b-8546-28f1fed89c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f3046066-0002-4c37-928b-48ce704e7664 tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab94c2f1-4cb3-4ddf-b56d-76c85679bbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f3046066-0002-4c37-928b-48ce704e7664 tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab94c2f1-4cb3-4ddf-b56d-76c85679bbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77ce5316-e287-4515-8ab2-04f4ccbb52cd', 'volume_name': 'volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f3046066-0002-4c37-928b-48ce704e7664 tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca6419f5-290e-4ce7-b055-d4db4daa6b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f3046066-0002-4c37-928b-48ce704e7664 tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca6419f5-290e-4ce7-b055-d4db4daa6b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f3046066-0002-4c37-928b-48ce704e7664 tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6be29d5-24fa-41e2-ab15-8ba44f2ac328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:47 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-f3046066-0002-4c37-928b-48ce704e7664 tempest-VolumesSnapshotTestJSON-130675119 None] Volume 77ce5316-e287-4515-8ab2-04f4ccbb52cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd', 'volume_size': 1} Nov 02 12:39:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f3046066-0002-4c37-928b-48ce704e7664 tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:50 devstack sudo[103676]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-89d5e5c9-f0cb-475d-8ab1-37826d9972f1" returned: 0 in 6.021s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:50 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Image conversion details: src /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda, size 1024.00 MB, duration 6.02 sec, destination /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-89d5e5c9-f0cb-475d-8ab1-37826d9972f1 {{(pid=86515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 12:39:50 devstack cinder-volume[86515]: INFO cinder.image.image_utils [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Converted 1024.00 MB image at 170.03 MB/s Nov 02 12:39:50 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-89d5e5c9-f0cb-475d-8ab1-37826d9972f1 is being set with open permissions: ugo+rw Nov 02 12:39:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-89d5e5c9-f0cb-475d-8ab1-37826d9972f1 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:50 devstack sudo[103708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-89d5e5c9-f0cb-475d-8ab1-37826d9972f1 Nov 02 12:39:50 devstack sudo[103708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:50 devstack sudo[103708]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-89d5e5c9-f0cb-475d-8ab1-37826d9972f1" returned: 0 in 0.225s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:50 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Lock "cinder-quobyte-89d5e5c9-f0cb-475d-8ab1-37826d9972f1" released by "_copy_volume_from_snapshot" :: held 7.174s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:50 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Lock "cinder-quobyte-0f815291-209d-4606-a3bd-e676ba668b03-89d5e5c9-f0cb-475d-8ab1-37826d9972f1" released by "_create_volume_from_snapshot" :: held 7.236s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.254s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f3046066-0002-4c37-928b-48ce704e7664 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.038s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:50 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f3046066-0002-4c37-928b-48ce704e7664 tempest-VolumesSnapshotTestJSON-130675119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1087106430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77ce5316-e287-4515-8ab2-04f4ccbb52cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7060abc179094b93999584088c8e776a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:48Z,use_quota=True,user_id='a5e6e4e9ce4b4c9e82fb48b98cbaf73d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:39:50 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-f3046066-0002-4c37-928b-48ce704e7664 tempest-VolumesSnapshotTestJSON-130675119 None] Creating volume 77ce5316-e287-4515-8ab2-04f4ccbb52cd {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:39:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f3046066-0002-4c37-928b-48ce704e7664 tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f3046066-0002-4c37-928b-48ce704e7664 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:50 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f3046066-0002-4c37-928b-48ce704e7664 tempest-VolumesSnapshotTestJSON-130675119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:50 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f3046066-0002-4c37-928b-48ce704e7664 tempest-VolumesSnapshotTestJSON-130675119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f3046066-0002-4c37-928b-48ce704e7664 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:50 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f3046066-0002-4c37-928b-48ce704e7664 tempest-VolumesSnapshotTestJSON-130675119 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:39:50 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-f3046066-0002-4c37-928b-48ce704e7664 tempest-VolumesSnapshotTestJSON-130675119 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:39:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f3046066-0002-4c37-928b-48ce704e7664 tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:50 devstack sudo[103711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd 1073741824 Nov 02 12:39:50 devstack sudo[103711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:50 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2095bc10-eb3b-4a80-ad8b-5f91ae9ab48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89d5e5c9-f0cb-475d-8ab1-37826d9972f1', 'volume_size': 1, 'snapshot_id': '0f815291-209d-4606-a3bd-e676ba668b03'}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:50 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c2b5893-d92b-4667-b124-284dd45af0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:50 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Volume volume-89d5e5c9-f0cb-475d-8ab1-37826d9972f1 (89d5e5c9-f0cb-475d-8ab1-37826d9972f1): created successfully Nov 02 12:39:50 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c2b5893-d92b-4667-b124-284dd45af0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:50 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Flow 'volume_create_manager' (35c2353c-6107-4672-85b0-85d4c95c78b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:50 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-68924065-3b8e-4c77-b20e-8ea845656c00 tempest-VolumeDependencyTests-771631023 None] Created volume successfully. Nov 02 12:39:51 devstack sudo[103711]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f3046066-0002-4c37-928b-48ce704e7664 tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd 1073741824" returned: 0 in 0.381s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f3046066-0002-4c37-928b-48ce704e7664 tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:51 devstack sudo[103717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd Nov 02 12:39:51 devstack sudo[103717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:51 devstack sudo[103717]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f3046066-0002-4c37-928b-48ce704e7664 tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd" returned: 0 in 0.222s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:51 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f3046066-0002-4c37-928b-48ce704e7664 tempest-VolumesSnapshotTestJSON-130675119 None] <== create_volume: return (637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:39:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f3046066-0002-4c37-928b-48ce704e7664 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.640s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f3046066-0002-4c37-928b-48ce704e7664 tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6be29d5-24fa-41e2-ab15-8ba44f2ac328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f3046066-0002-4c37-928b-48ce704e7664 tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9816bf4-af87-464d-a110-44db2a5f3502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:51 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-f3046066-0002-4c37-928b-48ce704e7664 tempest-VolumesSnapshotTestJSON-130675119 None] Volume volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd (77ce5316-e287-4515-8ab2-04f4ccbb52cd): created successfully Nov 02 12:39:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f3046066-0002-4c37-928b-48ce704e7664 tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9816bf4-af87-464d-a110-44db2a5f3502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f3046066-0002-4c37-928b-48ce704e7664 tempest-VolumesSnapshotTestJSON-130675119 None] Flow 'volume_create_manager' (72a1735d-287a-43ee-923b-ef8130ea434a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:51 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-f3046066-0002-4c37-928b-48ce704e7664 tempest-VolumesSnapshotTestJSON-130675119 None] Created volume successfully. Nov 02 12:39:52 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-842285d9-acf5-412b-b758-0d4504a89a04 tempest-VolumeDependencyTests-771631023 None] Acquiring lock "cinder-0f815291-209d-4606-a3bd-e676ba668b03-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:52 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-842285d9-acf5-412b-b758-0d4504a89a04 tempest-VolumeDependencyTests-771631023 None] Lock "cinder-0f815291-209d-4606-a3bd-e676ba668b03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:52 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-842285d9-acf5-412b-b758-0d4504a89a04 tempest-VolumeDependencyTests-771631023 None] Acquiring lock "cinder-quobyte-5f380f92-f34e-49ba-992d-3aa77be97eda" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:52 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-842285d9-acf5-412b-b758-0d4504a89a04 tempest-VolumeDependencyTests-771631023 None] Lock "cinder-quobyte-5f380f92-f34e-49ba-992d-3aa77be97eda" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:52 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-842285d9-acf5-412b-b758-0d4504a89a04 tempest-VolumeDependencyTests-771631023 None] Acquiring lock "cinder-quobyte-0f815291-209d-4606-a3bd-e676ba668b03" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-19ac6b5b-0a33-42cd-9dc5-1c47fba1e32b tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-19ac6b5b-0a33-42cd-9dc5-1c47fba1e32b tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:52 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-842285d9-acf5-412b-b758-0d4504a89a04 tempest-VolumeDependencyTests-771631023 None] Lock "cinder-quobyte-0f815291-209d-4606-a3bd-e676ba668b03" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:52 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-842285d9-acf5-412b-b758-0d4504a89a04 tempest-VolumeDependencyTests-771631023 None] Deleting offline snapshot 0f815291-209d-4606-a3bd-e676ba668b03 of volume 5f380f92-f34e-49ba-992d-3aa77be97eda {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:39:52 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-842285d9-acf5-412b-b758-0d4504a89a04 tempest-VolumeDependencyTests-771631023 None] snapshot_file for this snap is: volume-5f380f92-f34e-49ba-992d-3aa77be97eda.0f815291-209d-4606-a3bd-e676ba668b03 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:39:52 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-19ac6b5b-0a33-42cd-9dc5-1c47fba1e32b tempest-VolumesSnapshotTestJSON-130675119 None] Creating offline snapshot c7c5ef44-038c-475a-886a-014281ae26c2 of volume 77ce5316-e287-4515-8ab2-04f4ccbb52cd {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:39:52 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0147fe-b80d-4877-9361-bfeab104a295]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-842285d9-acf5-412b-b758-0d4504a89a04 tempest-VolumeDependencyTests-771631023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda.0f815291-209d-4606-a3bd-e676ba668b03 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:52 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[677b8d11-4438-4e13-9d0d-4ff4dd5146de]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-19ac6b5b-0a33-42cd-9dc5-1c47fba1e32b tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:52 devstack sudo[103721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda.0f815291-209d-4606-a3bd-e676ba668b03 Nov 02 12:39:52 devstack sudo[103721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:52 devstack sudo[103722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd Nov 02 12:39:52 devstack sudo[103722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:52 devstack sudo[103721]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-842285d9-acf5-412b-b758-0d4504a89a04 tempest-VolumeDependencyTests-771631023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda.0f815291-209d-4606-a3bd-e676ba668b03" returned: 0 in 0.355s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:52 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-842285d9-acf5-412b-b758-0d4504a89a04 tempest-VolumeDependencyTests-771631023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f380f92-f34e-49ba-992d-3aa77be97eda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:39:52 devstack sudo[103722]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-19ac6b5b-0a33-42cd-9dc5-1c47fba1e32b tempest-VolumesSnapshotTestJSON-130675119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd" returned: 0 in 0.368s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-19ac6b5b-0a33-42cd-9dc5-1c47fba1e32b tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd.c7c5ef44-038c-475a-886a-014281ae26c2 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:52 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d468d271-7ee3-42c5-8266-e32e17d37078]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-842285d9-acf5-412b-b758-0d4504a89a04 tempest-VolumeDependencyTests-771631023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:52 devstack sudo[103731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd.c7c5ef44-038c-475a-886a-014281ae26c2 1G Nov 02 12:39:52 devstack sudo[103731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:52 devstack sudo[103732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda Nov 02 12:39:52 devstack sudo[103732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:52 devstack sudo[103731]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-19ac6b5b-0a33-42cd-9dc5-1c47fba1e32b tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd.c7c5ef44-038c-475a-886a-014281ae26c2 1G" returned: 0 in 0.389s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-19ac6b5b-0a33-42cd-9dc5-1c47fba1e32b tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd.c7c5ef44-038c-475a-886a-014281ae26c2 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:52 devstack sudo[103741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd.c7c5ef44-038c-475a-886a-014281ae26c2 Nov 02 12:39:52 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:53 devstack sudo[103732]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-842285d9-acf5-412b-b758-0d4504a89a04 tempest-VolumeDependencyTests-771631023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda" returned: 0 in 0.519s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-842285d9-acf5-412b-b758-0d4504a89a04 tempest-VolumeDependencyTests-771631023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda.0f815291-209d-4606-a3bd-e676ba668b03 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:53 devstack sudo[103744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda.0f815291-209d-4606-a3bd-e676ba668b03 Nov 02 12:39:53 devstack sudo[103744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:53 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-19ac6b5b-0a33-42cd-9dc5-1c47fba1e32b tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd.c7c5ef44-038c-475a-886a-014281ae26c2" returned: 0 in 0.290s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:53 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-19ac6b5b-0a33-42cd-9dc5-1c47fba1e32b tempest-VolumesSnapshotTestJSON-130675119 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd.c7c5ef44-038c-475a-886a-014281ae26c2 is being set with open permissions: ugo+rw Nov 02 12:39:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-19ac6b5b-0a33-42cd-9dc5-1c47fba1e32b tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd.c7c5ef44-038c-475a-886a-014281ae26c2 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:53 devstack sudo[103749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd.c7c5ef44-038c-475a-886a-014281ae26c2 Nov 02 12:39:53 devstack sudo[103749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:53 devstack sudo[103744]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-842285d9-acf5-412b-b758-0d4504a89a04 tempest-VolumeDependencyTests-771631023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda.0f815291-209d-4606-a3bd-e676ba668b03" returned: 0 in 0.328s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-842285d9-acf5-412b-b758-0d4504a89a04 tempest-VolumeDependencyTests-771631023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda.0f815291-209d-4606-a3bd-e676ba668b03 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:53 devstack sudo[103754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda.0f815291-209d-4606-a3bd-e676ba668b03 Nov 02 12:39:53 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:53 devstack sudo[103749]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-19ac6b5b-0a33-42cd-9dc5-1c47fba1e32b tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd.c7c5ef44-038c-475a-886a-014281ae26c2" returned: 0 in 0.248s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-19ac6b5b-0a33-42cd-9dc5-1c47fba1e32b tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:53 devstack sudo[103757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd.info Nov 02 12:39:53 devstack sudo[103757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:53 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-842285d9-acf5-412b-b758-0d4504a89a04 tempest-VolumeDependencyTests-771631023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda.0f815291-209d-4606-a3bd-e676ba668b03" returned: 0 in 0.235s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:53 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-842285d9-acf5-412b-b758-0d4504a89a04 tempest-VolumeDependencyTests-771631023 None] Lock "cinder-quobyte-0f815291-209d-4606-a3bd-e676ba668b03" released by "_delete_snapshot" :: held 1.556s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:53 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-842285d9-acf5-412b-b758-0d4504a89a04 tempest-VolumeDependencyTests-771631023 None] Lock "cinder-quobyte-5f380f92-f34e-49ba-992d-3aa77be97eda" released by "delete_snapshot" :: held 1.585s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:53 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-842285d9-acf5-412b-b758-0d4504a89a04 tempest-VolumeDependencyTests-771631023 None] Created reservations ['bbbd60d2-663c-4de2-9a24-15efd1341198', '4f926202-8dca-47b2-abff-8f9acd7595c3', '737faba3-4690-41ff-8022-7123f026cb3c', '58a9bf11-60b9-4f5b-a28e-0e329820d11b'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:39:53 devstack sudo[103757]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-19ac6b5b-0a33-42cd-9dc5-1c47fba1e32b tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd.info" returned: 0 in 0.261s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:53 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-19ac6b5b-0a33-42cd-9dc5-1c47fba1e32b tempest-VolumesSnapshotTestJSON-130675119 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd.info is being set with open permissions: ugo+rw Nov 02 12:39:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-19ac6b5b-0a33-42cd-9dc5-1c47fba1e32b tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:53 devstack sudo[103761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd.info Nov 02 12:39:53 devstack sudo[103761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:53 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-842285d9-acf5-412b-b758-0d4504a89a04 tempest-VolumeDependencyTests-771631023 None] Delete snapshot completed successfully. Nov 02 12:39:53 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-842285d9-acf5-412b-b758-0d4504a89a04 tempest-VolumeDependencyTests-771631023 None] Lock "cinder-0f815291-209d-4606-a3bd-e676ba668b03-delete_snapshot" released by "delete_snapshot" :: held 1.762s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:53 devstack sudo[103761]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-19ac6b5b-0a33-42cd-9dc5-1c47fba1e32b tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd.info" returned: 0 in 0.237s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-19ac6b5b-0a33-42cd-9dc5-1c47fba1e32b tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.895s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:53 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-19ac6b5b-0a33-42cd-9dc5-1c47fba1e32b tempest-VolumesSnapshotTestJSON-130675119 None] Create snapshot completed successfully Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-734e0d90-c4ef-4c6f-815c-d530c4146f9d tempest-VolumeDependencyTests-771631023 None] Acquiring lock "cinder-5f380f92-f34e-49ba-992d-3aa77be97eda-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-734e0d90-c4ef-4c6f-815c-d530c4146f9d tempest-VolumeDependencyTests-771631023 None] Lock "cinder-5f380f92-f34e-49ba-992d-3aa77be97eda-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-734e0d90-c4ef-4c6f-815c-d530c4146f9d tempest-VolumeDependencyTests-771631023 None] Acquiring lock "cinder-quobyte-5f380f92-f34e-49ba-992d-3aa77be97eda" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-734e0d90-c4ef-4c6f-815c-d530c4146f9d tempest-VolumeDependencyTests-771631023 None] Lock "cinder-quobyte-5f380f92-f34e-49ba-992d-3aa77be97eda" acquired by "delete_volume" :: waited 0.017s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dce6d80-f754-428d-91a4-869bda058b45]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-734e0d90-c4ef-4c6f-815c-d530c4146f9d tempest-VolumeDependencyTests-771631023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:54 devstack sudo[103764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda Nov 02 12:39:54 devstack sudo[103764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:54 devstack sudo[103764]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-734e0d90-c4ef-4c6f-815c-d530c4146f9d tempest-VolumeDependencyTests-771631023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda" returned: 0 in 0.366s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-734e0d90-c4ef-4c6f-815c-d530c4146f9d tempest-VolumeDependencyTests-771631023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:54 devstack sudo[103769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda Nov 02 12:39:54 devstack sudo[103769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Flow 'volume_create_manager' (6a79854f-62c5-4758-a67d-a99e669abfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a1c01c-9b14-484f-81fe-ae6490d1e455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a1c01c-9b14-484f-81fe-ae6490d1e455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1393534164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=288c4fcf-a5b6-4b07-a8ec-3ea93feec194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7060abc179094b93999584088c8e776a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c7c5ef44-038c-475a-886a-014281ae26c2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:39:55Z,use_quota=True,user_id='a5e6e4e9ce4b4c9e82fb48b98cbaf73d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f9bc0c4-9c60-4391-9d94-aad3ba0dc208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f9bc0c4-9c60-4391-9d94-aad3ba0dc208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe4be1dd-2cc3-4a1f-926a-0011cd1c3ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe4be1dd-2cc3-4a1f-926a-0011cd1c3ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '288c4fcf-a5b6-4b07-a8ec-3ea93feec194', 'volume_name': 'volume-288c4fcf-a5b6-4b07-a8ec-3ea93feec194', 'volume_size': 1, 'snapshot_id': 'c7c5ef44-038c-475a-886a-014281ae26c2'}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98de6e39-6c1d-47a0-bad5-7fe4bb820f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98de6e39-6c1d-47a0-bad5-7fe4bb820f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54718640-6c91-434e-a83e-ea832207078f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:39:54 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Volume 288c4fcf-a5b6-4b07-a8ec-3ea93feec194: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-288c4fcf-a5b6-4b07-a8ec-3ea93feec194', 'volume_size': 1, 'snapshot_id': 'c7c5ef44-038c-475a-886a-014281ae26c2'} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "cinder-quobyte-c7c5ef44-038c-475a-886a-014281ae26c2-288c4fcf-a5b6-4b07-a8ec-3ea93feec194" by "_create_volume_from_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-quobyte-c7c5ef44-038c-475a-886a-014281ae26c2-288c4fcf-a5b6-4b07-a8ec-3ea93feec194" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Creating volume 288c4fcf-a5b6-4b07-a8ec-3ea93feec194 from snapshot c7c5ef44-038c-475a-886a-014281ae26c2 {{(pid=86515) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "cinder-quobyte-288c4fcf-a5b6-4b07-a8ec-3ea93feec194" by "_copy_volume_from_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-quobyte-288c4fcf-a5b6-4b07-a8ec-3ea93feec194" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] snapshot: c7c5ef44-038c-475a-886a-014281ae26c2, volume: 288c4fcf-a5b6-4b07-a8ec-3ea93feec194, {{(pid=86515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 12:39:54 devstack sudo[103769]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-734e0d90-c4ef-4c6f-815c-d530c4146f9d tempest-VolumeDependencyTests-771631023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5f380f92-f34e-49ba-992d-3aa77be97eda" returned: 0 in 0.256s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[818d1fe8-c1c0-4645-a5b0-c8621098e90b]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd.c7c5ef44-038c-475a-886a-014281ae26c2 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-734e0d90-c4ef-4c6f-815c-d530c4146f9d tempest-VolumeDependencyTests-771631023 None] Lock "cinder-quobyte-5f380f92-f34e-49ba-992d-3aa77be97eda" released by "delete_volume" :: held 0.695s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:54 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-734e0d90-c4ef-4c6f-815c-d530c4146f9d tempest-VolumeDependencyTests-771631023 None] Created reservations ['07082a9f-6301-4466-ada4-31c9761a2018', 'b228241d-7034-4b04-8340-6f99b8f5afb2', '7dfb97c3-a5ce-4590-9baf-0dbe2573c2c5', 'ebe65e51-e0cb-4f34-bb71-3f597e913852'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:39:55 devstack sudo[103772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd.c7c5ef44-038c-475a-886a-014281ae26c2 Nov 02 12:39:55 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-734e0d90-c4ef-4c6f-815c-d530c4146f9d tempest-VolumeDependencyTests-771631023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-734e0d90-c4ef-4c6f-815c-d530c4146f9d tempest-VolumeDependencyTests-771631023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:55 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-734e0d90-c4ef-4c6f-815c-d530c4146f9d tempest-VolumeDependencyTests-771631023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:55 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-734e0d90-c4ef-4c6f-815c-d530c4146f9d tempest-VolumeDependencyTests-771631023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-734e0d90-c4ef-4c6f-815c-d530c4146f9d tempest-VolumeDependencyTests-771631023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-734e0d90-c4ef-4c6f-815c-d530c4146f9d tempest-VolumeDependencyTests-771631023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:55 devstack sudo[103774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:39:55 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:55 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd.c7c5ef44-038c-475a-886a-014281ae26c2" returned: 0 in 0.392s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:55 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:39:55 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c68f92-af6d-42d2-ad86-58a0da6310f8]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:55 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-01c460cd-6b71-4232-b3ae-2d83dad0e824 tempest-VolumeDependencyTests-771631023 None] Acquiring lock "cinder-89d5e5c9-f0cb-475d-8ab1-37826d9972f1-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:55 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-734e0d90-c4ef-4c6f-815c-d530c4146f9d tempest-VolumeDependencyTests-771631023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.316s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:55 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-734e0d90-c4ef-4c6f-815c-d530c4146f9d tempest-VolumeDependencyTests-771631023 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:39:55 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-01c460cd-6b71-4232-b3ae-2d83dad0e824 tempest-VolumeDependencyTests-771631023 None] Lock "cinder-89d5e5c9-f0cb-475d-8ab1-37826d9972f1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:55 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-734e0d90-c4ef-4c6f-815c-d530c4146f9d tempest-VolumeDependencyTests-771631023 None] Deleted volume successfully. Nov 02 12:39:55 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-734e0d90-c4ef-4c6f-815c-d530c4146f9d tempest-VolumeDependencyTests-771631023 None] Lock "cinder-5f380f92-f34e-49ba-992d-3aa77be97eda-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:55 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-01c460cd-6b71-4232-b3ae-2d83dad0e824 tempest-VolumeDependencyTests-771631023 None] Acquiring lock "cinder-quobyte-89d5e5c9-f0cb-475d-8ab1-37826d9972f1" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:39:55 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-01c460cd-6b71-4232-b3ae-2d83dad0e824 tempest-VolumeDependencyTests-771631023 None] Lock "cinder-quobyte-89d5e5c9-f0cb-475d-8ab1-37826d9972f1" acquired by "delete_volume" :: waited 0.016s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:39:55 devstack sudo[103780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd Nov 02 12:39:55 devstack sudo[103780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:55 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0f8786-1126-4e3f-bc6e-9a2703b2ed1b]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:39:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-01c460cd-6b71-4232-b3ae-2d83dad0e824 tempest-VolumeDependencyTests-771631023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-89d5e5c9-f0cb-475d-8ab1-37826d9972f1 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:55 devstack sudo[103782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-89d5e5c9-f0cb-475d-8ab1-37826d9972f1 Nov 02 12:39:55 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:55 devstack sudo[103780]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd" returned: 0 in 0.379s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:55 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] will copy from snapshot at /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd {{(pid=86515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 12:39:55 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Creating direct copy from snapshot {{(pid=86515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 12:39:55 devstack cinder-volume[86515]: DEBUG cinder.utils [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Path /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-288c4fcf-a5b6-4b07-a8ec-3ea93feec194 not found in is_blk_device check {{(pid=86515) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 12:39:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-288c4fcf-a5b6-4b07-a8ec-3ea93feec194 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:55 devstack sudo[103787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-288c4fcf-a5b6-4b07-a8ec-3ea93feec194 Nov 02 12:39:55 devstack sudo[103787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:55 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-01c460cd-6b71-4232-b3ae-2d83dad0e824 tempest-VolumeDependencyTests-771631023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-89d5e5c9-f0cb-475d-8ab1-37826d9972f1" returned: 0 in 0.367s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-01c460cd-6b71-4232-b3ae-2d83dad0e824 tempest-VolumeDependencyTests-771631023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-89d5e5c9-f0cb-475d-8ab1-37826d9972f1 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:55 devstack sudo[103792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-89d5e5c9-f0cb-475d-8ab1-37826d9972f1 Nov 02 12:39:55 devstack sudo[103792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:56 devstack sudo[103792]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-01c460cd-6b71-4232-b3ae-2d83dad0e824 tempest-VolumeDependencyTests-771631023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-89d5e5c9-f0cb-475d-8ab1-37826d9972f1" returned: 0 in 0.272s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:56 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-01c460cd-6b71-4232-b3ae-2d83dad0e824 tempest-VolumeDependencyTests-771631023 None] Lock "cinder-quobyte-89d5e5c9-f0cb-475d-8ab1-37826d9972f1" released by "delete_volume" :: held 0.698s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:39:56 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-01c460cd-6b71-4232-b3ae-2d83dad0e824 tempest-VolumeDependencyTests-771631023 None] Created reservations ['64f5c54b-e5a8-40ee-ba60-ab690c1f8718', '7f479076-70b7-48a3-9487-35d4be4dc8d9', '5a4ddd9e-a451-4b21-817e-64d6da8829d8', '048a7c75-660e-4951-b38b-412b0196db73'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:39:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-01c460cd-6b71-4232-b3ae-2d83dad0e824 tempest-VolumeDependencyTests-771631023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:39:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-01c460cd-6b71-4232-b3ae-2d83dad0e824 tempest-VolumeDependencyTests-771631023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:39:56 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-01c460cd-6b71-4232-b3ae-2d83dad0e824 tempest-VolumeDependencyTests-771631023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:39:56 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-01c460cd-6b71-4232-b3ae-2d83dad0e824 tempest-VolumeDependencyTests-771631023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:39:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-01c460cd-6b71-4232-b3ae-2d83dad0e824 tempest-VolumeDependencyTests-771631023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:39:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-01c460cd-6b71-4232-b3ae-2d83dad0e824 tempest-VolumeDependencyTests-771631023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:39:56 devstack sudo[103805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:39:56 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:39:56 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root Nov 02 12:39:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-01c460cd-6b71-4232-b3ae-2d83dad0e824 tempest-VolumeDependencyTests-771631023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.492s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:39:56 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-01c460cd-6b71-4232-b3ae-2d83dad0e824 tempest-VolumeDependencyTests-771631023 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:39:56 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-01c460cd-6b71-4232-b3ae-2d83dad0e824 tempest-VolumeDependencyTests-771631023 None] Deleted volume successfully. Nov 02 12:39:56 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-01c460cd-6b71-4232-b3ae-2d83dad0e824 tempest-VolumeDependencyTests-771631023 None] Lock "cinder-89d5e5c9-f0cb-475d-8ab1-37826d9972f1-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:40:01 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e8a98ea-8f1e-4fd8-9508-d8f553259287 tempest-CinderUnicodeTest-755315141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:40:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2e8a98ea-8f1e-4fd8-9508-d8f553259287 tempest-CinderUnicodeTest-755315141 None] Flow 'volume_create_manager' (2687b39d-17b5-4f05-b016-0c551c9c3726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:40:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2e8a98ea-8f1e-4fd8-9508-d8f553259287 tempest-CinderUnicodeTest-755315141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b06e6582-a11f-40f8-99d4-d63f8b740052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2e8a98ea-8f1e-4fd8-9508-d8f553259287 tempest-CinderUnicodeTest-755315141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b06e6582-a11f-40f8-99d4-d63f8b740052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=928e7b05-1f3b-4c73-8190-dc5dd4788fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d14adaf3e3f745dfa6ff5b8d1e2ddf6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:40:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:40:02Z,use_quota=True,user_id='f640c2f6e847436eacaf9929e2f0bd2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2e8a98ea-8f1e-4fd8-9508-d8f553259287 tempest-CinderUnicodeTest-755315141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d8e2a4-bb10-4b03-a19c-882637751cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2e8a98ea-8f1e-4fd8-9508-d8f553259287 tempest-CinderUnicodeTest-755315141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d8e2a4-bb10-4b03-a19c-882637751cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2e8a98ea-8f1e-4fd8-9508-d8f553259287 tempest-CinderUnicodeTest-755315141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa84594a-71bd-4693-a678-d8aaf48a2467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2e8a98ea-8f1e-4fd8-9508-d8f553259287 tempest-CinderUnicodeTest-755315141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa84594a-71bd-4693-a678-d8aaf48a2467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '928e7b05-1f3b-4c73-8190-dc5dd4788fd1', 'volume_name': 'volume-928e7b05-1f3b-4c73-8190-dc5dd4788fd1', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2e8a98ea-8f1e-4fd8-9508-d8f553259287 tempest-CinderUnicodeTest-755315141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4202869c-88eb-48d5-9f4d-6c0d79c3f44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2e8a98ea-8f1e-4fd8-9508-d8f553259287 tempest-CinderUnicodeTest-755315141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4202869c-88eb-48d5-9f4d-6c0d79c3f44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2e8a98ea-8f1e-4fd8-9508-d8f553259287 tempest-CinderUnicodeTest-755315141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f730b04-4a83-4ba1-a0b6-e5c30684a98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:01 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-2e8a98ea-8f1e-4fd8-9508-d8f553259287 tempest-CinderUnicodeTest-755315141 None] Volume 928e7b05-1f3b-4c73-8190-dc5dd4788fd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-928e7b05-1f3b-4c73-8190-dc5dd4788fd1', 'volume_size': 1} Nov 02 12:40:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2e8a98ea-8f1e-4fd8-9508-d8f553259287 tempest-CinderUnicodeTest-755315141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:02 devstack sudo[103787]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-288c4fcf-a5b6-4b07-a8ec-3ea93feec194" returned: 0 in 7.017s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:02 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Image conversion details: src /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd, size 1024.00 MB, duration 7.02 sec, destination /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-288c4fcf-a5b6-4b07-a8ec-3ea93feec194 {{(pid=86515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 12:40:02 devstack cinder-volume[86515]: INFO cinder.image.image_utils [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Converted 1024.00 MB image at 145.92 MB/s Nov 02 12:40:02 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-288c4fcf-a5b6-4b07-a8ec-3ea93feec194 is being set with open permissions: ugo+rw Nov 02 12:40:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-288c4fcf-a5b6-4b07-a8ec-3ea93feec194 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:02 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-288c4fcf-a5b6-4b07-a8ec-3ea93feec194 Nov 02 12:40:02 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:02 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-288c4fcf-a5b6-4b07-a8ec-3ea93feec194" returned: 0 in 0.239s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:02 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-quobyte-288c4fcf-a5b6-4b07-a8ec-3ea93feec194" released by "_copy_volume_from_snapshot" :: held 8.111s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:40:03 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-quobyte-c7c5ef44-038c-475a-886a-014281ae26c2-288c4fcf-a5b6-4b07-a8ec-3ea93feec194" released by "_create_volume_from_snapshot" :: held 8.182s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:40:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.198s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2e8a98ea-8f1e-4fd8-9508-d8f553259287 tempest-CinderUnicodeTest-755315141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.066s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:03 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-2e8a98ea-8f1e-4fd8-9508-d8f553259287 tempest-CinderUnicodeTest-755315141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=928e7b05-1f3b-4c73-8190-dc5dd4788fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d14adaf3e3f745dfa6ff5b8d1e2ddf6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:40:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:40:02Z,use_quota=True,user_id='f640c2f6e847436eacaf9929e2f0bd2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:40:03 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-2e8a98ea-8f1e-4fd8-9508-d8f553259287 tempest-CinderUnicodeTest-755315141 None] Creating volume 928e7b05-1f3b-4c73-8190-dc5dd4788fd1 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:40:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2e8a98ea-8f1e-4fd8-9508-d8f553259287 tempest-CinderUnicodeTest-755315141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2e8a98ea-8f1e-4fd8-9508-d8f553259287 tempest-CinderUnicodeTest-755315141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:03 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-2e8a98ea-8f1e-4fd8-9508-d8f553259287 tempest-CinderUnicodeTest-755315141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:40:03 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-2e8a98ea-8f1e-4fd8-9508-d8f553259287 tempest-CinderUnicodeTest-755315141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:40:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2e8a98ea-8f1e-4fd8-9508-d8f553259287 tempest-CinderUnicodeTest-755315141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:03 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-2e8a98ea-8f1e-4fd8-9508-d8f553259287 tempest-CinderUnicodeTest-755315141 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:40:03 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-2e8a98ea-8f1e-4fd8-9508-d8f553259287 tempest-CinderUnicodeTest-755315141 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:40:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2e8a98ea-8f1e-4fd8-9508-d8f553259287 tempest-CinderUnicodeTest-755315141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-928e7b05-1f3b-4c73-8190-dc5dd4788fd1 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:03 devstack sudo[103818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-928e7b05-1f3b-4c73-8190-dc5dd4788fd1 1073741824 Nov 02 12:40:03 devstack sudo[103818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54718640-6c91-434e-a83e-ea832207078f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-288c4fcf-a5b6-4b07-a8ec-3ea93feec194', 'volume_size': 1, 'snapshot_id': 'c7c5ef44-038c-475a-886a-014281ae26c2'}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a0fed49-15e7-4622-8545-072d17b319a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:03 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Volume volume-288c4fcf-a5b6-4b07-a8ec-3ea93feec194 (288c4fcf-a5b6-4b07-a8ec-3ea93feec194): created successfully Nov 02 12:40:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a0fed49-15e7-4622-8545-072d17b319a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Flow 'volume_create_manager' (6a79854f-62c5-4758-a67d-a99e669abfd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:40:03 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-35e3e1c3-7b39-4364-b55f-6898c2aa2872 tempest-VolumesSnapshotTestJSON-130675119 None] Created volume successfully. Nov 02 12:40:03 devstack sudo[103818]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2e8a98ea-8f1e-4fd8-9508-d8f553259287 tempest-CinderUnicodeTest-755315141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-928e7b05-1f3b-4c73-8190-dc5dd4788fd1 1073741824" returned: 0 in 0.439s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2e8a98ea-8f1e-4fd8-9508-d8f553259287 tempest-CinderUnicodeTest-755315141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-928e7b05-1f3b-4c73-8190-dc5dd4788fd1 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:03 devstack sudo[103823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-928e7b05-1f3b-4c73-8190-dc5dd4788fd1 Nov 02 12:40:03 devstack sudo[103823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:03 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-988ef53c-9105-4128-9b44-0e503b397ff1 tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "cinder-288c4fcf-a5b6-4b07-a8ec-3ea93feec194-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:40:03 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-988ef53c-9105-4128-9b44-0e503b397ff1 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-288c4fcf-a5b6-4b07-a8ec-3ea93feec194-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:40:03 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-988ef53c-9105-4128-9b44-0e503b397ff1 tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "cinder-quobyte-288c4fcf-a5b6-4b07-a8ec-3ea93feec194" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:40:03 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-988ef53c-9105-4128-9b44-0e503b397ff1 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-quobyte-288c4fcf-a5b6-4b07-a8ec-3ea93feec194" acquired by "delete_volume" :: waited 0.024s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:40:03 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a9defe-7f7b-4a00-a0c9-e255b0712024]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:40:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-988ef53c-9105-4128-9b44-0e503b397ff1 tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-288c4fcf-a5b6-4b07-a8ec-3ea93feec194 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:03 devstack sudo[103825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-288c4fcf-a5b6-4b07-a8ec-3ea93feec194 Nov 02 12:40:03 devstack sudo[103825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:03 devstack sudo[103823]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2e8a98ea-8f1e-4fd8-9508-d8f553259287 tempest-CinderUnicodeTest-755315141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-928e7b05-1f3b-4c73-8190-dc5dd4788fd1" returned: 0 in 0.263s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:03 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-2e8a98ea-8f1e-4fd8-9508-d8f553259287 tempest-CinderUnicodeTest-755315141 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:40:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2e8a98ea-8f1e-4fd8-9508-d8f553259287 tempest-CinderUnicodeTest-755315141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2e8a98ea-8f1e-4fd8-9508-d8f553259287 tempest-CinderUnicodeTest-755315141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f730b04-4a83-4ba1-a0b6-e5c30684a98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-928e7b05-1f3b-4c73-8190-dc5dd4788fd1', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2e8a98ea-8f1e-4fd8-9508-d8f553259287 tempest-CinderUnicodeTest-755315141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3118c8c-c5d0-47c8-bbd0-f8626402a771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:03 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-2e8a98ea-8f1e-4fd8-9508-d8f553259287 tempest-CinderUnicodeTest-755315141 None] Volume volume-928e7b05-1f3b-4c73-8190-dc5dd4788fd1 (928e7b05-1f3b-4c73-8190-dc5dd4788fd1): created successfully Nov 02 12:40:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2e8a98ea-8f1e-4fd8-9508-d8f553259287 tempest-CinderUnicodeTest-755315141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3118c8c-c5d0-47c8-bbd0-f8626402a771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2e8a98ea-8f1e-4fd8-9508-d8f553259287 tempest-CinderUnicodeTest-755315141 None] Flow 'volume_create_manager' (2687b39d-17b5-4f05-b016-0c551c9c3726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:40:03 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-2e8a98ea-8f1e-4fd8-9508-d8f553259287 tempest-CinderUnicodeTest-755315141 None] Created volume successfully. Nov 02 12:40:04 devstack sudo[103825]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-988ef53c-9105-4128-9b44-0e503b397ff1 tempest-VolumesSnapshotTestJSON-130675119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-288c4fcf-a5b6-4b07-a8ec-3ea93feec194" returned: 0 in 0.366s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-988ef53c-9105-4128-9b44-0e503b397ff1 tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-288c4fcf-a5b6-4b07-a8ec-3ea93feec194 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:04 devstack sudo[103831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-288c4fcf-a5b6-4b07-a8ec-3ea93feec194 Nov 02 12:40:04 devstack sudo[103831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:04 devstack sudo[103831]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-988ef53c-9105-4128-9b44-0e503b397ff1 tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-288c4fcf-a5b6-4b07-a8ec-3ea93feec194" returned: 0 in 0.238s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:04 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-988ef53c-9105-4128-9b44-0e503b397ff1 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-quobyte-288c4fcf-a5b6-4b07-a8ec-3ea93feec194" released by "delete_volume" :: held 0.649s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:40:04 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-988ef53c-9105-4128-9b44-0e503b397ff1 tempest-VolumesSnapshotTestJSON-130675119 None] Created reservations ['db8c00a1-8cb1-4fb2-846a-49d286b83eb1', 'dc5150bc-f9be-4ceb-be5b-dbb8df73e927', 'c9f8bbed-b646-4ff5-94a2-3569de483015', 'f617b25e-0e39-4ac1-a8a5-dc44d13b5694'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:40:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-988ef53c-9105-4128-9b44-0e503b397ff1 tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-988ef53c-9105-4128-9b44-0e503b397ff1 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:04 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-988ef53c-9105-4128-9b44-0e503b397ff1 tempest-VolumesSnapshotTestJSON-130675119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:40:04 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-988ef53c-9105-4128-9b44-0e503b397ff1 tempest-VolumesSnapshotTestJSON-130675119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:40:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-988ef53c-9105-4128-9b44-0e503b397ff1 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-988ef53c-9105-4128-9b44-0e503b397ff1 tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:04 devstack sudo[103834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:40:04 devstack sudo[103834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:04 devstack sudo[103834]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-988ef53c-9105-4128-9b44-0e503b397ff1 tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.275s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:04 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-988ef53c-9105-4128-9b44-0e503b397ff1 tempest-VolumesSnapshotTestJSON-130675119 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:40:04 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-988ef53c-9105-4128-9b44-0e503b397ff1 tempest-VolumesSnapshotTestJSON-130675119 None] Deleted volume successfully. Nov 02 12:40:04 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-988ef53c-9105-4128-9b44-0e503b397ff1 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-288c4fcf-a5b6-4b07-a8ec-3ea93feec194-delete_volume" released by "delete_volume" :: held 1.126s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:40:04 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0a278026-ddc1-4597-9546-015347edd200 tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "cinder-c7c5ef44-038c-475a-886a-014281ae26c2-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:40:04 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0a278026-ddc1-4597-9546-015347edd200 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-c7c5ef44-038c-475a-886a-014281ae26c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:40:04 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0a278026-ddc1-4597-9546-015347edd200 tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "cinder-quobyte-77ce5316-e287-4515-8ab2-04f4ccbb52cd" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:40:04 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0a278026-ddc1-4597-9546-015347edd200 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-quobyte-77ce5316-e287-4515-8ab2-04f4ccbb52cd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:40:04 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0a278026-ddc1-4597-9546-015347edd200 tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "cinder-quobyte-c7c5ef44-038c-475a-886a-014281ae26c2" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:40:04 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0a278026-ddc1-4597-9546-015347edd200 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-quobyte-c7c5ef44-038c-475a-886a-014281ae26c2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:40:04 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-0a278026-ddc1-4597-9546-015347edd200 tempest-VolumesSnapshotTestJSON-130675119 None] Deleting offline snapshot c7c5ef44-038c-475a-886a-014281ae26c2 of volume 77ce5316-e287-4515-8ab2-04f4ccbb52cd {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:40:04 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-0a278026-ddc1-4597-9546-015347edd200 tempest-VolumesSnapshotTestJSON-130675119 None] snapshot_file for this snap is: volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd.c7c5ef44-038c-475a-886a-014281ae26c2 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:40:04 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[53624d36-b406-443e-9a2a-8d53b12ec5fc]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:40:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0a278026-ddc1-4597-9546-015347edd200 tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd.c7c5ef44-038c-475a-886a-014281ae26c2 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:04 devstack sudo[103837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd.c7c5ef44-038c-475a-886a-014281ae26c2 Nov 02 12:40:04 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:05 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0a278026-ddc1-4597-9546-015347edd200 tempest-VolumesSnapshotTestJSON-130675119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd.c7c5ef44-038c-475a-886a-014281ae26c2" returned: 0 in 0.421s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:05 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-0a278026-ddc1-4597-9546-015347edd200 tempest-VolumesSnapshotTestJSON-130675119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:40:05 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b657114-db14-454e-b817-64cf685c2326]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:40:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0a278026-ddc1-4597-9546-015347edd200 tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:05 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eea3919-002b-4ab8-9938-100738de3562 tempest-CinderUnicodeTest-755315141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:40:05 devstack sudo[103842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd Nov 02 12:40:05 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0eea3919-002b-4ab8-9938-100738de3562 tempest-CinderUnicodeTest-755315141 None] Flow 'volume_create_manager' (20ab3881-e286-4f32-8fe7-6a50e50999ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:40:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0eea3919-002b-4ab8-9938-100738de3562 tempest-CinderUnicodeTest-755315141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce1fe423-9f6b-413d-a12f-5b4813ae13ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0eea3919-002b-4ab8-9938-100738de3562 tempest-CinderUnicodeTest-755315141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce1fe423-9f6b-413d-a12f-5b4813ae13ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:40:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-921921413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35516dda-4142-41f8-9ddb-e3e8fcca60f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d14adaf3e3f745dfa6ff5b8d1e2ddf6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:40:05Z,use_quota=True,user_id='f640c2f6e847436eacaf9929e2f0bd2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0eea3919-002b-4ab8-9938-100738de3562 tempest-CinderUnicodeTest-755315141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da916c91-3ca4-4926-83b3-aaade1590be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0eea3919-002b-4ab8-9938-100738de3562 tempest-CinderUnicodeTest-755315141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da916c91-3ca4-4926-83b3-aaade1590be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0eea3919-002b-4ab8-9938-100738de3562 tempest-CinderUnicodeTest-755315141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36063b7e-1823-4380-aba9-1e25d8e50490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0eea3919-002b-4ab8-9938-100738de3562 tempest-CinderUnicodeTest-755315141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36063b7e-1823-4380-aba9-1e25d8e50490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35516dda-4142-41f8-9ddb-e3e8fcca60f1', 'volume_name': 'volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0eea3919-002b-4ab8-9938-100738de3562 tempest-CinderUnicodeTest-755315141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3daa0305-7c6f-45d4-a3fe-3c3d5fc423c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0eea3919-002b-4ab8-9938-100738de3562 tempest-CinderUnicodeTest-755315141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3daa0305-7c6f-45d4-a3fe-3c3d5fc423c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0eea3919-002b-4ab8-9938-100738de3562 tempest-CinderUnicodeTest-755315141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0867f075-09e4-40c4-8f52-cb3090946341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:05 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-0eea3919-002b-4ab8-9938-100738de3562 tempest-CinderUnicodeTest-755315141 None] Volume 35516dda-4142-41f8-9ddb-e3e8fcca60f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1', 'volume_size': 1} Nov 02 12:40:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0eea3919-002b-4ab8-9938-100738de3562 tempest-CinderUnicodeTest-755315141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0eea3919-002b-4ab8-9938-100738de3562 tempest-CinderUnicodeTest-755315141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:05 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0eea3919-002b-4ab8-9938-100738de3562 tempest-CinderUnicodeTest-755315141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:40:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-921921413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35516dda-4142-41f8-9ddb-e3e8fcca60f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d14adaf3e3f745dfa6ff5b8d1e2ddf6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:40:05Z,use_quota=True,user_id='f640c2f6e847436eacaf9929e2f0bd2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:40:05 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-0eea3919-002b-4ab8-9938-100738de3562 tempest-CinderUnicodeTest-755315141 None] Creating volume 35516dda-4142-41f8-9ddb-e3e8fcca60f1 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:40:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0eea3919-002b-4ab8-9938-100738de3562 tempest-CinderUnicodeTest-755315141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0eea3919-002b-4ab8-9938-100738de3562 tempest-CinderUnicodeTest-755315141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:05 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0eea3919-002b-4ab8-9938-100738de3562 tempest-CinderUnicodeTest-755315141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:40:05 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0eea3919-002b-4ab8-9938-100738de3562 tempest-CinderUnicodeTest-755315141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:40:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0eea3919-002b-4ab8-9938-100738de3562 tempest-CinderUnicodeTest-755315141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:05 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0eea3919-002b-4ab8-9938-100738de3562 tempest-CinderUnicodeTest-755315141 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:40:05 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-0eea3919-002b-4ab8-9938-100738de3562 tempest-CinderUnicodeTest-755315141 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:40:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0eea3919-002b-4ab8-9938-100738de3562 tempest-CinderUnicodeTest-755315141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:05 devstack sudo[103844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1 1073741824 Nov 02 12:40:05 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:05 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0a278026-ddc1-4597-9546-015347edd200 tempest-VolumesSnapshotTestJSON-130675119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd" returned: 0 in 0.571s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0a278026-ddc1-4597-9546-015347edd200 tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd.c7c5ef44-038c-475a-886a-014281ae26c2 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:05 devstack sudo[103852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd.c7c5ef44-038c-475a-886a-014281ae26c2 Nov 02 12:40:05 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:06 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0eea3919-002b-4ab8-9938-100738de3562 tempest-CinderUnicodeTest-755315141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1 1073741824" returned: 0 in 0.491s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0eea3919-002b-4ab8-9938-100738de3562 tempest-CinderUnicodeTest-755315141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:06 devstack sudo[103854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1 Nov 02 12:40:06 devstack sudo[103854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:06 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0a278026-ddc1-4597-9546-015347edd200 tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd.c7c5ef44-038c-475a-886a-014281ae26c2" returned: 0 in 0.401s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0a278026-ddc1-4597-9546-015347edd200 tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd.c7c5ef44-038c-475a-886a-014281ae26c2 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:06 devstack sudo[103859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd.c7c5ef44-038c-475a-886a-014281ae26c2 Nov 02 12:40:06 devstack sudo[103859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:06 devstack sudo[103854]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0eea3919-002b-4ab8-9938-100738de3562 tempest-CinderUnicodeTest-755315141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1" returned: 0 in 0.304s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:06 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0eea3919-002b-4ab8-9938-100738de3562 tempest-CinderUnicodeTest-755315141 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:40:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0eea3919-002b-4ab8-9938-100738de3562 tempest-CinderUnicodeTest-755315141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:06 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0eea3919-002b-4ab8-9938-100738de3562 tempest-CinderUnicodeTest-755315141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0867f075-09e4-40c4-8f52-cb3090946341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:06 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0eea3919-002b-4ab8-9938-100738de3562 tempest-CinderUnicodeTest-755315141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (575486c3-7c8f-4ce6-a89f-cda146f9a850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:06 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-0eea3919-002b-4ab8-9938-100738de3562 tempest-CinderUnicodeTest-755315141 None] Volume volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1 (35516dda-4142-41f8-9ddb-e3e8fcca60f1): created successfully Nov 02 12:40:06 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0eea3919-002b-4ab8-9938-100738de3562 tempest-CinderUnicodeTest-755315141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (575486c3-7c8f-4ce6-a89f-cda146f9a850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:06 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0eea3919-002b-4ab8-9938-100738de3562 tempest-CinderUnicodeTest-755315141 None] Flow 'volume_create_manager' (20ab3881-e286-4f32-8fe7-6a50e50999ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:40:06 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-0eea3919-002b-4ab8-9938-100738de3562 tempest-CinderUnicodeTest-755315141 None] Created volume successfully. Nov 02 12:40:06 devstack sudo[103859]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0a278026-ddc1-4597-9546-015347edd200 tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd.c7c5ef44-038c-475a-886a-014281ae26c2" returned: 0 in 0.281s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:06 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0a278026-ddc1-4597-9546-015347edd200 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-quobyte-c7c5ef44-038c-475a-886a-014281ae26c2" released by "_delete_snapshot" :: held 1.783s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:40:06 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0a278026-ddc1-4597-9546-015347edd200 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-quobyte-77ce5316-e287-4515-8ab2-04f4ccbb52cd" released by "delete_snapshot" :: held 1.807s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:40:06 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-0a278026-ddc1-4597-9546-015347edd200 tempest-VolumesSnapshotTestJSON-130675119 None] Created reservations ['bdcf35f8-00c9-48d3-82a4-9656ae17608e', 'da48f201-4e91-460e-a89d-e67d4ce7e5ec', '94fee0cc-75a2-4bcf-b972-d921ce9bdd39', '42534ada-4801-4abb-8d27-3d1d7380f3f5'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:40:06 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-0a278026-ddc1-4597-9546-015347edd200 tempest-VolumesSnapshotTestJSON-130675119 None] Delete snapshot completed successfully. Nov 02 12:40:06 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0a278026-ddc1-4597-9546-015347edd200 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-c7c5ef44-038c-475a-886a-014281ae26c2-delete_snapshot" released by "delete_snapshot" :: held 1.951s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:40:07 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-31377c8b-f58a-4184-a4e0-2d5e9a677c42 tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "cinder-77ce5316-e287-4515-8ab2-04f4ccbb52cd-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:40:07 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-31377c8b-f58a-4184-a4e0-2d5e9a677c42 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-77ce5316-e287-4515-8ab2-04f4ccbb52cd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:40:07 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-31377c8b-f58a-4184-a4e0-2d5e9a677c42 tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "cinder-quobyte-77ce5316-e287-4515-8ab2-04f4ccbb52cd" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:40:07 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-31377c8b-f58a-4184-a4e0-2d5e9a677c42 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-quobyte-77ce5316-e287-4515-8ab2-04f4ccbb52cd" acquired by "delete_volume" :: waited 0.013s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:40:07 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[282c4eb5-6c57-4725-8663-5018ab4c8962]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:40:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-31377c8b-f58a-4184-a4e0-2d5e9a677c42 tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:07 devstack sudo[103863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd Nov 02 12:40:07 devstack sudo[103863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:07 devstack sudo[103863]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-31377c8b-f58a-4184-a4e0-2d5e9a677c42 tempest-VolumesSnapshotTestJSON-130675119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd" returned: 0 in 0.375s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-31377c8b-f58a-4184-a4e0-2d5e9a677c42 tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:07 devstack sudo[103868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd Nov 02 12:40:07 devstack sudo[103868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:07 devstack sudo[103868]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-31377c8b-f58a-4184-a4e0-2d5e9a677c42 tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-77ce5316-e287-4515-8ab2-04f4ccbb52cd" returned: 0 in 0.252s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f670cd61-0ebe-4c7d-8f06-0f9f96c2d247 tempest-CinderUnicodeTest-755315141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f670cd61-0ebe-4c7d-8f06-0f9f96c2d247 tempest-CinderUnicodeTest-755315141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:07 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-31377c8b-f58a-4184-a4e0-2d5e9a677c42 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-quobyte-77ce5316-e287-4515-8ab2-04f4ccbb52cd" released by "delete_volume" :: held 0.688s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:40:07 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-f670cd61-0ebe-4c7d-8f06-0f9f96c2d247 tempest-CinderUnicodeTest-755315141 None] Creating offline snapshot 691c771b-1fd5-41d4-a0f2-ec12705518f3 of volume 35516dda-4142-41f8-9ddb-e3e8fcca60f1 {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:40:07 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b48a5a-06fb-4825-8702-82aa3dca52e9]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:40:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f670cd61-0ebe-4c7d-8f06-0f9f96c2d247 tempest-CinderUnicodeTest-755315141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:07 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-31377c8b-f58a-4184-a4e0-2d5e9a677c42 tempest-VolumesSnapshotTestJSON-130675119 None] Created reservations ['a51176a6-5aee-4b8a-9f85-53bbbf93c850', '8a22c471-24b0-464c-b764-2ca401528a8d', '66f6a193-6684-46c9-b934-8e60c95079e5', '601c7f3c-ce9e-4fd4-9691-b99c99bc2274'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:40:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-31377c8b-f58a-4184-a4e0-2d5e9a677c42 tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-31377c8b-f58a-4184-a4e0-2d5e9a677c42 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:07 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-31377c8b-f58a-4184-a4e0-2d5e9a677c42 tempest-VolumesSnapshotTestJSON-130675119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:40:07 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-31377c8b-f58a-4184-a4e0-2d5e9a677c42 tempest-VolumesSnapshotTestJSON-130675119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:40:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-31377c8b-f58a-4184-a4e0-2d5e9a677c42 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-31377c8b-f58a-4184-a4e0-2d5e9a677c42 tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:07 devstack sudo[103871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1 Nov 02 12:40:07 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:07 devstack sudo[103872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:40:07 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:08 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-31377c8b-f58a-4184-a4e0-2d5e9a677c42 tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.255s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:08 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-31377c8b-f58a-4184-a4e0-2d5e9a677c42 tempest-VolumesSnapshotTestJSON-130675119 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:40:08 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-31377c8b-f58a-4184-a4e0-2d5e9a677c42 tempest-VolumesSnapshotTestJSON-130675119 None] Deleted volume successfully. Nov 02 12:40:08 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-31377c8b-f58a-4184-a4e0-2d5e9a677c42 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-77ce5316-e287-4515-8ab2-04f4ccbb52cd-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:40:08 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f670cd61-0ebe-4c7d-8f06-0f9f96c2d247 tempest-CinderUnicodeTest-755315141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1" returned: 0 in 0.415s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f670cd61-0ebe-4c7d-8f06-0f9f96c2d247 tempest-CinderUnicodeTest-755315141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1.691c771b-1fd5-41d4-a0f2-ec12705518f3 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:08 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-90969a58-3da0-4585-b816-f7a0ddde63c6 tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "cinder-309ed49d-bba9-4265-b601-48fce1e56e1a-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:40:08 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1.691c771b-1fd5-41d4-a0f2-ec12705518f3 1G Nov 02 12:40:08 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:08 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-90969a58-3da0-4585-b816-f7a0ddde63c6 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-309ed49d-bba9-4265-b601-48fce1e56e1a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:40:08 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-90969a58-3da0-4585-b816-f7a0ddde63c6 tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "cinder-quobyte-309ed49d-bba9-4265-b601-48fce1e56e1a" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:40:08 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-90969a58-3da0-4585-b816-f7a0ddde63c6 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-quobyte-309ed49d-bba9-4265-b601-48fce1e56e1a" acquired by "delete_volume" :: waited 0.014s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:40:08 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e7e155-b0b6-4488-aed5-5330ea8bd474]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:40:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-90969a58-3da0-4585-b816-f7a0ddde63c6 tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:08 devstack sudo[103881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a Nov 02 12:40:08 devstack sudo[103881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:08 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f670cd61-0ebe-4c7d-8f06-0f9f96c2d247 tempest-CinderUnicodeTest-755315141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1.691c771b-1fd5-41d4-a0f2-ec12705518f3 1G" returned: 0 in 0.411s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f670cd61-0ebe-4c7d-8f06-0f9f96c2d247 tempest-CinderUnicodeTest-755315141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1.691c771b-1fd5-41d4-a0f2-ec12705518f3 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:08 devstack sudo[103887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1.691c771b-1fd5-41d4-a0f2-ec12705518f3 Nov 02 12:40:08 devstack sudo[103887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:08 devstack sudo[103881]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-90969a58-3da0-4585-b816-f7a0ddde63c6 tempest-VolumesSnapshotTestJSON-130675119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a" returned: 0 in 0.369s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-90969a58-3da0-4585-b816-f7a0ddde63c6 tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:08 devstack sudo[103892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a Nov 02 12:40:08 devstack sudo[103892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:08 devstack sudo[103887]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f670cd61-0ebe-4c7d-8f06-0f9f96c2d247 tempest-CinderUnicodeTest-755315141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1.691c771b-1fd5-41d4-a0f2-ec12705518f3" returned: 0 in 0.277s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:08 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-f670cd61-0ebe-4c7d-8f06-0f9f96c2d247 tempest-CinderUnicodeTest-755315141 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1.691c771b-1fd5-41d4-a0f2-ec12705518f3 is being set with open permissions: ugo+rw Nov 02 12:40:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f670cd61-0ebe-4c7d-8f06-0f9f96c2d247 tempest-CinderUnicodeTest-755315141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1.691c771b-1fd5-41d4-a0f2-ec12705518f3 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:08 devstack sudo[103897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1.691c771b-1fd5-41d4-a0f2-ec12705518f3 Nov 02 12:40:08 devstack sudo[103897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:08 devstack sudo[103892]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-90969a58-3da0-4585-b816-f7a0ddde63c6 tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-309ed49d-bba9-4265-b601-48fce1e56e1a" returned: 0 in 0.241s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:08 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-90969a58-3da0-4585-b816-f7a0ddde63c6 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-quobyte-309ed49d-bba9-4265-b601-48fce1e56e1a" released by "delete_volume" :: held 0.673s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:40:09 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-90969a58-3da0-4585-b816-f7a0ddde63c6 tempest-VolumesSnapshotTestJSON-130675119 None] Created reservations ['f7e0fd95-0351-4892-ae4d-a14b4ab041d5', '14c42b23-6750-467d-8781-96e6602fd186', '0aa27a80-7b7f-4f5b-a94b-c065ca226844', '2b2920ef-d40b-4ddf-a4ce-36b1133e63c3'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:40:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-90969a58-3da0-4585-b816-f7a0ddde63c6 tempest-VolumesSnapshotTestJSON-130675119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-90969a58-3da0-4585-b816-f7a0ddde63c6 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:09 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-90969a58-3da0-4585-b816-f7a0ddde63c6 tempest-VolumesSnapshotTestJSON-130675119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:40:09 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-90969a58-3da0-4585-b816-f7a0ddde63c6 tempest-VolumesSnapshotTestJSON-130675119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:40:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-90969a58-3da0-4585-b816-f7a0ddde63c6 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-90969a58-3da0-4585-b816-f7a0ddde63c6 tempest-VolumesSnapshotTestJSON-130675119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:09 devstack sudo[103900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:40:09 devstack sudo[103900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:09 devstack sudo[103897]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f670cd61-0ebe-4c7d-8f06-0f9f96c2d247 tempest-CinderUnicodeTest-755315141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1.691c771b-1fd5-41d4-a0f2-ec12705518f3" returned: 0 in 0.263s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f670cd61-0ebe-4c7d-8f06-0f9f96c2d247 tempest-CinderUnicodeTest-755315141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:09 devstack sudo[103903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1.info Nov 02 12:40:09 devstack sudo[103903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:09 devstack sudo[103900]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-90969a58-3da0-4585-b816-f7a0ddde63c6 tempest-VolumesSnapshotTestJSON-130675119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.258s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:09 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-90969a58-3da0-4585-b816-f7a0ddde63c6 tempest-VolumesSnapshotTestJSON-130675119 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:40:09 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-90969a58-3da0-4585-b816-f7a0ddde63c6 tempest-VolumesSnapshotTestJSON-130675119 None] Deleted volume successfully. Nov 02 12:40:09 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-90969a58-3da0-4585-b816-f7a0ddde63c6 tempest-VolumesSnapshotTestJSON-130675119 None] Lock "cinder-309ed49d-bba9-4265-b601-48fce1e56e1a-delete_volume" released by "delete_volume" :: held 1.127s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:40:09 devstack sudo[103903]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f670cd61-0ebe-4c7d-8f06-0f9f96c2d247 tempest-CinderUnicodeTest-755315141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1.info" returned: 0 in 0.272s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:09 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-f670cd61-0ebe-4c7d-8f06-0f9f96c2d247 tempest-CinderUnicodeTest-755315141 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1.info is being set with open permissions: ugo+rw Nov 02 12:40:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f670cd61-0ebe-4c7d-8f06-0f9f96c2d247 tempest-CinderUnicodeTest-755315141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:09 devstack sudo[103907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1.info Nov 02 12:40:09 devstack sudo[103907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:09 devstack sudo[103907]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f670cd61-0ebe-4c7d-8f06-0f9f96c2d247 tempest-CinderUnicodeTest-755315141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1.info" returned: 0 in 0.245s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f670cd61-0ebe-4c7d-8f06-0f9f96c2d247 tempest-CinderUnicodeTest-755315141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.982s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:09 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-f670cd61-0ebe-4c7d-8f06-0f9f96c2d247 tempest-CinderUnicodeTest-755315141 None] Create snapshot completed successfully Nov 02 12:40:09 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ce471ec8-39a6-4ed2-a4aa-9852ae426fd6 tempest-CinderUnicodeTest-755315141 None] Acquiring lock "cinder-691c771b-1fd5-41d4-a0f2-ec12705518f3-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:40:09 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ce471ec8-39a6-4ed2-a4aa-9852ae426fd6 tempest-CinderUnicodeTest-755315141 None] Lock "cinder-691c771b-1fd5-41d4-a0f2-ec12705518f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:40:09 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ce471ec8-39a6-4ed2-a4aa-9852ae426fd6 tempest-CinderUnicodeTest-755315141 None] Acquiring lock "cinder-quobyte-35516dda-4142-41f8-9ddb-e3e8fcca60f1" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:40:09 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ce471ec8-39a6-4ed2-a4aa-9852ae426fd6 tempest-CinderUnicodeTest-755315141 None] Lock "cinder-quobyte-35516dda-4142-41f8-9ddb-e3e8fcca60f1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:40:09 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ce471ec8-39a6-4ed2-a4aa-9852ae426fd6 tempest-CinderUnicodeTest-755315141 None] Acquiring lock "cinder-quobyte-691c771b-1fd5-41d4-a0f2-ec12705518f3" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:40:09 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ce471ec8-39a6-4ed2-a4aa-9852ae426fd6 tempest-CinderUnicodeTest-755315141 None] Lock "cinder-quobyte-691c771b-1fd5-41d4-a0f2-ec12705518f3" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:40:09 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-ce471ec8-39a6-4ed2-a4aa-9852ae426fd6 tempest-CinderUnicodeTest-755315141 None] Deleting offline snapshot 691c771b-1fd5-41d4-a0f2-ec12705518f3 of volume 35516dda-4142-41f8-9ddb-e3e8fcca60f1 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:40:09 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-ce471ec8-39a6-4ed2-a4aa-9852ae426fd6 tempest-CinderUnicodeTest-755315141 None] snapshot_file for this snap is: volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1.691c771b-1fd5-41d4-a0f2-ec12705518f3 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:40:09 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[be541559-1374-4189-b8bf-9f8c0c6a2229]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:40:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ce471ec8-39a6-4ed2-a4aa-9852ae426fd6 tempest-CinderUnicodeTest-755315141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1.691c771b-1fd5-41d4-a0f2-ec12705518f3 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:10 devstack sudo[103910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1.691c771b-1fd5-41d4-a0f2-ec12705518f3 Nov 02 12:40:10 devstack sudo[103910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:10 devstack sudo[103910]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ce471ec8-39a6-4ed2-a4aa-9852ae426fd6 tempest-CinderUnicodeTest-755315141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1.691c771b-1fd5-41d4-a0f2-ec12705518f3" returned: 0 in 0.382s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:10 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-ce471ec8-39a6-4ed2-a4aa-9852ae426fd6 tempest-CinderUnicodeTest-755315141 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:40:10 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5765530-09df-4d0d-aff7-21e55ae3073f]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:40:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ce471ec8-39a6-4ed2-a4aa-9852ae426fd6 tempest-CinderUnicodeTest-755315141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:10 devstack sudo[103915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1 Nov 02 12:40:10 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:10 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ce471ec8-39a6-4ed2-a4aa-9852ae426fd6 tempest-CinderUnicodeTest-755315141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1" returned: 0 in 0.401s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ce471ec8-39a6-4ed2-a4aa-9852ae426fd6 tempest-CinderUnicodeTest-755315141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1.691c771b-1fd5-41d4-a0f2-ec12705518f3 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:10 devstack sudo[103921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1.691c771b-1fd5-41d4-a0f2-ec12705518f3 Nov 02 12:40:10 devstack sudo[103921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:11 devstack sudo[103921]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ce471ec8-39a6-4ed2-a4aa-9852ae426fd6 tempest-CinderUnicodeTest-755315141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1.691c771b-1fd5-41d4-a0f2-ec12705518f3" returned: 0 in 0.334s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ce471ec8-39a6-4ed2-a4aa-9852ae426fd6 tempest-CinderUnicodeTest-755315141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1.691c771b-1fd5-41d4-a0f2-ec12705518f3 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:11 devstack sudo[103926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1.691c771b-1fd5-41d4-a0f2-ec12705518f3 Nov 02 12:40:11 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:11 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ce471ec8-39a6-4ed2-a4aa-9852ae426fd6 tempest-CinderUnicodeTest-755315141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1.691c771b-1fd5-41d4-a0f2-ec12705518f3" returned: 0 in 0.245s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:11 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ce471ec8-39a6-4ed2-a4aa-9852ae426fd6 tempest-CinderUnicodeTest-755315141 None] Lock "cinder-quobyte-691c771b-1fd5-41d4-a0f2-ec12705518f3" released by "_delete_snapshot" :: held 1.483s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:40:11 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ce471ec8-39a6-4ed2-a4aa-9852ae426fd6 tempest-CinderUnicodeTest-755315141 None] Lock "cinder-quobyte-35516dda-4142-41f8-9ddb-e3e8fcca60f1" released by "delete_snapshot" :: held 1.513s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:40:11 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-ce471ec8-39a6-4ed2-a4aa-9852ae426fd6 tempest-CinderUnicodeTest-755315141 None] Created reservations ['dc462fd2-52b0-41d0-9577-bc46122f8710', '78a0e7d9-c434-4102-b340-25c01315e600', '4efd7088-0b2f-41d2-9f85-992678e176f6', '5c197d6a-44a0-4bae-ab3d-5310fc2b951f'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:40:11 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-ce471ec8-39a6-4ed2-a4aa-9852ae426fd6 tempest-CinderUnicodeTest-755315141 None] Delete snapshot completed successfully. Nov 02 12:40:11 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ce471ec8-39a6-4ed2-a4aa-9852ae426fd6 tempest-CinderUnicodeTest-755315141 None] Lock "cinder-691c771b-1fd5-41d4-a0f2-ec12705518f3-delete_snapshot" released by "delete_snapshot" :: held 1.653s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:40:12 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0434e1e4-1316-4f72-9dd7-48697c0c3c96 tempest-CinderUnicodeTest-755315141 None] Acquiring lock "cinder-35516dda-4142-41f8-9ddb-e3e8fcca60f1-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:40:12 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0434e1e4-1316-4f72-9dd7-48697c0c3c96 tempest-CinderUnicodeTest-755315141 None] Lock "cinder-35516dda-4142-41f8-9ddb-e3e8fcca60f1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:40:12 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0434e1e4-1316-4f72-9dd7-48697c0c3c96 tempest-CinderUnicodeTest-755315141 None] Acquiring lock "cinder-quobyte-35516dda-4142-41f8-9ddb-e3e8fcca60f1" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:40:12 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0434e1e4-1316-4f72-9dd7-48697c0c3c96 tempest-CinderUnicodeTest-755315141 None] Lock "cinder-quobyte-35516dda-4142-41f8-9ddb-e3e8fcca60f1" acquired by "delete_volume" :: waited 0.014s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:40:12 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d8dc10-4408-4442-88ad-0bb5f3142542]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:40:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0434e1e4-1316-4f72-9dd7-48697c0c3c96 tempest-CinderUnicodeTest-755315141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:12 devstack sudo[103930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1 Nov 02 12:40:12 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:12 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0434e1e4-1316-4f72-9dd7-48697c0c3c96 tempest-CinderUnicodeTest-755315141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1" returned: 0 in 0.365s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0434e1e4-1316-4f72-9dd7-48697c0c3c96 tempest-CinderUnicodeTest-755315141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:12 devstack sudo[103935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1 Nov 02 12:40:12 devstack sudo[103935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:12 devstack sudo[103935]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0434e1e4-1316-4f72-9dd7-48697c0c3c96 tempest-CinderUnicodeTest-755315141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-35516dda-4142-41f8-9ddb-e3e8fcca60f1" returned: 0 in 0.309s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:12 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0434e1e4-1316-4f72-9dd7-48697c0c3c96 tempest-CinderUnicodeTest-755315141 None] Lock "cinder-quobyte-35516dda-4142-41f8-9ddb-e3e8fcca60f1" released by "delete_volume" :: held 0.733s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:40:12 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-0434e1e4-1316-4f72-9dd7-48697c0c3c96 tempest-CinderUnicodeTest-755315141 None] Created reservations ['75c86201-0348-461e-b8d6-61a7b5a3746e', '5bf629c2-8609-474b-a470-ea1b50628a29', '71a726fa-cd8f-4fc4-9d00-eab5fa2973e6', '5a48a5a4-f595-4e25-b3b2-594cefaa7217'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:40:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0434e1e4-1316-4f72-9dd7-48697c0c3c96 tempest-CinderUnicodeTest-755315141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0434e1e4-1316-4f72-9dd7-48697c0c3c96 tempest-CinderUnicodeTest-755315141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:12 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0434e1e4-1316-4f72-9dd7-48697c0c3c96 tempest-CinderUnicodeTest-755315141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:40:12 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0434e1e4-1316-4f72-9dd7-48697c0c3c96 tempest-CinderUnicodeTest-755315141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:40:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0434e1e4-1316-4f72-9dd7-48697c0c3c96 tempest-CinderUnicodeTest-755315141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0434e1e4-1316-4f72-9dd7-48697c0c3c96 tempest-CinderUnicodeTest-755315141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:12 devstack sudo[103938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:40:12 devstack sudo[103938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:13 devstack sudo[103938]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:13 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f8521fe3-ec9f-4a07-aff5-c49d6f34aea3 tempest-CinderUnicodeTest-755315141 None] Acquiring lock "cinder-928e7b05-1f3b-4c73-8190-dc5dd4788fd1-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:40:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0434e1e4-1316-4f72-9dd7-48697c0c3c96 tempest-CinderUnicodeTest-755315141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.262s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:13 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-0434e1e4-1316-4f72-9dd7-48697c0c3c96 tempest-CinderUnicodeTest-755315141 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:40:13 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-0434e1e4-1316-4f72-9dd7-48697c0c3c96 tempest-CinderUnicodeTest-755315141 None] Deleted volume successfully. Nov 02 12:40:13 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f8521fe3-ec9f-4a07-aff5-c49d6f34aea3 tempest-CinderUnicodeTest-755315141 None] Lock "cinder-928e7b05-1f3b-4c73-8190-dc5dd4788fd1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:40:13 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:UPDATE=188,cinder:SELECT=150,cinder:DELETE=12,cinder:INSERT=45 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:40:13 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=148,cinder:INSERT=46,cinder:UPDATE=175,cinder:DELETE=20 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:40:13 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-0434e1e4-1316-4f72-9dd7-48697c0c3c96 tempest-CinderUnicodeTest-755315141 None] Lock "cinder-35516dda-4142-41f8-9ddb-e3e8fcca60f1-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:40:13 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f8521fe3-ec9f-4a07-aff5-c49d6f34aea3 tempest-CinderUnicodeTest-755315141 None] Acquiring lock "cinder-quobyte-928e7b05-1f3b-4c73-8190-dc5dd4788fd1" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:40:13 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f8521fe3-ec9f-4a07-aff5-c49d6f34aea3 tempest-CinderUnicodeTest-755315141 None] Lock "cinder-quobyte-928e7b05-1f3b-4c73-8190-dc5dd4788fd1" acquired by "delete_volume" :: waited 0.018s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:40:13 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[736f2417-3b01-4e93-82da-0bc88336d941]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:40:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f8521fe3-ec9f-4a07-aff5-c49d6f34aea3 tempest-CinderUnicodeTest-755315141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-928e7b05-1f3b-4c73-8190-dc5dd4788fd1 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:13 devstack sudo[103941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-928e7b05-1f3b-4c73-8190-dc5dd4788fd1 Nov 02 12:40:13 devstack sudo[103941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:13 devstack sudo[103941]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f8521fe3-ec9f-4a07-aff5-c49d6f34aea3 tempest-CinderUnicodeTest-755315141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-928e7b05-1f3b-4c73-8190-dc5dd4788fd1" returned: 0 in 0.438s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f8521fe3-ec9f-4a07-aff5-c49d6f34aea3 tempest-CinderUnicodeTest-755315141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-928e7b05-1f3b-4c73-8190-dc5dd4788fd1 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:13 devstack sudo[103947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-928e7b05-1f3b-4c73-8190-dc5dd4788fd1 Nov 02 12:40:13 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:14 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f8521fe3-ec9f-4a07-aff5-c49d6f34aea3 tempest-CinderUnicodeTest-755315141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-928e7b05-1f3b-4c73-8190-dc5dd4788fd1" returned: 0 in 0.252s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:14 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f8521fe3-ec9f-4a07-aff5-c49d6f34aea3 tempest-CinderUnicodeTest-755315141 None] Lock "cinder-quobyte-928e7b05-1f3b-4c73-8190-dc5dd4788fd1" released by "delete_volume" :: held 0.731s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:40:14 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-f8521fe3-ec9f-4a07-aff5-c49d6f34aea3 tempest-CinderUnicodeTest-755315141 None] Created reservations ['5a193bce-c0fa-4e74-aa74-37381d88f65b', '5a2648fe-4aef-4781-a45c-a3b55c3002ea', '771e92ce-546d-429c-a671-d57cb9a7fdb7', '48abf536-81c4-4abb-b9cb-e4c144e0b9b8'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:40:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f8521fe3-ec9f-4a07-aff5-c49d6f34aea3 tempest-CinderUnicodeTest-755315141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f8521fe3-ec9f-4a07-aff5-c49d6f34aea3 tempest-CinderUnicodeTest-755315141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:14 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f8521fe3-ec9f-4a07-aff5-c49d6f34aea3 tempest-CinderUnicodeTest-755315141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:40:14 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f8521fe3-ec9f-4a07-aff5-c49d6f34aea3 tempest-CinderUnicodeTest-755315141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:40:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f8521fe3-ec9f-4a07-aff5-c49d6f34aea3 tempest-CinderUnicodeTest-755315141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f8521fe3-ec9f-4a07-aff5-c49d6f34aea3 tempest-CinderUnicodeTest-755315141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:14 devstack sudo[103950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:40:14 devstack sudo[103950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:14 devstack sudo[103950]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f8521fe3-ec9f-4a07-aff5-c49d6f34aea3 tempest-CinderUnicodeTest-755315141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.297s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:14 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-f8521fe3-ec9f-4a07-aff5-c49d6f34aea3 tempest-CinderUnicodeTest-755315141 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:40:14 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-f8521fe3-ec9f-4a07-aff5-c49d6f34aea3 tempest-CinderUnicodeTest-755315141 None] Deleted volume successfully. Nov 02 12:40:14 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f8521fe3-ec9f-4a07-aff5-c49d6f34aea3 tempest-CinderUnicodeTest-755315141 None] Lock "cinder-928e7b05-1f3b-4c73-8190-dc5dd4788fd1-delete_volume" released by "delete_volume" :: held 1.251s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:40:24 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:UPDATE=8,cinder:SELECT=6,cinder:INSERT=2 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:40:24 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=3,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:40:34 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9a4c381-57c3-4579-bb8f-ae6cb112f9ef tempest-TestServerVolumeAttachmentScenario-99354544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:40:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9a4c381-57c3-4579-bb8f-ae6cb112f9ef tempest-TestServerVolumeAttachmentScenario-99354544 None] Flow 'volume_create_manager' (b7512773-6663-44e1-8416-208d2b620c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:40:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9a4c381-57c3-4579-bb8f-ae6cb112f9ef tempest-TestServerVolumeAttachmentScenario-99354544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca78989-7c17-4704-bf94-cf381523629a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9a4c381-57c3-4579-bb8f-ae6cb112f9ef tempest-TestServerVolumeAttachmentScenario-99354544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca78989-7c17-4704-bf94-cf381523629a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1507985632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=970a6cfb-2e3b-4711-a3b9-a7218e9f6250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a184ba2943c45f49548452e4ba3f27e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:40:34Z,use_quota=True,user_id='279a8cdfb06b4742988f06a4a05ae929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9a4c381-57c3-4579-bb8f-ae6cb112f9ef tempest-TestServerVolumeAttachmentScenario-99354544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61344550-9b9a-4f64-a7a1-8e7d6e35d91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9a4c381-57c3-4579-bb8f-ae6cb112f9ef tempest-TestServerVolumeAttachmentScenario-99354544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61344550-9b9a-4f64-a7a1-8e7d6e35d91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9a4c381-57c3-4579-bb8f-ae6cb112f9ef tempest-TestServerVolumeAttachmentScenario-99354544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d7e5d3e-cb22-48af-99d7-439695a5e4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9a4c381-57c3-4579-bb8f-ae6cb112f9ef tempest-TestServerVolumeAttachmentScenario-99354544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d7e5d3e-cb22-48af-99d7-439695a5e4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '970a6cfb-2e3b-4711-a3b9-a7218e9f6250', 'volume_name': 'volume-970a6cfb-2e3b-4711-a3b9-a7218e9f6250', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9a4c381-57c3-4579-bb8f-ae6cb112f9ef tempest-TestServerVolumeAttachmentScenario-99354544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae56f8e9-3957-4ef7-9559-4fee5cb013e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9a4c381-57c3-4579-bb8f-ae6cb112f9ef tempest-TestServerVolumeAttachmentScenario-99354544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae56f8e9-3957-4ef7-9559-4fee5cb013e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9a4c381-57c3-4579-bb8f-ae6cb112f9ef tempest-TestServerVolumeAttachmentScenario-99354544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f14de2b6-19a0-4f59-9fb6-c811c2756c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:34 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-d9a4c381-57c3-4579-bb8f-ae6cb112f9ef tempest-TestServerVolumeAttachmentScenario-99354544 None] Volume 970a6cfb-2e3b-4711-a3b9-a7218e9f6250: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-970a6cfb-2e3b-4711-a3b9-a7218e9f6250', 'volume_size': 1} Nov 02 12:40:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d9a4c381-57c3-4579-bb8f-ae6cb112f9ef tempest-TestServerVolumeAttachmentScenario-99354544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d9a4c381-57c3-4579-bb8f-ae6cb112f9ef tempest-TestServerVolumeAttachmentScenario-99354544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d9a4c381-57c3-4579-bb8f-ae6cb112f9ef tempest-TestServerVolumeAttachmentScenario-99354544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1507985632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=970a6cfb-2e3b-4711-a3b9-a7218e9f6250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a184ba2943c45f49548452e4ba3f27e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:40:34Z,use_quota=True,user_id='279a8cdfb06b4742988f06a4a05ae929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:40:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-d9a4c381-57c3-4579-bb8f-ae6cb112f9ef tempest-TestServerVolumeAttachmentScenario-99354544 None] Creating volume 970a6cfb-2e3b-4711-a3b9-a7218e9f6250 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:40:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d9a4c381-57c3-4579-bb8f-ae6cb112f9ef tempest-TestServerVolumeAttachmentScenario-99354544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d9a4c381-57c3-4579-bb8f-ae6cb112f9ef tempest-TestServerVolumeAttachmentScenario-99354544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d9a4c381-57c3-4579-bb8f-ae6cb112f9ef tempest-TestServerVolumeAttachmentScenario-99354544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:40:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d9a4c381-57c3-4579-bb8f-ae6cb112f9ef tempest-TestServerVolumeAttachmentScenario-99354544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:40:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d9a4c381-57c3-4579-bb8f-ae6cb112f9ef tempest-TestServerVolumeAttachmentScenario-99354544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d9a4c381-57c3-4579-bb8f-ae6cb112f9ef tempest-TestServerVolumeAttachmentScenario-99354544 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:40:34 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-d9a4c381-57c3-4579-bb8f-ae6cb112f9ef tempest-TestServerVolumeAttachmentScenario-99354544 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:40:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d9a4c381-57c3-4579-bb8f-ae6cb112f9ef tempest-TestServerVolumeAttachmentScenario-99354544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-970a6cfb-2e3b-4711-a3b9-a7218e9f6250 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:34 devstack sudo[103955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-970a6cfb-2e3b-4711-a3b9-a7218e9f6250 1073741824 Nov 02 12:40:34 devstack sudo[103955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:34 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6515fbd-0dad-47d0-9afe-ed6c7a307893 tempest-TestServerVolumeAttachmentScenario-99354544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:40:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b6515fbd-0dad-47d0-9afe-ed6c7a307893 tempest-TestServerVolumeAttachmentScenario-99354544 None] Flow 'volume_create_manager' (46774e61-5589-4411-b5c7-862b294c9a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:40:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b6515fbd-0dad-47d0-9afe-ed6c7a307893 tempest-TestServerVolumeAttachmentScenario-99354544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57659019-4264-4144-a3db-b55b54c70a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b6515fbd-0dad-47d0-9afe-ed6c7a307893 tempest-TestServerVolumeAttachmentScenario-99354544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57659019-4264-4144-a3db-b55b54c70a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1431457400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f093ae12-1221-4820-9cc3-b684980cae4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a184ba2943c45f49548452e4ba3f27e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:40:35Z,use_quota=True,user_id='279a8cdfb06b4742988f06a4a05ae929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b6515fbd-0dad-47d0-9afe-ed6c7a307893 tempest-TestServerVolumeAttachmentScenario-99354544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ffd67d9-0f39-475c-be59-2e05a3826f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b6515fbd-0dad-47d0-9afe-ed6c7a307893 tempest-TestServerVolumeAttachmentScenario-99354544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ffd67d9-0f39-475c-be59-2e05a3826f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b6515fbd-0dad-47d0-9afe-ed6c7a307893 tempest-TestServerVolumeAttachmentScenario-99354544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (067f7d56-e908-41e2-8925-e43908b659cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b6515fbd-0dad-47d0-9afe-ed6c7a307893 tempest-TestServerVolumeAttachmentScenario-99354544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (067f7d56-e908-41e2-8925-e43908b659cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f093ae12-1221-4820-9cc3-b684980cae4d', 'volume_name': 'volume-f093ae12-1221-4820-9cc3-b684980cae4d', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b6515fbd-0dad-47d0-9afe-ed6c7a307893 tempest-TestServerVolumeAttachmentScenario-99354544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b563b6f0-c819-4abd-8b15-b7d6bf127ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b6515fbd-0dad-47d0-9afe-ed6c7a307893 tempest-TestServerVolumeAttachmentScenario-99354544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b563b6f0-c819-4abd-8b15-b7d6bf127ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b6515fbd-0dad-47d0-9afe-ed6c7a307893 tempest-TestServerVolumeAttachmentScenario-99354544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d4f83e1-49ee-4c50-b4f4-3cd3a8324342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:34 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-b6515fbd-0dad-47d0-9afe-ed6c7a307893 tempest-TestServerVolumeAttachmentScenario-99354544 None] Volume f093ae12-1221-4820-9cc3-b684980cae4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f093ae12-1221-4820-9cc3-b684980cae4d', 'volume_size': 1} Nov 02 12:40:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b6515fbd-0dad-47d0-9afe-ed6c7a307893 tempest-TestServerVolumeAttachmentScenario-99354544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:34 devstack sudo[103955]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d9a4c381-57c3-4579-bb8f-ae6cb112f9ef tempest-TestServerVolumeAttachmentScenario-99354544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-970a6cfb-2e3b-4711-a3b9-a7218e9f6250 1073741824" returned: 0 in 0.497s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d9a4c381-57c3-4579-bb8f-ae6cb112f9ef tempest-TestServerVolumeAttachmentScenario-99354544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-970a6cfb-2e3b-4711-a3b9-a7218e9f6250 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:34 devstack sudo[103961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-970a6cfb-2e3b-4711-a3b9-a7218e9f6250 Nov 02 12:40:34 devstack sudo[103961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:35 devstack sudo[103961]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d9a4c381-57c3-4579-bb8f-ae6cb112f9ef tempest-TestServerVolumeAttachmentScenario-99354544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-970a6cfb-2e3b-4711-a3b9-a7218e9f6250" returned: 0 in 0.254s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:35 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d9a4c381-57c3-4579-bb8f-ae6cb112f9ef tempest-TestServerVolumeAttachmentScenario-99354544 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:40:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d9a4c381-57c3-4579-bb8f-ae6cb112f9ef tempest-TestServerVolumeAttachmentScenario-99354544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b6515fbd-0dad-47d0-9afe-ed6c7a307893 tempest-TestServerVolumeAttachmentScenario-99354544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.430s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:35 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b6515fbd-0dad-47d0-9afe-ed6c7a307893 tempest-TestServerVolumeAttachmentScenario-99354544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1431457400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f093ae12-1221-4820-9cc3-b684980cae4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a184ba2943c45f49548452e4ba3f27e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:40:35Z,use_quota=True,user_id='279a8cdfb06b4742988f06a4a05ae929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:40:35 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-b6515fbd-0dad-47d0-9afe-ed6c7a307893 tempest-TestServerVolumeAttachmentScenario-99354544 None] Creating volume f093ae12-1221-4820-9cc3-b684980cae4d {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:40:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b6515fbd-0dad-47d0-9afe-ed6c7a307893 tempest-TestServerVolumeAttachmentScenario-99354544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b6515fbd-0dad-47d0-9afe-ed6c7a307893 tempest-TestServerVolumeAttachmentScenario-99354544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:35 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b6515fbd-0dad-47d0-9afe-ed6c7a307893 tempest-TestServerVolumeAttachmentScenario-99354544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:40:35 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b6515fbd-0dad-47d0-9afe-ed6c7a307893 tempest-TestServerVolumeAttachmentScenario-99354544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:40:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b6515fbd-0dad-47d0-9afe-ed6c7a307893 tempest-TestServerVolumeAttachmentScenario-99354544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:35 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b6515fbd-0dad-47d0-9afe-ed6c7a307893 tempest-TestServerVolumeAttachmentScenario-99354544 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:40:35 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-b6515fbd-0dad-47d0-9afe-ed6c7a307893 tempest-TestServerVolumeAttachmentScenario-99354544 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:40:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6515fbd-0dad-47d0-9afe-ed6c7a307893 tempest-TestServerVolumeAttachmentScenario-99354544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f093ae12-1221-4820-9cc3-b684980cae4d 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:35 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9a4c381-57c3-4579-bb8f-ae6cb112f9ef tempest-TestServerVolumeAttachmentScenario-99354544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f14de2b6-19a0-4f59-9fb6-c811c2756c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-970a6cfb-2e3b-4711-a3b9-a7218e9f6250', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:35 devstack sudo[103964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f093ae12-1221-4820-9cc3-b684980cae4d 1073741824 Nov 02 12:40:35 devstack sudo[103964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:35 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9a4c381-57c3-4579-bb8f-ae6cb112f9ef tempest-TestServerVolumeAttachmentScenario-99354544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b17bf25e-9109-415f-8b3b-90a768b14900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:35 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-d9a4c381-57c3-4579-bb8f-ae6cb112f9ef tempest-TestServerVolumeAttachmentScenario-99354544 None] Volume volume-970a6cfb-2e3b-4711-a3b9-a7218e9f6250 (970a6cfb-2e3b-4711-a3b9-a7218e9f6250): created successfully Nov 02 12:40:35 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9a4c381-57c3-4579-bb8f-ae6cb112f9ef tempest-TestServerVolumeAttachmentScenario-99354544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b17bf25e-9109-415f-8b3b-90a768b14900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:35 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9a4c381-57c3-4579-bb8f-ae6cb112f9ef tempest-TestServerVolumeAttachmentScenario-99354544 None] Flow 'volume_create_manager' (b7512773-6663-44e1-8416-208d2b620c86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:40:35 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-d9a4c381-57c3-4579-bb8f-ae6cb112f9ef tempest-TestServerVolumeAttachmentScenario-99354544 None] Created volume successfully. Nov 02 12:40:35 devstack sudo[103964]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6515fbd-0dad-47d0-9afe-ed6c7a307893 tempest-TestServerVolumeAttachmentScenario-99354544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f093ae12-1221-4820-9cc3-b684980cae4d 1073741824" returned: 0 in 0.450s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6515fbd-0dad-47d0-9afe-ed6c7a307893 tempest-TestServerVolumeAttachmentScenario-99354544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f093ae12-1221-4820-9cc3-b684980cae4d {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:35 devstack sudo[103970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f093ae12-1221-4820-9cc3-b684980cae4d Nov 02 12:40:35 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:35 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6515fbd-0dad-47d0-9afe-ed6c7a307893 tempest-TestServerVolumeAttachmentScenario-99354544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f093ae12-1221-4820-9cc3-b684980cae4d" returned: 0 in 0.240s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:35 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b6515fbd-0dad-47d0-9afe-ed6c7a307893 tempest-TestServerVolumeAttachmentScenario-99354544 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:40:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b6515fbd-0dad-47d0-9afe-ed6c7a307893 tempest-TestServerVolumeAttachmentScenario-99354544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:35 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b6515fbd-0dad-47d0-9afe-ed6c7a307893 tempest-TestServerVolumeAttachmentScenario-99354544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d4f83e1-49ee-4c50-b4f4-3cd3a8324342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f093ae12-1221-4820-9cc3-b684980cae4d', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:35 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b6515fbd-0dad-47d0-9afe-ed6c7a307893 tempest-TestServerVolumeAttachmentScenario-99354544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (200a38f6-82c2-43c5-bdd4-8aa13dbbafed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:40:35 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-b6515fbd-0dad-47d0-9afe-ed6c7a307893 tempest-TestServerVolumeAttachmentScenario-99354544 None] Volume volume-f093ae12-1221-4820-9cc3-b684980cae4d (f093ae12-1221-4820-9cc3-b684980cae4d): created successfully Nov 02 12:40:35 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b6515fbd-0dad-47d0-9afe-ed6c7a307893 tempest-TestServerVolumeAttachmentScenario-99354544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (200a38f6-82c2-43c5-bdd4-8aa13dbbafed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:40:35 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b6515fbd-0dad-47d0-9afe-ed6c7a307893 tempest-TestServerVolumeAttachmentScenario-99354544 None] Flow 'volume_create_manager' (46774e61-5589-4411-b5c7-862b294c9a4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:40:35 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-b6515fbd-0dad-47d0-9afe-ed6c7a307893 tempest-TestServerVolumeAttachmentScenario-99354544 None] Created volume successfully. Nov 02 12:40:43 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:40:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:40:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:40:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:40:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:40:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:40:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:40:43 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:40:43 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:40:44 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Nov 02 12:40:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.283s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:40:44 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:40:44 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager._thread_info {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:40:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread count: 28 {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:40:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread info: [<_MainThread(MainThread, started 129944084402304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:40:45 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=4,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:40:45 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:40:56 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=1 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:40:56 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:UPDATE=1 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:41:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-99fcc498-6c8e-412e-a7b3-b90f5e9d19d6 req-3ff6a129-e0a7-4bb6-8b7c-cb3c2c7ddebd tempest-TestServerVolumeAttachmentScenario-99354544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-99fcc498-6c8e-412e-a7b3-b90f5e9d19d6 req-3ff6a129-e0a7-4bb6-8b7c-cb3c2c7ddebd tempest-TestServerVolumeAttachmentScenario-99354544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-99fcc498-6c8e-412e-a7b3-b90f5e9d19d6 req-3ff6a129-e0a7-4bb6-8b7c-cb3c2c7ddebd tempest-TestServerVolumeAttachmentScenario-99354544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:05 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-99fcc498-6c8e-412e-a7b3-b90f5e9d19d6 req-3ff6a129-e0a7-4bb6-8b7c-cb3c2c7ddebd tempest-TestServerVolumeAttachmentScenario-99354544 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae', 'name': 'volume-970a6cfb-2e3b-4711-a3b9-a7218e9f6250', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fd074376-1be4-4b1f-9d68-a3a944d2fe4f', 'enforce_multipath': True} {{(pid=86515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:41:05 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-99fcc498-6c8e-412e-a7b3-b90f5e9d19d6 req-3ff6a129-e0a7-4bb6-8b7c-cb3c2c7ddebd tempest-TestServerVolumeAttachmentScenario-99354544 None] attachment_update completed successfully. Nov 02 12:41:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-4a07a14f-939d-405b-8968-afa7f0d62236 req-4bdd2a53-0963-44fe-81a2-04daa1381625 tempest-TestServerVolumeAttachmentScenario-99354544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-4a07a14f-939d-405b-8968-afa7f0d62236 req-4bdd2a53-0963-44fe-81a2-04daa1381625 tempest-TestServerVolumeAttachmentScenario-99354544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-4a07a14f-939d-405b-8968-afa7f0d62236 req-4bdd2a53-0963-44fe-81a2-04daa1381625 tempest-TestServerVolumeAttachmentScenario-99354544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:09 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-4a07a14f-939d-405b-8968-afa7f0d62236 req-4bdd2a53-0963-44fe-81a2-04daa1381625 tempest-TestServerVolumeAttachmentScenario-99354544 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae', 'name': 'volume-f093ae12-1221-4820-9cc3-b684980cae4d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '251a31d7-8544-4867-b4ff-dc79f32fad55', 'enforce_multipath': True} {{(pid=86515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:41:09 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-4a07a14f-939d-405b-8968-afa7f0d62236 req-4bdd2a53-0963-44fe-81a2-04daa1381625 tempest-TestServerVolumeAttachmentScenario-99354544 None] attachment_update completed successfully. Nov 02 12:41:10 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-969ceda9-adf1-4d66-8441-ef819ec4cf1a req-e2019658-6b01-4fa2-aad9-3bed34498a94 tempest-TestServerVolumeAttachmentScenario-99354544 None] Terminate volume connection completed successfully. Nov 02 12:41:10 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-969ceda9-adf1-4d66-8441-ef819ec4cf1a req-e2019658-6b01-4fa2-aad9-3bed34498a94 tempest-TestServerVolumeAttachmentScenario-99354544 None] Deleting attachment 251a31d7-8544-4867-b4ff-dc79f32fad55. {{(pid=86515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:41:12 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-5a4a9b5d-58e8-4667-ba92-4bab2872045c req-5edc1d04-cf5c-4310-812e-b6e9e7ddb312 tempest-TestServerVolumeAttachmentScenario-99354544 None] Terminate volume connection completed successfully. Nov 02 12:41:12 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-5a4a9b5d-58e8-4667-ba92-4bab2872045c req-5edc1d04-cf5c-4310-812e-b6e9e7ddb312 tempest-TestServerVolumeAttachmentScenario-99354544 None] Deleting attachment fd074376-1be4-4b1f-9d68-a3a944d2fe4f. {{(pid=86515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:41:16 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-08abbe36-0e90-41ff-bf66-fb06987df353 tempest-TestServerVolumeAttachmentScenario-99354544 None] Acquiring lock "cinder-f093ae12-1221-4820-9cc3-b684980cae4d-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:41:16 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-08abbe36-0e90-41ff-bf66-fb06987df353 tempest-TestServerVolumeAttachmentScenario-99354544 None] Lock "cinder-f093ae12-1221-4820-9cc3-b684980cae4d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:41:16 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-08abbe36-0e90-41ff-bf66-fb06987df353 tempest-TestServerVolumeAttachmentScenario-99354544 None] Acquiring lock "cinder-quobyte-f093ae12-1221-4820-9cc3-b684980cae4d" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:41:16 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-08abbe36-0e90-41ff-bf66-fb06987df353 tempest-TestServerVolumeAttachmentScenario-99354544 None] Lock "cinder-quobyte-f093ae12-1221-4820-9cc3-b684980cae4d" acquired by "delete_volume" :: waited 0.015s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:41:16 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd646369-0d7d-48ac-ae62-2a2b9bdbb9fb]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:41:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-08abbe36-0e90-41ff-bf66-fb06987df353 tempest-TestServerVolumeAttachmentScenario-99354544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f093ae12-1221-4820-9cc3-b684980cae4d {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:16 devstack sudo[104639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f093ae12-1221-4820-9cc3-b684980cae4d Nov 02 12:41:16 devstack sudo[104639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:17 devstack sudo[104639]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-08abbe36-0e90-41ff-bf66-fb06987df353 tempest-TestServerVolumeAttachmentScenario-99354544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f093ae12-1221-4820-9cc3-b684980cae4d" returned: 0 in 0.377s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-08abbe36-0e90-41ff-bf66-fb06987df353 tempest-TestServerVolumeAttachmentScenario-99354544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f093ae12-1221-4820-9cc3-b684980cae4d {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:17 devstack sudo[104644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f093ae12-1221-4820-9cc3-b684980cae4d Nov 02 12:41:17 devstack sudo[104644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:17 devstack sudo[104644]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-08abbe36-0e90-41ff-bf66-fb06987df353 tempest-TestServerVolumeAttachmentScenario-99354544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f093ae12-1221-4820-9cc3-b684980cae4d" returned: 0 in 0.239s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:17 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-08abbe36-0e90-41ff-bf66-fb06987df353 tempest-TestServerVolumeAttachmentScenario-99354544 None] Lock "cinder-quobyte-f093ae12-1221-4820-9cc3-b684980cae4d" released by "delete_volume" :: held 0.664s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:41:17 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-08abbe36-0e90-41ff-bf66-fb06987df353 tempest-TestServerVolumeAttachmentScenario-99354544 None] Created reservations ['000d26ae-4d09-4bad-be72-d676cf794270', '561474d0-1b5c-434e-949e-37c81bef82c7', '96e7b15c-fb8d-428c-8c0a-0c9f7be5a69c', 'e6ea949a-3be0-448b-95c5-edb9afacf4e8'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:41:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-08abbe36-0e90-41ff-bf66-fb06987df353 tempest-TestServerVolumeAttachmentScenario-99354544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-08abbe36-0e90-41ff-bf66-fb06987df353 tempest-TestServerVolumeAttachmentScenario-99354544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-08abbe36-0e90-41ff-bf66-fb06987df353 tempest-TestServerVolumeAttachmentScenario-99354544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:41:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-08abbe36-0e90-41ff-bf66-fb06987df353 tempest-TestServerVolumeAttachmentScenario-99354544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:41:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-08abbe36-0e90-41ff-bf66-fb06987df353 tempest-TestServerVolumeAttachmentScenario-99354544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-08abbe36-0e90-41ff-bf66-fb06987df353 tempest-TestServerVolumeAttachmentScenario-99354544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:17 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:41:17 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:17 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-08abbe36-0e90-41ff-bf66-fb06987df353 tempest-TestServerVolumeAttachmentScenario-99354544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.246s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:17 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-08abbe36-0e90-41ff-bf66-fb06987df353 tempest-TestServerVolumeAttachmentScenario-99354544 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:41:17 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-08abbe36-0e90-41ff-bf66-fb06987df353 tempest-TestServerVolumeAttachmentScenario-99354544 None] Deleted volume successfully. Nov 02 12:41:17 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-08abbe36-0e90-41ff-bf66-fb06987df353 tempest-TestServerVolumeAttachmentScenario-99354544 None] Lock "cinder-f093ae12-1221-4820-9cc3-b684980cae4d-delete_volume" released by "delete_volume" :: held 1.129s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:41:17 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e87b3381-f6dd-4381-92d8-dd7e1800dc59 tempest-TestServerVolumeAttachmentScenario-99354544 None] Acquiring lock "cinder-970a6cfb-2e3b-4711-a3b9-a7218e9f6250-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:41:17 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e87b3381-f6dd-4381-92d8-dd7e1800dc59 tempest-TestServerVolumeAttachmentScenario-99354544 None] Lock "cinder-970a6cfb-2e3b-4711-a3b9-a7218e9f6250-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:41:17 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e87b3381-f6dd-4381-92d8-dd7e1800dc59 tempest-TestServerVolumeAttachmentScenario-99354544 None] Acquiring lock "cinder-quobyte-970a6cfb-2e3b-4711-a3b9-a7218e9f6250" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:41:17 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e87b3381-f6dd-4381-92d8-dd7e1800dc59 tempest-TestServerVolumeAttachmentScenario-99354544 None] Lock "cinder-quobyte-970a6cfb-2e3b-4711-a3b9-a7218e9f6250" acquired by "delete_volume" :: waited 0.017s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:41:17 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ef2d12-38ad-4b5f-99c7-13f8f94263c7]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:41:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e87b3381-f6dd-4381-92d8-dd7e1800dc59 tempest-TestServerVolumeAttachmentScenario-99354544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-970a6cfb-2e3b-4711-a3b9-a7218e9f6250 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:18 devstack sudo[104650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-970a6cfb-2e3b-4711-a3b9-a7218e9f6250 Nov 02 12:41:18 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:18 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e87b3381-f6dd-4381-92d8-dd7e1800dc59 tempest-TestServerVolumeAttachmentScenario-99354544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-970a6cfb-2e3b-4711-a3b9-a7218e9f6250" returned: 0 in 0.352s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e87b3381-f6dd-4381-92d8-dd7e1800dc59 tempest-TestServerVolumeAttachmentScenario-99354544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-970a6cfb-2e3b-4711-a3b9-a7218e9f6250 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:18 devstack sudo[104655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-970a6cfb-2e3b-4711-a3b9-a7218e9f6250 Nov 02 12:41:18 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:18 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e87b3381-f6dd-4381-92d8-dd7e1800dc59 tempest-TestServerVolumeAttachmentScenario-99354544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-970a6cfb-2e3b-4711-a3b9-a7218e9f6250" returned: 0 in 0.262s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:18 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e87b3381-f6dd-4381-92d8-dd7e1800dc59 tempest-TestServerVolumeAttachmentScenario-99354544 None] Lock "cinder-quobyte-970a6cfb-2e3b-4711-a3b9-a7218e9f6250" released by "delete_volume" :: held 0.654s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:41:18 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-e87b3381-f6dd-4381-92d8-dd7e1800dc59 tempest-TestServerVolumeAttachmentScenario-99354544 None] Created reservations ['ddae2f91-0c1e-4b23-b26b-984b0e645732', '24a5c884-7b19-411a-bc8e-c70780ee613e', '4fcbea31-2f31-40df-85f2-3c82b42af6e6', '3442b92a-a8ce-42d7-88b1-4140a8a2bd0c'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:41:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e87b3381-f6dd-4381-92d8-dd7e1800dc59 tempest-TestServerVolumeAttachmentScenario-99354544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e87b3381-f6dd-4381-92d8-dd7e1800dc59 tempest-TestServerVolumeAttachmentScenario-99354544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:18 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e87b3381-f6dd-4381-92d8-dd7e1800dc59 tempest-TestServerVolumeAttachmentScenario-99354544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:41:18 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e87b3381-f6dd-4381-92d8-dd7e1800dc59 tempest-TestServerVolumeAttachmentScenario-99354544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:41:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e87b3381-f6dd-4381-92d8-dd7e1800dc59 tempest-TestServerVolumeAttachmentScenario-99354544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e87b3381-f6dd-4381-92d8-dd7e1800dc59 tempest-TestServerVolumeAttachmentScenario-99354544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:18 devstack sudo[104658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:41:18 devstack sudo[104658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:18 devstack sudo[104658]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e87b3381-f6dd-4381-92d8-dd7e1800dc59 tempest-TestServerVolumeAttachmentScenario-99354544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.256s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:18 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-e87b3381-f6dd-4381-92d8-dd7e1800dc59 tempest-TestServerVolumeAttachmentScenario-99354544 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:41:18 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-e87b3381-f6dd-4381-92d8-dd7e1800dc59 tempest-TestServerVolumeAttachmentScenario-99354544 None] Deleted volume successfully. Nov 02 12:41:18 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e87b3381-f6dd-4381-92d8-dd7e1800dc59 tempest-TestServerVolumeAttachmentScenario-99354544 None] Lock "cinder-970a6cfb-2e3b-4711-a3b9-a7218e9f6250-delete_volume" released by "delete_volume" :: held 1.120s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:41:28 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=27,cinder:UPDATE=18,cinder:INSERT=4 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:41:28 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=23,cinder:UPDATE=20,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:41:43 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:41:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:41:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:41:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:43 devstack sudo[104705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:41:43 devstack sudo[104705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:44 devstack sudo[104705]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.250s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:44 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:41:44 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager._thread_info {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:41:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread count: 28 {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:41:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread info: [<_MainThread(MainThread, started 129944084402304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:41:50 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-4688b446-60ef-4d0c-91c6-c629d513f9ab tempest-TestStampPattern-1109703018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:41:50 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4688b446-60ef-4d0c-91c6-c629d513f9ab tempest-TestStampPattern-1109703018 None] Flow 'volume_create_manager' (c29341e2-fc7f-4316-8a0c-c3eefd602339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:41:50 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4688b446-60ef-4d0c-91c6-c629d513f9ab tempest-TestStampPattern-1109703018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9028fb77-b894-4a40-9611-fc58d9526fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4688b446-60ef-4d0c-91c6-c629d513f9ab tempest-TestStampPattern-1109703018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9028fb77-b894-4a40-9611-fc58d9526fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-341831652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9993b0d5-1ef0-48a0-8740-639ee0385bf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdc18ead38b64f18a1c38d2e8035ad4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:41:51Z,use_quota=True,user_id='8a9c121463484c1db9f5873ec8463700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4688b446-60ef-4d0c-91c6-c629d513f9ab tempest-TestStampPattern-1109703018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c40a195-f72f-495f-bac9-842ce2b0ad1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4688b446-60ef-4d0c-91c6-c629d513f9ab tempest-TestStampPattern-1109703018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c40a195-f72f-495f-bac9-842ce2b0ad1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4688b446-60ef-4d0c-91c6-c629d513f9ab tempest-TestStampPattern-1109703018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e6cb685-536b-4c02-86db-c176f6771048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4688b446-60ef-4d0c-91c6-c629d513f9ab tempest-TestStampPattern-1109703018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e6cb685-536b-4c02-86db-c176f6771048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9993b0d5-1ef0-48a0-8740-639ee0385bf3', 'volume_name': 'volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4688b446-60ef-4d0c-91c6-c629d513f9ab tempest-TestStampPattern-1109703018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e2f47eb-067a-4bc0-a725-215e5bff0c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4688b446-60ef-4d0c-91c6-c629d513f9ab tempest-TestStampPattern-1109703018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e2f47eb-067a-4bc0-a725-215e5bff0c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4688b446-60ef-4d0c-91c6-c629d513f9ab tempest-TestStampPattern-1109703018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (735be997-7ced-4cee-8e04-82e679b268cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:51 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-4688b446-60ef-4d0c-91c6-c629d513f9ab tempest-TestStampPattern-1109703018 None] Volume 9993b0d5-1ef0-48a0-8740-639ee0385bf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3', 'volume_size': 1} Nov 02 12:41:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4688b446-60ef-4d0c-91c6-c629d513f9ab tempest-TestStampPattern-1109703018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4688b446-60ef-4d0c-91c6-c629d513f9ab tempest-TestStampPattern-1109703018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:51 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-4688b446-60ef-4d0c-91c6-c629d513f9ab tempest-TestStampPattern-1109703018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-341831652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9993b0d5-1ef0-48a0-8740-639ee0385bf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdc18ead38b64f18a1c38d2e8035ad4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:41:51Z,use_quota=True,user_id='8a9c121463484c1db9f5873ec8463700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:41:51 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-4688b446-60ef-4d0c-91c6-c629d513f9ab tempest-TestStampPattern-1109703018 None] Creating volume 9993b0d5-1ef0-48a0-8740-639ee0385bf3 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:41:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4688b446-60ef-4d0c-91c6-c629d513f9ab tempest-TestStampPattern-1109703018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:41:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4688b446-60ef-4d0c-91c6-c629d513f9ab tempest-TestStampPattern-1109703018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:41:51 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-4688b446-60ef-4d0c-91c6-c629d513f9ab tempest-TestStampPattern-1109703018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:41:51 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-4688b446-60ef-4d0c-91c6-c629d513f9ab tempest-TestStampPattern-1109703018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:41:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4688b446-60ef-4d0c-91c6-c629d513f9ab tempest-TestStampPattern-1109703018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:51 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-4688b446-60ef-4d0c-91c6-c629d513f9ab tempest-TestStampPattern-1109703018 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:41:51 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-4688b446-60ef-4d0c-91c6-c629d513f9ab tempest-TestStampPattern-1109703018 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:41:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4688b446-60ef-4d0c-91c6-c629d513f9ab tempest-TestStampPattern-1109703018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:51 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3 1073741824 Nov 02 12:41:51 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:51 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4688b446-60ef-4d0c-91c6-c629d513f9ab tempest-TestStampPattern-1109703018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3 1073741824" returned: 0 in 0.450s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4688b446-60ef-4d0c-91c6-c629d513f9ab tempest-TestStampPattern-1109703018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:41:51 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3 Nov 02 12:41:51 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:41:51 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Nov 02 12:41:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4688b446-60ef-4d0c-91c6-c629d513f9ab tempest-TestStampPattern-1109703018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3" returned: 0 in 0.258s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:41:51 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-4688b446-60ef-4d0c-91c6-c629d513f9ab tempest-TestStampPattern-1109703018 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:41:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4688b446-60ef-4d0c-91c6-c629d513f9ab tempest-TestStampPattern-1109703018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:41:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4688b446-60ef-4d0c-91c6-c629d513f9ab tempest-TestStampPattern-1109703018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (735be997-7ced-4cee-8e04-82e679b268cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4688b446-60ef-4d0c-91c6-c629d513f9ab tempest-TestStampPattern-1109703018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f145338-5461-4abe-bd51-3eeeac70c91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:41:51 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-4688b446-60ef-4d0c-91c6-c629d513f9ab tempest-TestStampPattern-1109703018 None] Volume volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3 (9993b0d5-1ef0-48a0-8740-639ee0385bf3): created successfully Nov 02 12:41:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4688b446-60ef-4d0c-91c6-c629d513f9ab tempest-TestStampPattern-1109703018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f145338-5461-4abe-bd51-3eeeac70c91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:41:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4688b446-60ef-4d0c-91c6-c629d513f9ab tempest-TestStampPattern-1109703018 None] Flow 'volume_create_manager' (c29341e2-fc7f-4316-8a0c-c3eefd602339) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:41:51 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-4688b446-60ef-4d0c-91c6-c629d513f9ab tempest-TestStampPattern-1109703018 None] Created volume successfully. Nov 02 12:42:01 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:42:01 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:42:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-7710425f-c99d-4eac-84b3-f3c7f967e87e req-b2ec5b84-5136-4ef5-8508-cc91051e34ad tempest-TestStampPattern-1109703018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:42:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-7710425f-c99d-4eac-84b3-f3c7f967e87e req-b2ec5b84-5136-4ef5-8508-cc91051e34ad tempest-TestStampPattern-1109703018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:42:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-7710425f-c99d-4eac-84b3-f3c7f967e87e req-b2ec5b84-5136-4ef5-8508-cc91051e34ad tempest-TestStampPattern-1109703018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:42:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-7710425f-c99d-4eac-84b3-f3c7f967e87e req-b2ec5b84-5136-4ef5-8508-cc91051e34ad tempest-TestStampPattern-1109703018 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae', 'name': 'volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '821bf321-00bf-4b08-9444-ca61c3366efe', 'enforce_multipath': True} {{(pid=86515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:42:20 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-7710425f-c99d-4eac-84b3-f3c7f967e87e req-b2ec5b84-5136-4ef5-8508-cc91051e34ad tempest-TestStampPattern-1109703018 None] attachment_update completed successfully. Nov 02 12:42:24 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-4eae9ccc-10dd-43bf-8353-0d30ce666577 req-ca7d9784-ac5b-4ec5-9099-460e3195ce0b tempest-TestStampPattern-1109703018 None] Terminate volume connection completed successfully. Nov 02 12:42:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-4eae9ccc-10dd-43bf-8353-0d30ce666577 req-ca7d9784-ac5b-4ec5-9099-460e3195ce0b tempest-TestStampPattern-1109703018 None] Deleting attachment 821bf321-00bf-4b08-9444-ca61c3366efe. {{(pid=86515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:42:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-cf38668d-4ef4-4711-86b0-29caabb596b9 tempest-TestStampPattern-1109703018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:42:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-cf38668d-4ef4-4711-86b0-29caabb596b9 tempest-TestStampPattern-1109703018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:42:25 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-cf38668d-4ef4-4711-86b0-29caabb596b9 tempest-TestStampPattern-1109703018 None] Creating offline snapshot c2b83754-7eca-4841-b5e8-14363cea2e66 of volume 9993b0d5-1ef0-48a0-8740-639ee0385bf3 {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:42:25 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[07081c81-cb50-4f52-a76c-471db5df509d]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:42:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cf38668d-4ef4-4711-86b0-29caabb596b9 tempest-TestStampPattern-1109703018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:25 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3 Nov 02 12:42:25 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:26 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cf38668d-4ef4-4711-86b0-29caabb596b9 tempest-TestStampPattern-1109703018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3" returned: 0 in 0.356s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cf38668d-4ef4-4711-86b0-29caabb596b9 tempest-TestStampPattern-1109703018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3.c2b83754-7eca-4841-b5e8-14363cea2e66 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:26 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3.c2b83754-7eca-4841-b5e8-14363cea2e66 1G Nov 02 12:42:26 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:26 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cf38668d-4ef4-4711-86b0-29caabb596b9 tempest-TestStampPattern-1109703018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3.c2b83754-7eca-4841-b5e8-14363cea2e66 1G" returned: 0 in 0.367s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cf38668d-4ef4-4711-86b0-29caabb596b9 tempest-TestStampPattern-1109703018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3.c2b83754-7eca-4841-b5e8-14363cea2e66 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:26 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3.c2b83754-7eca-4841-b5e8-14363cea2e66 Nov 02 12:42:26 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:26 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cf38668d-4ef4-4711-86b0-29caabb596b9 tempest-TestStampPattern-1109703018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3.c2b83754-7eca-4841-b5e8-14363cea2e66" returned: 0 in 0.278s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:26 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-cf38668d-4ef4-4711-86b0-29caabb596b9 tempest-TestStampPattern-1109703018 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3.c2b83754-7eca-4841-b5e8-14363cea2e66 is being set with open permissions: ugo+rw Nov 02 12:42:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cf38668d-4ef4-4711-86b0-29caabb596b9 tempest-TestStampPattern-1109703018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3.c2b83754-7eca-4841-b5e8-14363cea2e66 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:26 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3.c2b83754-7eca-4841-b5e8-14363cea2e66 Nov 02 12:42:26 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:26 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cf38668d-4ef4-4711-86b0-29caabb596b9 tempest-TestStampPattern-1109703018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3.c2b83754-7eca-4841-b5e8-14363cea2e66" returned: 0 in 0.239s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cf38668d-4ef4-4711-86b0-29caabb596b9 tempest-TestStampPattern-1109703018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:27 devstack sudo[105349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3.info Nov 02 12:42:27 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:27 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cf38668d-4ef4-4711-86b0-29caabb596b9 tempest-TestStampPattern-1109703018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3.info" returned: 0 in 0.256s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:27 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-cf38668d-4ef4-4711-86b0-29caabb596b9 tempest-TestStampPattern-1109703018 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3.info is being set with open permissions: ugo+rw Nov 02 12:42:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cf38668d-4ef4-4711-86b0-29caabb596b9 tempest-TestStampPattern-1109703018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:27 devstack sudo[105352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3.info Nov 02 12:42:27 devstack sudo[105352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:27 devstack sudo[105352]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cf38668d-4ef4-4711-86b0-29caabb596b9 tempest-TestStampPattern-1109703018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3.info" returned: 0 in 0.243s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-cf38668d-4ef4-4711-86b0-29caabb596b9 tempest-TestStampPattern-1109703018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.821s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:42:27 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-cf38668d-4ef4-4711-86b0-29caabb596b9 tempest-TestStampPattern-1109703018 None] Create snapshot completed successfully Nov 02 12:42:34 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:42:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Flow 'volume_create_manager' (2ef51932-38c9-416d-b8e8-a19fe7ed31fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:42:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d50196bb-b87f-4635-9b47-fd334c2895d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:42:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d50196bb-b87f-4635-9b47-fd334c2895d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1974928901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=493cc741-45cb-4c46-875e-88fa84525244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdc18ead38b64f18a1c38d2e8035ad4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c2b83754-7eca-4841-b5e8-14363cea2e66,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:42:34Z,use_quota=True,user_id='8a9c121463484c1db9f5873ec8463700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:42:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2562e776-2553-42d8-be53-1bf2c719f057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:42:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2562e776-2553-42d8-be53-1bf2c719f057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:42:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca75ace3-6907-4c36-aa1e-c725e8e912d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:42:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca75ace3-6907-4c36-aa1e-c725e8e912d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '493cc741-45cb-4c46-875e-88fa84525244', 'volume_name': 'volume-493cc741-45cb-4c46-875e-88fa84525244', 'volume_size': 1, 'snapshot_id': 'c2b83754-7eca-4841-b5e8-14363cea2e66'}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:42:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80949b9e-c823-46c4-9fcb-0991db204dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:42:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80949b9e-c823-46c4-9fcb-0991db204dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:42:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daa4f593-459f-4dbe-b1b3-b54a2968b0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:42:34 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Volume 493cc741-45cb-4c46-875e-88fa84525244: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-493cc741-45cb-4c46-875e-88fa84525244', 'volume_size': 1, 'snapshot_id': 'c2b83754-7eca-4841-b5e8-14363cea2e66'} Nov 02 12:42:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:42:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:42:34 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Acquiring lock "cinder-quobyte-c2b83754-7eca-4841-b5e8-14363cea2e66-493cc741-45cb-4c46-875e-88fa84525244" by "_create_volume_from_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:42:34 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Lock "cinder-quobyte-c2b83754-7eca-4841-b5e8-14363cea2e66-493cc741-45cb-4c46-875e-88fa84525244" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:42:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Creating volume 493cc741-45cb-4c46-875e-88fa84525244 from snapshot c2b83754-7eca-4841-b5e8-14363cea2e66 {{(pid=86515) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 12:42:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:42:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:42:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:42:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:42:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:42:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:42:34 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Acquiring lock "cinder-quobyte-493cc741-45cb-4c46-875e-88fa84525244" by "_copy_volume_from_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:42:34 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Lock "cinder-quobyte-493cc741-45cb-4c46-875e-88fa84525244" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:42:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] snapshot: c2b83754-7eca-4841-b5e8-14363cea2e66, volume: 493cc741-45cb-4c46-875e-88fa84525244, {{(pid=86515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 12:42:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:42:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:42:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:42:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:42:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:42:34 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b64ff7-aa6a-4958-bded-7dcfaf37346e]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:42:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3.c2b83754-7eca-4841-b5e8-14363cea2e66 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:34 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3.c2b83754-7eca-4841-b5e8-14363cea2e66 Nov 02 12:42:34 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:34 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3.c2b83754-7eca-4841-b5e8-14363cea2e66" returned: 0 in 0.367s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:42:34 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[93136db5-9ffd-4222-8c89-41d3647ad48d]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:42:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:35 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3 Nov 02 12:42:35 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:35 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3" returned: 0 in 0.447s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:35 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] will copy from snapshot at /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3 {{(pid=86515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 12:42:35 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Creating direct copy from snapshot {{(pid=86515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 12:42:35 devstack cinder-volume[86515]: DEBUG cinder.utils [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Path /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-493cc741-45cb-4c46-875e-88fa84525244 not found in is_blk_device check {{(pid=86515) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 12:42:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-493cc741-45cb-4c46-875e-88fa84525244 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:35 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-493cc741-45cb-4c46-875e-88fa84525244 Nov 02 12:42:35 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:43 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-493cc741-45cb-4c46-875e-88fa84525244" returned: 0 in 8.133s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:43 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Image conversion details: src /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3, size 1024.00 MB, duration 8.14 sec, destination /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-493cc741-45cb-4c46-875e-88fa84525244 {{(pid=86515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 12:42:43 devstack cinder-volume[86515]: INFO cinder.image.image_utils [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Converted 1024.00 MB image at 125.86 MB/s Nov 02 12:42:43 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-493cc741-45cb-4c46-875e-88fa84525244 is being set with open permissions: ugo+rw Nov 02 12:42:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-493cc741-45cb-4c46-875e-88fa84525244 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:43 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-493cc741-45cb-4c46-875e-88fa84525244 Nov 02 12:42:43 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:43 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:42:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:42:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:42:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:42:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:42:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:42:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:42:43 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:42:43 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:42:44 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-493cc741-45cb-4c46-875e-88fa84525244" returned: 0 in 0.454s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:44 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Lock "cinder-quobyte-493cc741-45cb-4c46-875e-88fa84525244" released by "_copy_volume_from_snapshot" :: held 9.496s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:42:44 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Lock "cinder-quobyte-c2b83754-7eca-4841-b5e8-14363cea2e66-493cc741-45cb-4c46-875e-88fa84525244" released by "_create_volume_from_snapshot" :: held 9.599s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:42:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.619s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:42:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daa4f593-459f-4dbe-b1b3-b54a2968b0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-493cc741-45cb-4c46-875e-88fa84525244', 'volume_size': 1, 'snapshot_id': 'c2b83754-7eca-4841-b5e8-14363cea2e66'}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:42:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (560def0b-8e15-4dd0-9984-133828d79da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:42:44 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Volume volume-493cc741-45cb-4c46-875e-88fa84525244 (493cc741-45cb-4c46-875e-88fa84525244): created successfully Nov 02 12:42:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (560def0b-8e15-4dd0-9984-133828d79da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:42:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Flow 'volume_create_manager' (2ef51932-38c9-416d-b8e8-a19fe7ed31fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:42:44 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-8ab5a145-4794-4d53-aafb-5b571996d5d1 tempest-TestStampPattern-1109703018 None] Created volume successfully. Nov 02 12:42:44 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Nov 02 12:42:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.404s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:42:44 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:42:44 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager._thread_info {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:42:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread count: 28 {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:42:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread info: [<_MainThread(MainThread, started 129944084402304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:42:56 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=13,cinder:UPDATE=8,cinder:INSERT=2 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:42:56 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=17,cinder:UPDATE=5,cinder:DELETE=2 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:43:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-148584c9-ae22-4c34-9c61-4f6f5d395692 req-5ab6d3da-28bb-41de-ac95-d5fe2b21ad51 tempest-TestStampPattern-1109703018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:43:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-148584c9-ae22-4c34-9c61-4f6f5d395692 req-5ab6d3da-28bb-41de-ac95-d5fe2b21ad51 tempest-TestStampPattern-1109703018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:43:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [req-148584c9-ae22-4c34-9c61-4f6f5d395692 req-5ab6d3da-28bb-41de-ac95-d5fe2b21ad51 tempest-TestStampPattern-1109703018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:43:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-148584c9-ae22-4c34-9c61-4f6f5d395692 req-5ab6d3da-28bb-41de-ac95-d5fe2b21ad51 tempest-TestStampPattern-1109703018 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae', 'name': 'volume-493cc741-45cb-4c46-875e-88fa84525244', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '562690a8-2ef2-4460-ad58-eaf91575b8d1', 'enforce_multipath': True} {{(pid=86515) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 12:43:24 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-148584c9-ae22-4c34-9c61-4f6f5d395692 req-5ab6d3da-28bb-41de-ac95-d5fe2b21ad51 tempest-TestStampPattern-1109703018 None] attachment_update completed successfully. Nov 02 12:43:26 devstack cinder-volume[86515]: INFO cinder.volume.manager [req-c85d25bb-7596-4555-83c7-839d3d692ace req-41563191-ca6d-49e6-94ec-1f7e7b25ad56 tempest-TestStampPattern-1109703018 None] Terminate volume connection completed successfully. Nov 02 12:43:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [req-c85d25bb-7596-4555-83c7-839d3d692ace req-41563191-ca6d-49e6-94ec-1f7e7b25ad56 tempest-TestStampPattern-1109703018 None] Deleting attachment 562690a8-2ef2-4460-ad58-eaf91575b8d1. {{(pid=86515) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 12:43:31 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5bea3cba-e8e7-4bf8-b4fd-7af758f81108 tempest-TestStampPattern-1109703018 None] Acquiring lock "cinder-493cc741-45cb-4c46-875e-88fa84525244-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:43:31 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5bea3cba-e8e7-4bf8-b4fd-7af758f81108 tempest-TestStampPattern-1109703018 None] Lock "cinder-493cc741-45cb-4c46-875e-88fa84525244-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:43:31 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5bea3cba-e8e7-4bf8-b4fd-7af758f81108 tempest-TestStampPattern-1109703018 None] Acquiring lock "cinder-quobyte-493cc741-45cb-4c46-875e-88fa84525244" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:43:31 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5bea3cba-e8e7-4bf8-b4fd-7af758f81108 tempest-TestStampPattern-1109703018 None] Lock "cinder-quobyte-493cc741-45cb-4c46-875e-88fa84525244" acquired by "delete_volume" :: waited 0.012s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:43:31 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1891b77-f320-4169-890c-032e36655f06]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:43:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5bea3cba-e8e7-4bf8-b4fd-7af758f81108 tempest-TestStampPattern-1109703018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-493cc741-45cb-4c46-875e-88fa84525244 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:31 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-493cc741-45cb-4c46-875e-88fa84525244 Nov 02 12:43:31 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:31 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5bea3cba-e8e7-4bf8-b4fd-7af758f81108 tempest-TestStampPattern-1109703018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-493cc741-45cb-4c46-875e-88fa84525244" returned: 0 in 0.355s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5bea3cba-e8e7-4bf8-b4fd-7af758f81108 tempest-TestStampPattern-1109703018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-493cc741-45cb-4c46-875e-88fa84525244 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:31 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-493cc741-45cb-4c46-875e-88fa84525244 Nov 02 12:43:31 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:31 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5bea3cba-e8e7-4bf8-b4fd-7af758f81108 tempest-TestStampPattern-1109703018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-493cc741-45cb-4c46-875e-88fa84525244" returned: 0 in 0.243s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:31 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5bea3cba-e8e7-4bf8-b4fd-7af758f81108 tempest-TestStampPattern-1109703018 None] Lock "cinder-quobyte-493cc741-45cb-4c46-875e-88fa84525244" released by "delete_volume" :: held 0.638s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:43:31 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-5bea3cba-e8e7-4bf8-b4fd-7af758f81108 tempest-TestStampPattern-1109703018 None] Created reservations ['a85c1a6d-b72e-4e38-b7f3-8e0d799ad693', 'c4e35a35-eb97-44e2-88b0-eb1b64c44ff5', '599ae65a-d794-4637-9b8c-5297a362ed6c', 'f30363c8-e46d-4059-ace8-1eb94c5bb1eb'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:43:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5bea3cba-e8e7-4bf8-b4fd-7af758f81108 tempest-TestStampPattern-1109703018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:43:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5bea3cba-e8e7-4bf8-b4fd-7af758f81108 tempest-TestStampPattern-1109703018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:43:31 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5bea3cba-e8e7-4bf8-b4fd-7af758f81108 tempest-TestStampPattern-1109703018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:43:31 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5bea3cba-e8e7-4bf8-b4fd-7af758f81108 tempest-TestStampPattern-1109703018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:43:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5bea3cba-e8e7-4bf8-b4fd-7af758f81108 tempest-TestStampPattern-1109703018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:43:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5bea3cba-e8e7-4bf8-b4fd-7af758f81108 tempest-TestStampPattern-1109703018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:31 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:43:31 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:32 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5bea3cba-e8e7-4bf8-b4fd-7af758f81108 tempest-TestStampPattern-1109703018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.233s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:32 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-5bea3cba-e8e7-4bf8-b4fd-7af758f81108 tempest-TestStampPattern-1109703018 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:43:32 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-5bea3cba-e8e7-4bf8-b4fd-7af758f81108 tempest-TestStampPattern-1109703018 None] Deleted volume successfully. Nov 02 12:43:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5bea3cba-e8e7-4bf8-b4fd-7af758f81108 tempest-TestStampPattern-1109703018 None] Lock "cinder-493cc741-45cb-4c46-875e-88fa84525244-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:43:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-253ae778-c1de-4c6a-a022-05fe6140d47a tempest-TestStampPattern-1109703018 None] Acquiring lock "cinder-c2b83754-7eca-4841-b5e8-14363cea2e66-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:43:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-253ae778-c1de-4c6a-a022-05fe6140d47a tempest-TestStampPattern-1109703018 None] Lock "cinder-c2b83754-7eca-4841-b5e8-14363cea2e66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:43:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-253ae778-c1de-4c6a-a022-05fe6140d47a tempest-TestStampPattern-1109703018 None] Acquiring lock "cinder-quobyte-9993b0d5-1ef0-48a0-8740-639ee0385bf3" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:43:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-253ae778-c1de-4c6a-a022-05fe6140d47a tempest-TestStampPattern-1109703018 None] Lock "cinder-quobyte-9993b0d5-1ef0-48a0-8740-639ee0385bf3" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:43:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-253ae778-c1de-4c6a-a022-05fe6140d47a tempest-TestStampPattern-1109703018 None] Acquiring lock "cinder-quobyte-c2b83754-7eca-4841-b5e8-14363cea2e66" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:43:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-253ae778-c1de-4c6a-a022-05fe6140d47a tempest-TestStampPattern-1109703018 None] Lock "cinder-quobyte-c2b83754-7eca-4841-b5e8-14363cea2e66" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:43:32 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-253ae778-c1de-4c6a-a022-05fe6140d47a tempest-TestStampPattern-1109703018 None] Deleting offline snapshot c2b83754-7eca-4841-b5e8-14363cea2e66 of volume 9993b0d5-1ef0-48a0-8740-639ee0385bf3 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:43:32 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-253ae778-c1de-4c6a-a022-05fe6140d47a tempest-TestStampPattern-1109703018 None] snapshot_file for this snap is: volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3.c2b83754-7eca-4841-b5e8-14363cea2e66 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:43:32 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[552d59ed-9d0b-4eed-9244-0bdf0548ba68]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:43:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-253ae778-c1de-4c6a-a022-05fe6140d47a tempest-TestStampPattern-1109703018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3.c2b83754-7eca-4841-b5e8-14363cea2e66 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:32 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3.c2b83754-7eca-4841-b5e8-14363cea2e66 Nov 02 12:43:32 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:32 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-253ae778-c1de-4c6a-a022-05fe6140d47a tempest-TestStampPattern-1109703018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3.c2b83754-7eca-4841-b5e8-14363cea2e66" returned: 0 in 0.333s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:32 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-253ae778-c1de-4c6a-a022-05fe6140d47a tempest-TestStampPattern-1109703018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:43:32 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[491aa58b-a8b9-48b1-b3ab-2efed653685c]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:43:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-253ae778-c1de-4c6a-a022-05fe6140d47a tempest-TestStampPattern-1109703018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:32 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3 Nov 02 12:43:32 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:33 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-253ae778-c1de-4c6a-a022-05fe6140d47a tempest-TestStampPattern-1109703018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3" returned: 0 in 0.517s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-253ae778-c1de-4c6a-a022-05fe6140d47a tempest-TestStampPattern-1109703018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3.c2b83754-7eca-4841-b5e8-14363cea2e66 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:33 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3.c2b83754-7eca-4841-b5e8-14363cea2e66 Nov 02 12:43:33 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:33 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-253ae778-c1de-4c6a-a022-05fe6140d47a tempest-TestStampPattern-1109703018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3.c2b83754-7eca-4841-b5e8-14363cea2e66" returned: 0 in 0.337s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-253ae778-c1de-4c6a-a022-05fe6140d47a tempest-TestStampPattern-1109703018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3.c2b83754-7eca-4841-b5e8-14363cea2e66 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:33 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3.c2b83754-7eca-4841-b5e8-14363cea2e66 Nov 02 12:43:33 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:33 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-253ae778-c1de-4c6a-a022-05fe6140d47a tempest-TestStampPattern-1109703018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3.c2b83754-7eca-4841-b5e8-14363cea2e66" returned: 0 in 0.246s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:34 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-253ae778-c1de-4c6a-a022-05fe6140d47a tempest-TestStampPattern-1109703018 None] Lock "cinder-quobyte-c2b83754-7eca-4841-b5e8-14363cea2e66" released by "_delete_snapshot" :: held 1.534s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:43:34 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-253ae778-c1de-4c6a-a022-05fe6140d47a tempest-TestStampPattern-1109703018 None] Lock "cinder-quobyte-9993b0d5-1ef0-48a0-8740-639ee0385bf3" released by "delete_snapshot" :: held 1.554s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:43:34 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-253ae778-c1de-4c6a-a022-05fe6140d47a tempest-TestStampPattern-1109703018 None] Created reservations ['3a436e7c-e117-4c7d-acc7-7a88b3bc9cd3', '18e3cb05-6821-4970-89bc-e601ae7d8775', '88e37bc3-0b43-46b8-a3f0-71cc94ca1668', '9e0f4e2e-c85d-45d1-b8e5-f58965142f7d'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:43:34 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-253ae778-c1de-4c6a-a022-05fe6140d47a tempest-TestStampPattern-1109703018 None] Delete snapshot completed successfully. Nov 02 12:43:34 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-253ae778-c1de-4c6a-a022-05fe6140d47a tempest-TestStampPattern-1109703018 None] Lock "cinder-c2b83754-7eca-4841-b5e8-14363cea2e66-delete_snapshot" released by "delete_snapshot" :: held 1.683s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:43:37 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5c6054a7-5f81-498e-8510-8f81cc016704 tempest-TestStampPattern-1109703018 None] Acquiring lock "cinder-9993b0d5-1ef0-48a0-8740-639ee0385bf3-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:43:37 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5c6054a7-5f81-498e-8510-8f81cc016704 tempest-TestStampPattern-1109703018 None] Lock "cinder-9993b0d5-1ef0-48a0-8740-639ee0385bf3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:43:38 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5c6054a7-5f81-498e-8510-8f81cc016704 tempest-TestStampPattern-1109703018 None] Acquiring lock "cinder-quobyte-9993b0d5-1ef0-48a0-8740-639ee0385bf3" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:43:38 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5c6054a7-5f81-498e-8510-8f81cc016704 tempest-TestStampPattern-1109703018 None] Lock "cinder-quobyte-9993b0d5-1ef0-48a0-8740-639ee0385bf3" acquired by "delete_volume" :: waited 0.018s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:43:38 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4ba439-9a2d-4f2e-a0a2-a070e3e17d6a]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:43:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5c6054a7-5f81-498e-8510-8f81cc016704 tempest-TestStampPattern-1109703018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:38 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3 Nov 02 12:43:38 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:38 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5c6054a7-5f81-498e-8510-8f81cc016704 tempest-TestStampPattern-1109703018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3" returned: 0 in 0.352s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5c6054a7-5f81-498e-8510-8f81cc016704 tempest-TestStampPattern-1109703018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:38 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3 Nov 02 12:43:38 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:38 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5c6054a7-5f81-498e-8510-8f81cc016704 tempest-TestStampPattern-1109703018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9993b0d5-1ef0-48a0-8740-639ee0385bf3" returned: 0 in 0.236s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:38 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5c6054a7-5f81-498e-8510-8f81cc016704 tempest-TestStampPattern-1109703018 None] Lock "cinder-quobyte-9993b0d5-1ef0-48a0-8740-639ee0385bf3" released by "delete_volume" :: held 0.647s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:43:38 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-5c6054a7-5f81-498e-8510-8f81cc016704 tempest-TestStampPattern-1109703018 None] Created reservations ['1e885f48-7532-41a3-99f9-919ac6dba9d1', '88ca79bb-6a2b-4b35-a63c-afad94b25bab', 'c1ad4285-97b7-4f15-a89f-476897ceda7e', '39989eb6-c0a2-4c3e-849e-852cab1e0f09'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:43:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5c6054a7-5f81-498e-8510-8f81cc016704 tempest-TestStampPattern-1109703018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:43:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5c6054a7-5f81-498e-8510-8f81cc016704 tempest-TestStampPattern-1109703018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:43:38 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5c6054a7-5f81-498e-8510-8f81cc016704 tempest-TestStampPattern-1109703018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:43:38 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5c6054a7-5f81-498e-8510-8f81cc016704 tempest-TestStampPattern-1109703018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:43:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5c6054a7-5f81-498e-8510-8f81cc016704 tempest-TestStampPattern-1109703018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:43:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5c6054a7-5f81-498e-8510-8f81cc016704 tempest-TestStampPattern-1109703018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:38 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:43:38 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:39 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5c6054a7-5f81-498e-8510-8f81cc016704 tempest-TestStampPattern-1109703018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.246s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:39 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-5c6054a7-5f81-498e-8510-8f81cc016704 tempest-TestStampPattern-1109703018 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:43:39 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-5c6054a7-5f81-498e-8510-8f81cc016704 tempest-TestStampPattern-1109703018 None] Deleted volume successfully. Nov 02 12:43:39 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5c6054a7-5f81-498e-8510-8f81cc016704 tempest-TestStampPattern-1109703018 None] Lock "cinder-9993b0d5-1ef0-48a0-8740-639ee0385bf3-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:43:43 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:43:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:43:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:43:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:43:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:43:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:43:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:43 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:43:43 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:44 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.264s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:44 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:43:44 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager._thread_info {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:43:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread count: 28 {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:43:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread info: [<_MainThread(MainThread, started 129944084402304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:43:48 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=24,cinder:INSERT=4,cinder:UPDATE=17,cinder:DELETE=1 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:43:49 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=22,cinder:UPDATE=29,cinder:INSERT=8,cinder:DELETE=1 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:43:50 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e50ebab-7e6d-49e0-810d-d85c45773f38 tempest-ProjectReaderTests-1457658627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:43:50 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4e50ebab-7e6d-49e0-810d-d85c45773f38 tempest-ProjectReaderTests-1457658627 None] Flow 'volume_create_manager' (e24c6a39-c37f-4b48-bb91-16579a112be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:43:50 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4e50ebab-7e6d-49e0-810d-d85c45773f38 tempest-ProjectReaderTests-1457658627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1601b16d-fc84-469e-a27f-bb8d9aa0e596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:43:50 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4e50ebab-7e6d-49e0-810d-d85c45773f38 tempest-ProjectReaderTests-1457658627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1601b16d-fc84-469e-a27f-bb8d9aa0e596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:43:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-711098410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=211961a4-b8e4-45be-9a8a-e6d36a65fa05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='183e3275f09c4762ad169dd217d2cd6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:43:51Z,use_quota=True,user_id='e3b749f5255840b195bdfa2e59c43b9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:43:50 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4e50ebab-7e6d-49e0-810d-d85c45773f38 tempest-ProjectReaderTests-1457658627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7dfc03d-d4e9-45c6-a87f-11969d600305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:43:50 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4e50ebab-7e6d-49e0-810d-d85c45773f38 tempest-ProjectReaderTests-1457658627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7dfc03d-d4e9-45c6-a87f-11969d600305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:43:50 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4e50ebab-7e6d-49e0-810d-d85c45773f38 tempest-ProjectReaderTests-1457658627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13444a83-5d2c-4117-bd2b-2319a2ca85f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:43:50 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4e50ebab-7e6d-49e0-810d-d85c45773f38 tempest-ProjectReaderTests-1457658627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13444a83-5d2c-4117-bd2b-2319a2ca85f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '211961a4-b8e4-45be-9a8a-e6d36a65fa05', 'volume_name': 'volume-211961a4-b8e4-45be-9a8a-e6d36a65fa05', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:43:50 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4e50ebab-7e6d-49e0-810d-d85c45773f38 tempest-ProjectReaderTests-1457658627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56af8e3f-7444-4d67-bf7d-6372aadf1095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:43:50 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4e50ebab-7e6d-49e0-810d-d85c45773f38 tempest-ProjectReaderTests-1457658627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56af8e3f-7444-4d67-bf7d-6372aadf1095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:43:50 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4e50ebab-7e6d-49e0-810d-d85c45773f38 tempest-ProjectReaderTests-1457658627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (773f4307-54c6-4776-bf09-852bd2489761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:43:50 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-4e50ebab-7e6d-49e0-810d-d85c45773f38 tempest-ProjectReaderTests-1457658627 None] Volume 211961a4-b8e4-45be-9a8a-e6d36a65fa05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-211961a4-b8e4-45be-9a8a-e6d36a65fa05', 'volume_size': 1} Nov 02 12:43:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4e50ebab-7e6d-49e0-810d-d85c45773f38 tempest-ProjectReaderTests-1457658627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:43:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4e50ebab-7e6d-49e0-810d-d85c45773f38 tempest-ProjectReaderTests-1457658627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:43:50 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-4e50ebab-7e6d-49e0-810d-d85c45773f38 tempest-ProjectReaderTests-1457658627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:43:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-711098410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=211961a4-b8e4-45be-9a8a-e6d36a65fa05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='183e3275f09c4762ad169dd217d2cd6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:43:51Z,use_quota=True,user_id='e3b749f5255840b195bdfa2e59c43b9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:43:50 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-4e50ebab-7e6d-49e0-810d-d85c45773f38 tempest-ProjectReaderTests-1457658627 None] Creating volume 211961a4-b8e4-45be-9a8a-e6d36a65fa05 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:43:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4e50ebab-7e6d-49e0-810d-d85c45773f38 tempest-ProjectReaderTests-1457658627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:43:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4e50ebab-7e6d-49e0-810d-d85c45773f38 tempest-ProjectReaderTests-1457658627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:43:50 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-4e50ebab-7e6d-49e0-810d-d85c45773f38 tempest-ProjectReaderTests-1457658627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:43:50 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-4e50ebab-7e6d-49e0-810d-d85c45773f38 tempest-ProjectReaderTests-1457658627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:43:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4e50ebab-7e6d-49e0-810d-d85c45773f38 tempest-ProjectReaderTests-1457658627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:43:50 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-4e50ebab-7e6d-49e0-810d-d85c45773f38 tempest-ProjectReaderTests-1457658627 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:43:50 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-4e50ebab-7e6d-49e0-810d-d85c45773f38 tempest-ProjectReaderTests-1457658627 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:43:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4e50ebab-7e6d-49e0-810d-d85c45773f38 tempest-ProjectReaderTests-1457658627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-211961a4-b8e4-45be-9a8a-e6d36a65fa05 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:50 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-211961a4-b8e4-45be-9a8a-e6d36a65fa05 1073741824 Nov 02 12:43:50 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:51 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4e50ebab-7e6d-49e0-810d-d85c45773f38 tempest-ProjectReaderTests-1457658627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-211961a4-b8e4-45be-9a8a-e6d36a65fa05 1073741824" returned: 0 in 0.401s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4e50ebab-7e6d-49e0-810d-d85c45773f38 tempest-ProjectReaderTests-1457658627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-211961a4-b8e4-45be-9a8a-e6d36a65fa05 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:51 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-211961a4-b8e4-45be-9a8a-e6d36a65fa05 Nov 02 12:43:51 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:51 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4e50ebab-7e6d-49e0-810d-d85c45773f38 tempest-ProjectReaderTests-1457658627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-211961a4-b8e4-45be-9a8a-e6d36a65fa05" returned: 0 in 0.229s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:51 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-4e50ebab-7e6d-49e0-810d-d85c45773f38 tempest-ProjectReaderTests-1457658627 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:43:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-4e50ebab-7e6d-49e0-810d-d85c45773f38 tempest-ProjectReaderTests-1457658627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.669s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:43:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4e50ebab-7e6d-49e0-810d-d85c45773f38 tempest-ProjectReaderTests-1457658627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (773f4307-54c6-4776-bf09-852bd2489761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-211961a4-b8e4-45be-9a8a-e6d36a65fa05', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:43:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4e50ebab-7e6d-49e0-810d-d85c45773f38 tempest-ProjectReaderTests-1457658627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b75a70e2-e699-4a4e-b3fc-bc3ee0ee00f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:43:51 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-4e50ebab-7e6d-49e0-810d-d85c45773f38 tempest-ProjectReaderTests-1457658627 None] Volume volume-211961a4-b8e4-45be-9a8a-e6d36a65fa05 (211961a4-b8e4-45be-9a8a-e6d36a65fa05): created successfully Nov 02 12:43:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4e50ebab-7e6d-49e0-810d-d85c45773f38 tempest-ProjectReaderTests-1457658627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b75a70e2-e699-4a4e-b3fc-bc3ee0ee00f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:43:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-4e50ebab-7e6d-49e0-810d-d85c45773f38 tempest-ProjectReaderTests-1457658627 None] Flow 'volume_create_manager' (e24c6a39-c37f-4b48-bb91-16579a112be6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:43:51 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-4e50ebab-7e6d-49e0-810d-d85c45773f38 tempest-ProjectReaderTests-1457658627 None] Created volume successfully. Nov 02 12:43:52 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ec643f4c-9b48-418e-8146-93019d225b51 tempest-ProjectReaderTests-1457658627 None] Acquiring lock "cinder-211961a4-b8e4-45be-9a8a-e6d36a65fa05-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:43:52 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ec643f4c-9b48-418e-8146-93019d225b51 tempest-ProjectReaderTests-1457658627 None] Lock "cinder-211961a4-b8e4-45be-9a8a-e6d36a65fa05-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:43:52 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ec643f4c-9b48-418e-8146-93019d225b51 tempest-ProjectReaderTests-1457658627 None] Acquiring lock "cinder-quobyte-211961a4-b8e4-45be-9a8a-e6d36a65fa05" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:43:52 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ec643f4c-9b48-418e-8146-93019d225b51 tempest-ProjectReaderTests-1457658627 None] Lock "cinder-quobyte-211961a4-b8e4-45be-9a8a-e6d36a65fa05" acquired by "delete_volume" :: waited 0.014s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:43:52 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bce3f3-2b62-4794-af74-5e1000a3ecdd]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:43:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ec643f4c-9b48-418e-8146-93019d225b51 tempest-ProjectReaderTests-1457658627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-211961a4-b8e4-45be-9a8a-e6d36a65fa05 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:52 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-211961a4-b8e4-45be-9a8a-e6d36a65fa05 Nov 02 12:43:52 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:52 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ec643f4c-9b48-418e-8146-93019d225b51 tempest-ProjectReaderTests-1457658627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-211961a4-b8e4-45be-9a8a-e6d36a65fa05" returned: 0 in 0.334s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ec643f4c-9b48-418e-8146-93019d225b51 tempest-ProjectReaderTests-1457658627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-211961a4-b8e4-45be-9a8a-e6d36a65fa05 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:52 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-211961a4-b8e4-45be-9a8a-e6d36a65fa05 Nov 02 12:43:52 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:52 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ec643f4c-9b48-418e-8146-93019d225b51 tempest-ProjectReaderTests-1457658627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-211961a4-b8e4-45be-9a8a-e6d36a65fa05" returned: 0 in 0.229s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:52 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ec643f4c-9b48-418e-8146-93019d225b51 tempest-ProjectReaderTests-1457658627 None] Lock "cinder-quobyte-211961a4-b8e4-45be-9a8a-e6d36a65fa05" released by "delete_volume" :: held 0.602s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:43:52 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-ec643f4c-9b48-418e-8146-93019d225b51 tempest-ProjectReaderTests-1457658627 None] Created reservations ['0f0c5b2e-2837-49e8-b1e9-17651a42a19d', '0bdaa8a3-161e-4647-88f5-a2a2d55dae24', '0bdb095f-f824-4746-800f-4b2634c5d474', '4ac0095b-c187-404a-b137-9420bd14011f'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:43:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ec643f4c-9b48-418e-8146-93019d225b51 tempest-ProjectReaderTests-1457658627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:43:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ec643f4c-9b48-418e-8146-93019d225b51 tempest-ProjectReaderTests-1457658627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:43:52 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ec643f4c-9b48-418e-8146-93019d225b51 tempest-ProjectReaderTests-1457658627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:43:52 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ec643f4c-9b48-418e-8146-93019d225b51 tempest-ProjectReaderTests-1457658627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:43:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ec643f4c-9b48-418e-8146-93019d225b51 tempest-ProjectReaderTests-1457658627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:43:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ec643f4c-9b48-418e-8146-93019d225b51 tempest-ProjectReaderTests-1457658627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:52 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:43:52 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:52 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ec643f4c-9b48-418e-8146-93019d225b51 tempest-ProjectReaderTests-1457658627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.225s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:52 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-ec643f4c-9b48-418e-8146-93019d225b51 tempest-ProjectReaderTests-1457658627 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:43:53 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-ec643f4c-9b48-418e-8146-93019d225b51 tempest-ProjectReaderTests-1457658627 None] Deleted volume successfully. Nov 02 12:43:53 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ec643f4c-9b48-418e-8146-93019d225b51 tempest-ProjectReaderTests-1457658627 None] Lock "cinder-211961a4-b8e4-45be-9a8a-e6d36a65fa05-delete_volume" released by "delete_volume" :: held 0.999s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:43:53 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b5044af-b2e9-494f-9bbe-fd35ab35088f tempest-ProjectReaderTests-1457658627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:43:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2b5044af-b2e9-494f-9bbe-fd35ab35088f tempest-ProjectReaderTests-1457658627 None] Flow 'volume_create_manager' (9223e5f0-93c0-4182-b84a-5087d43048cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:43:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2b5044af-b2e9-494f-9bbe-fd35ab35088f tempest-ProjectReaderTests-1457658627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a3bebc4-74a2-4e30-98be-15741f694895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:43:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2b5044af-b2e9-494f-9bbe-fd35ab35088f tempest-ProjectReaderTests-1457658627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a3bebc4-74a2-4e30-98be-15741f694895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1216397628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=549bfee0-7225-410a-ad6a-42a9413da090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='183e3275f09c4762ad169dd217d2cd6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:43:54Z,use_quota=True,user_id='e3b749f5255840b195bdfa2e59c43b9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:43:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2b5044af-b2e9-494f-9bbe-fd35ab35088f tempest-ProjectReaderTests-1457658627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1db99cf-6014-45cf-bcfd-e0bba73b7742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:43:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2b5044af-b2e9-494f-9bbe-fd35ab35088f tempest-ProjectReaderTests-1457658627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1db99cf-6014-45cf-bcfd-e0bba73b7742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:43:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2b5044af-b2e9-494f-9bbe-fd35ab35088f tempest-ProjectReaderTests-1457658627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f2a22f0-5613-4d6d-8f61-d1ffe99ce554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:43:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2b5044af-b2e9-494f-9bbe-fd35ab35088f tempest-ProjectReaderTests-1457658627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f2a22f0-5613-4d6d-8f61-d1ffe99ce554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '549bfee0-7225-410a-ad6a-42a9413da090', 'volume_name': 'volume-549bfee0-7225-410a-ad6a-42a9413da090', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:43:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2b5044af-b2e9-494f-9bbe-fd35ab35088f tempest-ProjectReaderTests-1457658627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd0073bd-8881-47ae-8dff-9c23f45e83b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:43:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2b5044af-b2e9-494f-9bbe-fd35ab35088f tempest-ProjectReaderTests-1457658627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd0073bd-8881-47ae-8dff-9c23f45e83b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:43:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2b5044af-b2e9-494f-9bbe-fd35ab35088f tempest-ProjectReaderTests-1457658627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c78da210-83e5-4825-ac13-5096ce851059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:43:53 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-2b5044af-b2e9-494f-9bbe-fd35ab35088f tempest-ProjectReaderTests-1457658627 None] Volume 549bfee0-7225-410a-ad6a-42a9413da090: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-549bfee0-7225-410a-ad6a-42a9413da090', 'volume_size': 1} Nov 02 12:43:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2b5044af-b2e9-494f-9bbe-fd35ab35088f tempest-ProjectReaderTests-1457658627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:43:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2b5044af-b2e9-494f-9bbe-fd35ab35088f tempest-ProjectReaderTests-1457658627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:43:53 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-2b5044af-b2e9-494f-9bbe-fd35ab35088f tempest-ProjectReaderTests-1457658627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1216397628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=549bfee0-7225-410a-ad6a-42a9413da090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='183e3275f09c4762ad169dd217d2cd6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:43:54Z,use_quota=True,user_id='e3b749f5255840b195bdfa2e59c43b9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:43:53 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-2b5044af-b2e9-494f-9bbe-fd35ab35088f tempest-ProjectReaderTests-1457658627 None] Creating volume 549bfee0-7225-410a-ad6a-42a9413da090 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:43:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2b5044af-b2e9-494f-9bbe-fd35ab35088f tempest-ProjectReaderTests-1457658627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:43:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2b5044af-b2e9-494f-9bbe-fd35ab35088f tempest-ProjectReaderTests-1457658627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:43:53 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-2b5044af-b2e9-494f-9bbe-fd35ab35088f tempest-ProjectReaderTests-1457658627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:43:53 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-2b5044af-b2e9-494f-9bbe-fd35ab35088f tempest-ProjectReaderTests-1457658627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:43:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2b5044af-b2e9-494f-9bbe-fd35ab35088f tempest-ProjectReaderTests-1457658627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:43:53 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-2b5044af-b2e9-494f-9bbe-fd35ab35088f tempest-ProjectReaderTests-1457658627 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:43:53 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-2b5044af-b2e9-494f-9bbe-fd35ab35088f tempest-ProjectReaderTests-1457658627 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:43:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2b5044af-b2e9-494f-9bbe-fd35ab35088f tempest-ProjectReaderTests-1457658627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-549bfee0-7225-410a-ad6a-42a9413da090 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:53 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-549bfee0-7225-410a-ad6a-42a9413da090 1073741824 Nov 02 12:43:53 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:54 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2b5044af-b2e9-494f-9bbe-fd35ab35088f tempest-ProjectReaderTests-1457658627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-549bfee0-7225-410a-ad6a-42a9413da090 1073741824" returned: 0 in 0.383s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2b5044af-b2e9-494f-9bbe-fd35ab35088f tempest-ProjectReaderTests-1457658627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-549bfee0-7225-410a-ad6a-42a9413da090 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:54 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-549bfee0-7225-410a-ad6a-42a9413da090 Nov 02 12:43:54 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:54 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2b5044af-b2e9-494f-9bbe-fd35ab35088f tempest-ProjectReaderTests-1457658627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-549bfee0-7225-410a-ad6a-42a9413da090" returned: 0 in 0.228s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-2b5044af-b2e9-494f-9bbe-fd35ab35088f tempest-ProjectReaderTests-1457658627 None] <== create_volume: return (652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:43:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2b5044af-b2e9-494f-9bbe-fd35ab35088f tempest-ProjectReaderTests-1457658627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.654s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:43:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2b5044af-b2e9-494f-9bbe-fd35ab35088f tempest-ProjectReaderTests-1457658627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c78da210-83e5-4825-ac13-5096ce851059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-549bfee0-7225-410a-ad6a-42a9413da090', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:43:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2b5044af-b2e9-494f-9bbe-fd35ab35088f tempest-ProjectReaderTests-1457658627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7933d92-5de1-402a-98d9-0096e3aef78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:43:54 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-2b5044af-b2e9-494f-9bbe-fd35ab35088f tempest-ProjectReaderTests-1457658627 None] Volume volume-549bfee0-7225-410a-ad6a-42a9413da090 (549bfee0-7225-410a-ad6a-42a9413da090): created successfully Nov 02 12:43:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2b5044af-b2e9-494f-9bbe-fd35ab35088f tempest-ProjectReaderTests-1457658627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7933d92-5de1-402a-98d9-0096e3aef78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:43:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2b5044af-b2e9-494f-9bbe-fd35ab35088f tempest-ProjectReaderTests-1457658627 None] Flow 'volume_create_manager' (9223e5f0-93c0-4182-b84a-5087d43048cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:43:54 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-2b5044af-b2e9-494f-9bbe-fd35ab35088f tempest-ProjectReaderTests-1457658627 None] Created volume successfully. Nov 02 12:43:54 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c7b3b4fd-3647-4d4d-afb8-fc594255a330 tempest-ProjectReaderTests-1457658627 None] Acquiring lock "cinder-549bfee0-7225-410a-ad6a-42a9413da090-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:43:54 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c7b3b4fd-3647-4d4d-afb8-fc594255a330 tempest-ProjectReaderTests-1457658627 None] Lock "cinder-549bfee0-7225-410a-ad6a-42a9413da090-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:43:54 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c7b3b4fd-3647-4d4d-afb8-fc594255a330 tempest-ProjectReaderTests-1457658627 None] Acquiring lock "cinder-quobyte-549bfee0-7225-410a-ad6a-42a9413da090" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:43:54 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c7b3b4fd-3647-4d4d-afb8-fc594255a330 tempest-ProjectReaderTests-1457658627 None] Lock "cinder-quobyte-549bfee0-7225-410a-ad6a-42a9413da090" acquired by "delete_volume" :: waited 0.013s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:43:54 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f32c0e9-ac71-4c0e-a141-b301af4a7eec]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:43:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c7b3b4fd-3647-4d4d-afb8-fc594255a330 tempest-ProjectReaderTests-1457658627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-549bfee0-7225-410a-ad6a-42a9413da090 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:54 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-549bfee0-7225-410a-ad6a-42a9413da090 Nov 02 12:43:54 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:55 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c7b3b4fd-3647-4d4d-afb8-fc594255a330 tempest-ProjectReaderTests-1457658627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-549bfee0-7225-410a-ad6a-42a9413da090" returned: 0 in 0.334s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c7b3b4fd-3647-4d4d-afb8-fc594255a330 tempest-ProjectReaderTests-1457658627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-549bfee0-7225-410a-ad6a-42a9413da090 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:55 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-549bfee0-7225-410a-ad6a-42a9413da090 Nov 02 12:43:55 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:55 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c7b3b4fd-3647-4d4d-afb8-fc594255a330 tempest-ProjectReaderTests-1457658627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-549bfee0-7225-410a-ad6a-42a9413da090" returned: 0 in 0.233s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:55 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c7b3b4fd-3647-4d4d-afb8-fc594255a330 tempest-ProjectReaderTests-1457658627 None] Lock "cinder-quobyte-549bfee0-7225-410a-ad6a-42a9413da090" released by "delete_volume" :: held 0.606s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:43:55 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-c7b3b4fd-3647-4d4d-afb8-fc594255a330 tempest-ProjectReaderTests-1457658627 None] Created reservations ['f26f733c-4cf7-4bca-8ec0-fb69cd74e026', '8101bc50-eb55-4b6a-aed9-09eb3353105f', 'e21f37de-e48a-43c5-a13d-f4976590502f', 'e2f4b64f-fd4e-4ab0-8471-585a24923b42'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:43:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c7b3b4fd-3647-4d4d-afb8-fc594255a330 tempest-ProjectReaderTests-1457658627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:43:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c7b3b4fd-3647-4d4d-afb8-fc594255a330 tempest-ProjectReaderTests-1457658627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:43:55 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-c7b3b4fd-3647-4d4d-afb8-fc594255a330 tempest-ProjectReaderTests-1457658627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:43:55 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-c7b3b4fd-3647-4d4d-afb8-fc594255a330 tempest-ProjectReaderTests-1457658627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:43:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c7b3b4fd-3647-4d4d-afb8-fc594255a330 tempest-ProjectReaderTests-1457658627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:43:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c7b3b4fd-3647-4d4d-afb8-fc594255a330 tempest-ProjectReaderTests-1457658627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:43:55 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:43:55 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:43:55 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Nov 02 12:43:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c7b3b4fd-3647-4d4d-afb8-fc594255a330 tempest-ProjectReaderTests-1457658627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.235s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:43:55 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-c7b3b4fd-3647-4d4d-afb8-fc594255a330 tempest-ProjectReaderTests-1457658627 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:43:55 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-c7b3b4fd-3647-4d4d-afb8-fc594255a330 tempest-ProjectReaderTests-1457658627 None] Deleted volume successfully. Nov 02 12:43:55 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c7b3b4fd-3647-4d4d-afb8-fc594255a330 tempest-ProjectReaderTests-1457658627 None] Lock "cinder-549bfee0-7225-410a-ad6a-42a9413da090-delete_volume" released by "delete_volume" :: held 1.020s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:44:05 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:UPDATE=20,cinder:SELECT=15,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:44:05 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=13,cinder:UPDATE=24,cinder:DELETE=3,cinder:INSERT=6 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:44:17 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-14266669-a84c-4726-994a-ba3b3cf089e2 tempest-SnapshotDependencyTests-1978653174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:44:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-14266669-a84c-4726-994a-ba3b3cf089e2 tempest-SnapshotDependencyTests-1978653174 None] Flow 'volume_create_manager' (54f77556-e370-42cf-9f35-955dcd7d2ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:44:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-14266669-a84c-4726-994a-ba3b3cf089e2 tempest-SnapshotDependencyTests-1978653174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e08630-fdcf-4d59-b022-7032a339662c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-14266669-a84c-4726-994a-ba3b3cf089e2 tempest-SnapshotDependencyTests-1978653174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e08630-fdcf-4d59-b022-7032a339662c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1063912388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=712f8670-972d-4d65-a659-fa93f866dbc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd173e9f8203494f8d108be4cdb1c9ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:44:17Z,use_quota=True,user_id='9468a325382f49359e2d9bcb0c2c4130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-14266669-a84c-4726-994a-ba3b3cf089e2 tempest-SnapshotDependencyTests-1978653174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422e90db-37a8-4f0d-be69-9c21b416cef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-14266669-a84c-4726-994a-ba3b3cf089e2 tempest-SnapshotDependencyTests-1978653174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422e90db-37a8-4f0d-be69-9c21b416cef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-14266669-a84c-4726-994a-ba3b3cf089e2 tempest-SnapshotDependencyTests-1978653174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76871548-a4c5-4a02-b85b-8f62b2bb2ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-14266669-a84c-4726-994a-ba3b3cf089e2 tempest-SnapshotDependencyTests-1978653174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76871548-a4c5-4a02-b85b-8f62b2bb2ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '712f8670-972d-4d65-a659-fa93f866dbc4', 'volume_name': 'volume-712f8670-972d-4d65-a659-fa93f866dbc4', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-14266669-a84c-4726-994a-ba3b3cf089e2 tempest-SnapshotDependencyTests-1978653174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0fcd98-44c8-4aa1-8dd7-715ed8d5ce1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-14266669-a84c-4726-994a-ba3b3cf089e2 tempest-SnapshotDependencyTests-1978653174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0fcd98-44c8-4aa1-8dd7-715ed8d5ce1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-14266669-a84c-4726-994a-ba3b3cf089e2 tempest-SnapshotDependencyTests-1978653174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1357ccaf-389c-4ce1-8807-9652eec296a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:17 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-14266669-a84c-4726-994a-ba3b3cf089e2 tempest-SnapshotDependencyTests-1978653174 None] Volume 712f8670-972d-4d65-a659-fa93f866dbc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-712f8670-972d-4d65-a659-fa93f866dbc4', 'volume_size': 1} Nov 02 12:44:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-14266669-a84c-4726-994a-ba3b3cf089e2 tempest-SnapshotDependencyTests-1978653174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:44:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-14266669-a84c-4726-994a-ba3b3cf089e2 tempest-SnapshotDependencyTests-1978653174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:44:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-14266669-a84c-4726-994a-ba3b3cf089e2 tempest-SnapshotDependencyTests-1978653174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:44:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1063912388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=712f8670-972d-4d65-a659-fa93f866dbc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd173e9f8203494f8d108be4cdb1c9ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:44:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:44:17Z,use_quota=True,user_id='9468a325382f49359e2d9bcb0c2c4130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:44:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-14266669-a84c-4726-994a-ba3b3cf089e2 tempest-SnapshotDependencyTests-1978653174 None] Creating volume 712f8670-972d-4d65-a659-fa93f866dbc4 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:44:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-14266669-a84c-4726-994a-ba3b3cf089e2 tempest-SnapshotDependencyTests-1978653174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:44:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-14266669-a84c-4726-994a-ba3b3cf089e2 tempest-SnapshotDependencyTests-1978653174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:44:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-14266669-a84c-4726-994a-ba3b3cf089e2 tempest-SnapshotDependencyTests-1978653174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:44:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-14266669-a84c-4726-994a-ba3b3cf089e2 tempest-SnapshotDependencyTests-1978653174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:44:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-14266669-a84c-4726-994a-ba3b3cf089e2 tempest-SnapshotDependencyTests-1978653174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:44:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-14266669-a84c-4726-994a-ba3b3cf089e2 tempest-SnapshotDependencyTests-1978653174 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:44:17 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-14266669-a84c-4726-994a-ba3b3cf089e2 tempest-SnapshotDependencyTests-1978653174 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:44:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-14266669-a84c-4726-994a-ba3b3cf089e2 tempest-SnapshotDependencyTests-1978653174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:17 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4 1073741824 Nov 02 12:44:17 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:17 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-14266669-a84c-4726-994a-ba3b3cf089e2 tempest-SnapshotDependencyTests-1978653174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4 1073741824" returned: 0 in 0.426s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-14266669-a84c-4726-994a-ba3b3cf089e2 tempest-SnapshotDependencyTests-1978653174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:17 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4 Nov 02 12:44:17 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:18 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-14266669-a84c-4726-994a-ba3b3cf089e2 tempest-SnapshotDependencyTests-1978653174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4" returned: 0 in 0.256s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:18 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-14266669-a84c-4726-994a-ba3b3cf089e2 tempest-SnapshotDependencyTests-1978653174 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:44:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-14266669-a84c-4726-994a-ba3b3cf089e2 tempest-SnapshotDependencyTests-1978653174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:44:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-14266669-a84c-4726-994a-ba3b3cf089e2 tempest-SnapshotDependencyTests-1978653174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1357ccaf-389c-4ce1-8807-9652eec296a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-712f8670-972d-4d65-a659-fa93f866dbc4', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-14266669-a84c-4726-994a-ba3b3cf089e2 tempest-SnapshotDependencyTests-1978653174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (518699c0-c2cf-4619-a615-19e518e60276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:18 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-14266669-a84c-4726-994a-ba3b3cf089e2 tempest-SnapshotDependencyTests-1978653174 None] Volume volume-712f8670-972d-4d65-a659-fa93f866dbc4 (712f8670-972d-4d65-a659-fa93f866dbc4): created successfully Nov 02 12:44:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-14266669-a84c-4726-994a-ba3b3cf089e2 tempest-SnapshotDependencyTests-1978653174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (518699c0-c2cf-4619-a615-19e518e60276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-14266669-a84c-4726-994a-ba3b3cf089e2 tempest-SnapshotDependencyTests-1978653174 None] Flow 'volume_create_manager' (54f77556-e370-42cf-9f35-955dcd7d2ce9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:44:18 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-14266669-a84c-4726-994a-ba3b3cf089e2 tempest-SnapshotDependencyTests-1978653174 None] Created volume successfully. Nov 02 12:44:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-394daa1f-097a-400e-9609-42a8f542f503 tempest-SnapshotDependencyTests-1978653174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:44:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-394daa1f-097a-400e-9609-42a8f542f503 tempest-SnapshotDependencyTests-1978653174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:44:18 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-394daa1f-097a-400e-9609-42a8f542f503 tempest-SnapshotDependencyTests-1978653174 None] Creating offline snapshot 242f4b8f-af06-40e2-aa8e-a1378741a5f8 of volume 712f8670-972d-4d65-a659-fa93f866dbc4 {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:44:18 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95b5a6b-3086-4720-b752-6d53937c60cf]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:44:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-394daa1f-097a-400e-9609-42a8f542f503 tempest-SnapshotDependencyTests-1978653174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:18 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4 Nov 02 12:44:18 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:19 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-394daa1f-097a-400e-9609-42a8f542f503 tempest-SnapshotDependencyTests-1978653174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4" returned: 0 in 0.355s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-394daa1f-097a-400e-9609-42a8f542f503 tempest-SnapshotDependencyTests-1978653174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4.242f4b8f-af06-40e2-aa8e-a1378741a5f8 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:19 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4.242f4b8f-af06-40e2-aa8e-a1378741a5f8 1G Nov 02 12:44:19 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:19 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-394daa1f-097a-400e-9609-42a8f542f503 tempest-SnapshotDependencyTests-1978653174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4.242f4b8f-af06-40e2-aa8e-a1378741a5f8 1G" returned: 0 in 0.410s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-394daa1f-097a-400e-9609-42a8f542f503 tempest-SnapshotDependencyTests-1978653174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-712f8670-972d-4d65-a659-fa93f866dbc4 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4.242f4b8f-af06-40e2-aa8e-a1378741a5f8 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:19 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-712f8670-972d-4d65-a659-fa93f866dbc4 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4.242f4b8f-af06-40e2-aa8e-a1378741a5f8 Nov 02 12:44:19 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:19 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-394daa1f-097a-400e-9609-42a8f542f503 tempest-SnapshotDependencyTests-1978653174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-712f8670-972d-4d65-a659-fa93f866dbc4 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4.242f4b8f-af06-40e2-aa8e-a1378741a5f8" returned: 0 in 0.291s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:19 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-394daa1f-097a-400e-9609-42a8f542f503 tempest-SnapshotDependencyTests-1978653174 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4.242f4b8f-af06-40e2-aa8e-a1378741a5f8 is being set with open permissions: ugo+rw Nov 02 12:44:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-394daa1f-097a-400e-9609-42a8f542f503 tempest-SnapshotDependencyTests-1978653174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4.242f4b8f-af06-40e2-aa8e-a1378741a5f8 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:19 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4.242f4b8f-af06-40e2-aa8e-a1378741a5f8 Nov 02 12:44:19 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:19 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-394daa1f-097a-400e-9609-42a8f542f503 tempest-SnapshotDependencyTests-1978653174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4.242f4b8f-af06-40e2-aa8e-a1378741a5f8" returned: 0 in 0.249s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-394daa1f-097a-400e-9609-42a8f542f503 tempest-SnapshotDependencyTests-1978653174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:20 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4.info Nov 02 12:44:20 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:20 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-394daa1f-097a-400e-9609-42a8f542f503 tempest-SnapshotDependencyTests-1978653174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4.info" returned: 0 in 0.249s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:20 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-394daa1f-097a-400e-9609-42a8f542f503 tempest-SnapshotDependencyTests-1978653174 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4.info is being set with open permissions: ugo+rw Nov 02 12:44:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-394daa1f-097a-400e-9609-42a8f542f503 tempest-SnapshotDependencyTests-1978653174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:20 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4.info Nov 02 12:44:20 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:20 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-394daa1f-097a-400e-9609-42a8f542f503 tempest-SnapshotDependencyTests-1978653174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4.info" returned: 0 in 0.241s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-394daa1f-097a-400e-9609-42a8f542f503 tempest-SnapshotDependencyTests-1978653174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.888s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:44:20 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-394daa1f-097a-400e-9609-42a8f542f503 tempest-SnapshotDependencyTests-1978653174 None] Create snapshot completed successfully Nov 02 12:44:21 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:44:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Flow 'volume_create_manager' (3b76c215-636c-4e5c-b55b-c7a13c0ecb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:44:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4454098f-ecbe-41c6-94b2-5216efba3001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4454098f-ecbe-41c6-94b2-5216efba3001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0439a552-8b23-4abf-81c8-663de275567d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd173e9f8203494f8d108be4cdb1c9ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=242f4b8f-af06-40e2-aa8e-a1378741a5f8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:44:21Z,use_quota=True,user_id='9468a325382f49359e2d9bcb0c2c4130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ddcaf15-5a9d-4391-9f0f-53778d500dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ddcaf15-5a9d-4391-9f0f-53778d500dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21562730-e9bc-4ba5-a171-d51ea6613ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21562730-e9bc-4ba5-a171-d51ea6613ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0439a552-8b23-4abf-81c8-663de275567d', 'volume_name': 'volume-0439a552-8b23-4abf-81c8-663de275567d', 'volume_size': 1, 'snapshot_id': '242f4b8f-af06-40e2-aa8e-a1378741a5f8'}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee12750-6cac-4fed-bd55-3771494351eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee12750-6cac-4fed-bd55-3771494351eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b411a480-b048-43d2-91d7-20a49e3a1b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:21 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Volume 0439a552-8b23-4abf-81c8-663de275567d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0439a552-8b23-4abf-81c8-663de275567d', 'volume_size': 1, 'snapshot_id': '242f4b8f-af06-40e2-aa8e-a1378741a5f8'} Nov 02 12:44:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:44:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:44:21 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Acquiring lock "cinder-quobyte-242f4b8f-af06-40e2-aa8e-a1378741a5f8-0439a552-8b23-4abf-81c8-663de275567d" by "_create_volume_from_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:44:21 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Lock "cinder-quobyte-242f4b8f-af06-40e2-aa8e-a1378741a5f8-0439a552-8b23-4abf-81c8-663de275567d" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:44:21 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Creating volume 0439a552-8b23-4abf-81c8-663de275567d from snapshot 242f4b8f-af06-40e2-aa8e-a1378741a5f8 {{(pid=86515) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 12:44:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:44:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:44:21 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:44:21 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:44:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:44:21 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:44:21 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Acquiring lock "cinder-quobyte-0439a552-8b23-4abf-81c8-663de275567d" by "_copy_volume_from_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:44:21 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Lock "cinder-quobyte-0439a552-8b23-4abf-81c8-663de275567d" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:44:21 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] snapshot: 242f4b8f-af06-40e2-aa8e-a1378741a5f8, volume: 0439a552-8b23-4abf-81c8-663de275567d, {{(pid=86515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 12:44:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:44:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:44:21 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:44:21 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:44:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:44:21 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[4382566f-62ed-4880-8092-51b5f3781f88]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:44:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4.242f4b8f-af06-40e2-aa8e-a1378741a5f8 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:21 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4.242f4b8f-af06-40e2-aa8e-a1378741a5f8 Nov 02 12:44:21 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:21 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4.242f4b8f-af06-40e2-aa8e-a1378741a5f8" returned: 0 in 0.352s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:21 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-712f8670-972d-4d65-a659-fa93f866dbc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:44:21 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c876ed-0ed7-471f-80f7-9fd8b9a04ceb]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:44:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:21 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4 Nov 02 12:44:21 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:22 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4" returned: 0 in 0.373s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:22 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] will copy from snapshot at /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4 {{(pid=86515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 12:44:22 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Creating direct copy from snapshot {{(pid=86515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 12:44:22 devstack cinder-volume[86515]: DEBUG cinder.utils [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Path /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0439a552-8b23-4abf-81c8-663de275567d not found in is_blk_device check {{(pid=86515) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 12:44:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0439a552-8b23-4abf-81c8-663de275567d {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:22 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0439a552-8b23-4abf-81c8-663de275567d Nov 02 12:44:22 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:27 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0439a552-8b23-4abf-81c8-663de275567d" returned: 0 in 5.336s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:27 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Image conversion details: src /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4, size 1024.00 MB, duration 5.34 sec, destination /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0439a552-8b23-4abf-81c8-663de275567d {{(pid=86515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 12:44:27 devstack cinder-volume[86515]: INFO cinder.image.image_utils [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Converted 1024.00 MB image at 191.85 MB/s Nov 02 12:44:27 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0439a552-8b23-4abf-81c8-663de275567d is being set with open permissions: ugo+rw Nov 02 12:44:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0439a552-8b23-4abf-81c8-663de275567d {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:27 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0439a552-8b23-4abf-81c8-663de275567d Nov 02 12:44:27 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:27 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0439a552-8b23-4abf-81c8-663de275567d" returned: 0 in 0.235s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:27 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Lock "cinder-quobyte-0439a552-8b23-4abf-81c8-663de275567d" released by "_copy_volume_from_snapshot" :: held 6.371s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:44:27 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Lock "cinder-quobyte-242f4b8f-af06-40e2-aa8e-a1378741a5f8-0439a552-8b23-4abf-81c8-663de275567d" released by "_create_volume_from_snapshot" :: held 6.429s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:44:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.442s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:44:27 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b411a480-b048-43d2-91d7-20a49e3a1b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0439a552-8b23-4abf-81c8-663de275567d', 'volume_size': 1, 'snapshot_id': '242f4b8f-af06-40e2-aa8e-a1378741a5f8'}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:27 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d90c9ab-8c86-434a-9481-33055752cf97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:27 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Volume volume-0439a552-8b23-4abf-81c8-663de275567d (0439a552-8b23-4abf-81c8-663de275567d): created successfully Nov 02 12:44:27 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d90c9ab-8c86-434a-9481-33055752cf97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:27 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Flow 'volume_create_manager' (3b76c215-636c-4e5c-b55b-c7a13c0ecb0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:44:27 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-d9d52f7e-f3f8-43e0-8319-ac516dfcdee9 tempest-SnapshotDependencyTests-1978653174 None] Created volume successfully. Nov 02 12:44:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a5d1ab02-bd66-4e11-9c8a-4b3e9b7d2505 tempest-SnapshotDependencyTests-1978653174 None] Acquiring lock "cinder-242f4b8f-af06-40e2-aa8e-a1378741a5f8-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:44:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a5d1ab02-bd66-4e11-9c8a-4b3e9b7d2505 tempest-SnapshotDependencyTests-1978653174 None] Lock "cinder-242f4b8f-af06-40e2-aa8e-a1378741a5f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:44:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a5d1ab02-bd66-4e11-9c8a-4b3e9b7d2505 tempest-SnapshotDependencyTests-1978653174 None] Acquiring lock "cinder-quobyte-712f8670-972d-4d65-a659-fa93f866dbc4" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:44:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a5d1ab02-bd66-4e11-9c8a-4b3e9b7d2505 tempest-SnapshotDependencyTests-1978653174 None] Lock "cinder-quobyte-712f8670-972d-4d65-a659-fa93f866dbc4" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:44:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a5d1ab02-bd66-4e11-9c8a-4b3e9b7d2505 tempest-SnapshotDependencyTests-1978653174 None] Acquiring lock "cinder-quobyte-242f4b8f-af06-40e2-aa8e-a1378741a5f8" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:44:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a5d1ab02-bd66-4e11-9c8a-4b3e9b7d2505 tempest-SnapshotDependencyTests-1978653174 None] Lock "cinder-quobyte-242f4b8f-af06-40e2-aa8e-a1378741a5f8" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:44:28 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-a5d1ab02-bd66-4e11-9c8a-4b3e9b7d2505 tempest-SnapshotDependencyTests-1978653174 None] Deleting offline snapshot 242f4b8f-af06-40e2-aa8e-a1378741a5f8 of volume 712f8670-972d-4d65-a659-fa93f866dbc4 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:44:28 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-a5d1ab02-bd66-4e11-9c8a-4b3e9b7d2505 tempest-SnapshotDependencyTests-1978653174 None] snapshot_file for this snap is: volume-712f8670-972d-4d65-a659-fa93f866dbc4.242f4b8f-af06-40e2-aa8e-a1378741a5f8 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:44:28 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[9207b7e2-374f-4408-8a44-2092e8af9753]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:44:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a5d1ab02-bd66-4e11-9c8a-4b3e9b7d2505 tempest-SnapshotDependencyTests-1978653174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4.242f4b8f-af06-40e2-aa8e-a1378741a5f8 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:29 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4.242f4b8f-af06-40e2-aa8e-a1378741a5f8 Nov 02 12:44:29 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:29 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a5d1ab02-bd66-4e11-9c8a-4b3e9b7d2505 tempest-SnapshotDependencyTests-1978653174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4.242f4b8f-af06-40e2-aa8e-a1378741a5f8" returned: 0 in 0.368s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:29 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-a5d1ab02-bd66-4e11-9c8a-4b3e9b7d2505 tempest-SnapshotDependencyTests-1978653174 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-712f8670-972d-4d65-a659-fa93f866dbc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:44:29 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[95baef09-a752-4ec0-bbb1-1b7022f74038]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:44:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a5d1ab02-bd66-4e11-9c8a-4b3e9b7d2505 tempest-SnapshotDependencyTests-1978653174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:29 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4 Nov 02 12:44:29 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:29 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a5d1ab02-bd66-4e11-9c8a-4b3e9b7d2505 tempest-SnapshotDependencyTests-1978653174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4" returned: 0 in 0.498s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a5d1ab02-bd66-4e11-9c8a-4b3e9b7d2505 tempest-SnapshotDependencyTests-1978653174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4.242f4b8f-af06-40e2-aa8e-a1378741a5f8 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:29 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4.242f4b8f-af06-40e2-aa8e-a1378741a5f8 Nov 02 12:44:29 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:30 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a5d1ab02-bd66-4e11-9c8a-4b3e9b7d2505 tempest-SnapshotDependencyTests-1978653174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4.242f4b8f-af06-40e2-aa8e-a1378741a5f8" returned: 0 in 0.363s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a5d1ab02-bd66-4e11-9c8a-4b3e9b7d2505 tempest-SnapshotDependencyTests-1978653174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4.242f4b8f-af06-40e2-aa8e-a1378741a5f8 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:30 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4.242f4b8f-af06-40e2-aa8e-a1378741a5f8 Nov 02 12:44:30 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:30 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a5d1ab02-bd66-4e11-9c8a-4b3e9b7d2505 tempest-SnapshotDependencyTests-1978653174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4.242f4b8f-af06-40e2-aa8e-a1378741a5f8" returned: 0 in 0.236s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:30 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a5d1ab02-bd66-4e11-9c8a-4b3e9b7d2505 tempest-SnapshotDependencyTests-1978653174 None] Lock "cinder-quobyte-242f4b8f-af06-40e2-aa8e-a1378741a5f8" released by "_delete_snapshot" :: held 1.563s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:44:30 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a5d1ab02-bd66-4e11-9c8a-4b3e9b7d2505 tempest-SnapshotDependencyTests-1978653174 None] Lock "cinder-quobyte-712f8670-972d-4d65-a659-fa93f866dbc4" released by "delete_snapshot" :: held 1.585s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:44:30 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-a5d1ab02-bd66-4e11-9c8a-4b3e9b7d2505 tempest-SnapshotDependencyTests-1978653174 None] Created reservations ['5dcf70cd-8b80-44ca-920c-a61a779c019b', '4b8f2bb8-96b8-4b6b-8253-a0e37b2b2938', '5dea803c-c715-4962-ac82-4f3931bb16ec', '63501b7b-980b-4e02-9f7b-3d42c79b9af1'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:44:30 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-a5d1ab02-bd66-4e11-9c8a-4b3e9b7d2505 tempest-SnapshotDependencyTests-1978653174 None] Delete snapshot completed successfully. Nov 02 12:44:30 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a5d1ab02-bd66-4e11-9c8a-4b3e9b7d2505 tempest-SnapshotDependencyTests-1978653174 None] Lock "cinder-242f4b8f-af06-40e2-aa8e-a1378741a5f8-delete_snapshot" released by "delete_snapshot" :: held 1.730s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:44:31 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7092eaf8-0c18-457a-a208-8cb8ac68e250 tempest-SnapshotDependencyTests-1978653174 None] Acquiring lock "cinder-712f8670-972d-4d65-a659-fa93f866dbc4-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:44:31 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7092eaf8-0c18-457a-a208-8cb8ac68e250 tempest-SnapshotDependencyTests-1978653174 None] Lock "cinder-712f8670-972d-4d65-a659-fa93f866dbc4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:44:31 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7092eaf8-0c18-457a-a208-8cb8ac68e250 tempest-SnapshotDependencyTests-1978653174 None] Acquiring lock "cinder-quobyte-712f8670-972d-4d65-a659-fa93f866dbc4" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:44:31 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7092eaf8-0c18-457a-a208-8cb8ac68e250 tempest-SnapshotDependencyTests-1978653174 None] Lock "cinder-quobyte-712f8670-972d-4d65-a659-fa93f866dbc4" acquired by "delete_volume" :: waited 0.016s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:44:31 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97bf894-0dc6-4574-b8bb-aef55629966f]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:44:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7092eaf8-0c18-457a-a208-8cb8ac68e250 tempest-SnapshotDependencyTests-1978653174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:31 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4 Nov 02 12:44:31 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:31 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7092eaf8-0c18-457a-a208-8cb8ac68e250 tempest-SnapshotDependencyTests-1978653174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4" returned: 0 in 0.355s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7092eaf8-0c18-457a-a208-8cb8ac68e250 tempest-SnapshotDependencyTests-1978653174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:31 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4 Nov 02 12:44:31 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:31 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7092eaf8-0c18-457a-a208-8cb8ac68e250 tempest-SnapshotDependencyTests-1978653174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-712f8670-972d-4d65-a659-fa93f866dbc4" returned: 0 in 0.253s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:31 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7092eaf8-0c18-457a-a208-8cb8ac68e250 tempest-SnapshotDependencyTests-1978653174 None] Lock "cinder-quobyte-712f8670-972d-4d65-a659-fa93f866dbc4" released by "delete_volume" :: held 0.670s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:44:31 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-7092eaf8-0c18-457a-a208-8cb8ac68e250 tempest-SnapshotDependencyTests-1978653174 None] Created reservations ['ed56048b-b8f3-45ce-8afd-bbc1e151328f', '55c29c4c-088c-4f18-ba5b-944aeac56607', 'a4b9db4e-6aa2-42b0-a744-328aac7e6314', 'a26212db-3bc0-4fd6-85b7-54be4069cc73'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:44:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7092eaf8-0c18-457a-a208-8cb8ac68e250 tempest-SnapshotDependencyTests-1978653174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:44:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7092eaf8-0c18-457a-a208-8cb8ac68e250 tempest-SnapshotDependencyTests-1978653174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:44:31 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-7092eaf8-0c18-457a-a208-8cb8ac68e250 tempest-SnapshotDependencyTests-1978653174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:44:31 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-7092eaf8-0c18-457a-a208-8cb8ac68e250 tempest-SnapshotDependencyTests-1978653174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:44:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7092eaf8-0c18-457a-a208-8cb8ac68e250 tempest-SnapshotDependencyTests-1978653174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:44:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7092eaf8-0c18-457a-a208-8cb8ac68e250 tempest-SnapshotDependencyTests-1978653174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:31 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:44:31 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:32 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7092eaf8-0c18-457a-a208-8cb8ac68e250 tempest-SnapshotDependencyTests-1978653174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.238s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:32 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-7092eaf8-0c18-457a-a208-8cb8ac68e250 tempest-SnapshotDependencyTests-1978653174 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:44:32 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-7092eaf8-0c18-457a-a208-8cb8ac68e250 tempest-SnapshotDependencyTests-1978653174 None] Deleted volume successfully. Nov 02 12:44:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7092eaf8-0c18-457a-a208-8cb8ac68e250 tempest-SnapshotDependencyTests-1978653174 None] Lock "cinder-712f8670-972d-4d65-a659-fa93f866dbc4-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:44:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5e07a2bf-62c8-4e6e-bc4a-acb431644b33 tempest-SnapshotDependencyTests-1978653174 None] Acquiring lock "cinder-0439a552-8b23-4abf-81c8-663de275567d-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:44:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5e07a2bf-62c8-4e6e-bc4a-acb431644b33 tempest-SnapshotDependencyTests-1978653174 None] Lock "cinder-0439a552-8b23-4abf-81c8-663de275567d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:44:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5e07a2bf-62c8-4e6e-bc4a-acb431644b33 tempest-SnapshotDependencyTests-1978653174 None] Acquiring lock "cinder-quobyte-0439a552-8b23-4abf-81c8-663de275567d" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:44:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5e07a2bf-62c8-4e6e-bc4a-acb431644b33 tempest-SnapshotDependencyTests-1978653174 None] Lock "cinder-quobyte-0439a552-8b23-4abf-81c8-663de275567d" acquired by "delete_volume" :: waited 0.017s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:44:32 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d0e93a-ccd7-4918-8dc0-5d8449364362]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:44:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5e07a2bf-62c8-4e6e-bc4a-acb431644b33 tempest-SnapshotDependencyTests-1978653174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0439a552-8b23-4abf-81c8-663de275567d {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:32 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0439a552-8b23-4abf-81c8-663de275567d Nov 02 12:44:32 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:32 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5e07a2bf-62c8-4e6e-bc4a-acb431644b33 tempest-SnapshotDependencyTests-1978653174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0439a552-8b23-4abf-81c8-663de275567d" returned: 0 in 0.360s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5e07a2bf-62c8-4e6e-bc4a-acb431644b33 tempest-SnapshotDependencyTests-1978653174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0439a552-8b23-4abf-81c8-663de275567d {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:32 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0439a552-8b23-4abf-81c8-663de275567d Nov 02 12:44:32 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:32 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5e07a2bf-62c8-4e6e-bc4a-acb431644b33 tempest-SnapshotDependencyTests-1978653174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0439a552-8b23-4abf-81c8-663de275567d" returned: 0 in 0.261s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5e07a2bf-62c8-4e6e-bc4a-acb431644b33 tempest-SnapshotDependencyTests-1978653174 None] Lock "cinder-quobyte-0439a552-8b23-4abf-81c8-663de275567d" released by "delete_volume" :: held 0.661s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:44:32 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-5e07a2bf-62c8-4e6e-bc4a-acb431644b33 tempest-SnapshotDependencyTests-1978653174 None] Created reservations ['5ee216ec-d9b8-44d7-ab46-7839b5fe818a', '4cbbf60d-5501-46f2-b4cf-d0585e360a7b', '9d35c835-021e-49c5-a48e-3bef3b7182fe', 'de97ee3d-50b5-4db2-b6ec-46eb0557004e'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:44:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5e07a2bf-62c8-4e6e-bc4a-acb431644b33 tempest-SnapshotDependencyTests-1978653174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:44:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5e07a2bf-62c8-4e6e-bc4a-acb431644b33 tempest-SnapshotDependencyTests-1978653174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:44:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5e07a2bf-62c8-4e6e-bc4a-acb431644b33 tempest-SnapshotDependencyTests-1978653174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:44:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5e07a2bf-62c8-4e6e-bc4a-acb431644b33 tempest-SnapshotDependencyTests-1978653174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:44:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5e07a2bf-62c8-4e6e-bc4a-acb431644b33 tempest-SnapshotDependencyTests-1978653174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:44:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5e07a2bf-62c8-4e6e-bc4a-acb431644b33 tempest-SnapshotDependencyTests-1978653174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:33 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:44:33 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:33 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5e07a2bf-62c8-4e6e-bc4a-acb431644b33 tempest-SnapshotDependencyTests-1978653174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.248s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:33 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-5e07a2bf-62c8-4e6e-bc4a-acb431644b33 tempest-SnapshotDependencyTests-1978653174 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:44:33 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-5e07a2bf-62c8-4e6e-bc4a-acb431644b33 tempest-SnapshotDependencyTests-1978653174 None] Deleted volume successfully. Nov 02 12:44:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5e07a2bf-62c8-4e6e-bc4a-acb431644b33 tempest-SnapshotDependencyTests-1978653174 None] Lock "cinder-0439a552-8b23-4abf-81c8-663de275567d-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:44:43 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:UPDATE=27,cinder:SELECT=27,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:44:43 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=22,cinder:UPDATE=31,cinder:INSERT=11,cinder:DELETE=4 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:44:43 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:44:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:44:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:44:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:44:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:44:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:44:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:43 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:44:43 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:44 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.252s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:44 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:44:44 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager._thread_info {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:44:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread count: 28 {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:44:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread info: [<_MainThread(MainThread, started 129944084402304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:44:53 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aae7b80-a5e7-4352-9258-172f5fe673fa tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:44:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3aae7b80-a5e7-4352-9258-172f5fe673fa tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Flow 'volume_create_manager' (dde6e7f3-1149-4dcd-a8ea-bb76ad218ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:44:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3aae7b80-a5e7-4352-9258-172f5fe673fa tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f22397-6741-4b6c-be19-c618f016421b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3aae7b80-a5e7-4352-9258-172f5fe673fa tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f22397-6741-4b6c-be19-c618f016421b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-668822468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f7f3382-4543-4609-8cd2-48a285e66703,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='150559a7fae843dea9b82c162dd79272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:44:54Z,use_quota=True,user_id='b75b81a3f03e455da73af86f707c5e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3aae7b80-a5e7-4352-9258-172f5fe673fa tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0a91ebc-b68d-4ef8-864e-e57defb81d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3aae7b80-a5e7-4352-9258-172f5fe673fa tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0a91ebc-b68d-4ef8-864e-e57defb81d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3aae7b80-a5e7-4352-9258-172f5fe673fa tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cdb39d7-fefe-49cc-a852-6aa140610c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3aae7b80-a5e7-4352-9258-172f5fe673fa tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cdb39d7-fefe-49cc-a852-6aa140610c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f7f3382-4543-4609-8cd2-48a285e66703', 'volume_name': 'volume-1f7f3382-4543-4609-8cd2-48a285e66703', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3aae7b80-a5e7-4352-9258-172f5fe673fa tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9b4c0e3-ffec-47bd-9402-1906c79bd0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3aae7b80-a5e7-4352-9258-172f5fe673fa tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9b4c0e3-ffec-47bd-9402-1906c79bd0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3aae7b80-a5e7-4352-9258-172f5fe673fa tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e6b5d39-0010-4501-a5dc-3dffa2eff38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:53 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-3aae7b80-a5e7-4352-9258-172f5fe673fa tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Volume 1f7f3382-4543-4609-8cd2-48a285e66703: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f7f3382-4543-4609-8cd2-48a285e66703', 'volume_size': 1} Nov 02 12:44:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3aae7b80-a5e7-4352-9258-172f5fe673fa tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:44:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3aae7b80-a5e7-4352-9258-172f5fe673fa tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:44:53 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3aae7b80-a5e7-4352-9258-172f5fe673fa tempest-CreateVolumesFromSourceVolumeTest-347036412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-668822468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f7f3382-4543-4609-8cd2-48a285e66703,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='150559a7fae843dea9b82c162dd79272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:44:54Z,use_quota=True,user_id='b75b81a3f03e455da73af86f707c5e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:44:53 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-3aae7b80-a5e7-4352-9258-172f5fe673fa tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Creating volume 1f7f3382-4543-4609-8cd2-48a285e66703 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:44:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3aae7b80-a5e7-4352-9258-172f5fe673fa tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:44:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3aae7b80-a5e7-4352-9258-172f5fe673fa tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:44:53 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3aae7b80-a5e7-4352-9258-172f5fe673fa tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:44:53 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3aae7b80-a5e7-4352-9258-172f5fe673fa tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:44:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3aae7b80-a5e7-4352-9258-172f5fe673fa tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:44:53 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3aae7b80-a5e7-4352-9258-172f5fe673fa tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:44:53 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-3aae7b80-a5e7-4352-9258-172f5fe673fa tempest-CreateVolumesFromSourceVolumeTest-347036412 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:44:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3aae7b80-a5e7-4352-9258-172f5fe673fa tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1f7f3382-4543-4609-8cd2-48a285e66703 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:54 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1f7f3382-4543-4609-8cd2-48a285e66703 1073741824 Nov 02 12:44:54 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:54 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d42a679-a05a-4cc2-b0bc-8ca11ca3c3be tempest-VolumeDependencyTests-798409840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:44:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-6d42a679-a05a-4cc2-b0bc-8ca11ca3c3be tempest-VolumeDependencyTests-798409840 None] Flow 'volume_create_manager' (12f83b86-8288-4d94-b8e9-dc2057479f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:44:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-6d42a679-a05a-4cc2-b0bc-8ca11ca3c3be tempest-VolumeDependencyTests-798409840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a9c0135-4c8e-45fd-994e-662bbb5c5baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-6d42a679-a05a-4cc2-b0bc-8ca11ca3c3be tempest-VolumeDependencyTests-798409840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a9c0135-4c8e-45fd-994e-662bbb5c5baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-917489012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=153f45fd-5276-407a-ae60-1c1e2057f474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d048840d98f42179e0b11ac201a20a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:44:54Z,use_quota=True,user_id='8e245873c387412e87d33e42c2fdacd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-6d42a679-a05a-4cc2-b0bc-8ca11ca3c3be tempest-VolumeDependencyTests-798409840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9265778-1302-4e32-ba22-d156750a19d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-6d42a679-a05a-4cc2-b0bc-8ca11ca3c3be tempest-VolumeDependencyTests-798409840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9265778-1302-4e32-ba22-d156750a19d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-6d42a679-a05a-4cc2-b0bc-8ca11ca3c3be tempest-VolumeDependencyTests-798409840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a373c0-d4a7-43f0-ac07-54016adb5673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-6d42a679-a05a-4cc2-b0bc-8ca11ca3c3be tempest-VolumeDependencyTests-798409840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a373c0-d4a7-43f0-ac07-54016adb5673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '153f45fd-5276-407a-ae60-1c1e2057f474', 'volume_name': 'volume-153f45fd-5276-407a-ae60-1c1e2057f474', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-6d42a679-a05a-4cc2-b0bc-8ca11ca3c3be tempest-VolumeDependencyTests-798409840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f8d454-b5e4-4722-87fe-aebdb5273f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-6d42a679-a05a-4cc2-b0bc-8ca11ca3c3be tempest-VolumeDependencyTests-798409840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f8d454-b5e4-4722-87fe-aebdb5273f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-6d42a679-a05a-4cc2-b0bc-8ca11ca3c3be tempest-VolumeDependencyTests-798409840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36753ea1-1434-4d35-a821-dcab78222685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:54 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-6d42a679-a05a-4cc2-b0bc-8ca11ca3c3be tempest-VolumeDependencyTests-798409840 None] Volume 153f45fd-5276-407a-ae60-1c1e2057f474: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-153f45fd-5276-407a-ae60-1c1e2057f474', 'volume_size': 1} Nov 02 12:44:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-6d42a679-a05a-4cc2-b0bc-8ca11ca3c3be tempest-VolumeDependencyTests-798409840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:44:54 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3aae7b80-a5e7-4352-9258-172f5fe673fa tempest-CreateVolumesFromSourceVolumeTest-347036412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1f7f3382-4543-4609-8cd2-48a285e66703 1073741824" returned: 0 in 0.540s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3aae7b80-a5e7-4352-9258-172f5fe673fa tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1f7f3382-4543-4609-8cd2-48a285e66703 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:54 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1f7f3382-4543-4609-8cd2-48a285e66703 Nov 02 12:44:54 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:54 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3aae7b80-a5e7-4352-9258-172f5fe673fa tempest-CreateVolumesFromSourceVolumeTest-347036412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1f7f3382-4543-4609-8cd2-48a285e66703" returned: 0 in 0.328s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3aae7b80-a5e7-4352-9258-172f5fe673fa tempest-CreateVolumesFromSourceVolumeTest-347036412 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:44:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3aae7b80-a5e7-4352-9258-172f5fe673fa tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:44:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-6d42a679-a05a-4cc2-b0bc-8ca11ca3c3be tempest-VolumeDependencyTests-798409840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.723s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:44:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-6d42a679-a05a-4cc2-b0bc-8ca11ca3c3be tempest-VolumeDependencyTests-798409840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-917489012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=153f45fd-5276-407a-ae60-1c1e2057f474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d048840d98f42179e0b11ac201a20a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:44:54Z,use_quota=True,user_id='8e245873c387412e87d33e42c2fdacd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:44:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-6d42a679-a05a-4cc2-b0bc-8ca11ca3c3be tempest-VolumeDependencyTests-798409840 None] Creating volume 153f45fd-5276-407a-ae60-1c1e2057f474 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:44:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-6d42a679-a05a-4cc2-b0bc-8ca11ca3c3be tempest-VolumeDependencyTests-798409840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:44:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-6d42a679-a05a-4cc2-b0bc-8ca11ca3c3be tempest-VolumeDependencyTests-798409840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:44:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-6d42a679-a05a-4cc2-b0bc-8ca11ca3c3be tempest-VolumeDependencyTests-798409840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:44:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-6d42a679-a05a-4cc2-b0bc-8ca11ca3c3be tempest-VolumeDependencyTests-798409840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:44:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-6d42a679-a05a-4cc2-b0bc-8ca11ca3c3be tempest-VolumeDependencyTests-798409840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:44:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-6d42a679-a05a-4cc2-b0bc-8ca11ca3c3be tempest-VolumeDependencyTests-798409840 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:44:54 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-6d42a679-a05a-4cc2-b0bc-8ca11ca3c3be tempest-VolumeDependencyTests-798409840 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:44:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6d42a679-a05a-4cc2-b0bc-8ca11ca3c3be tempest-VolumeDependencyTests-798409840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3aae7b80-a5e7-4352-9258-172f5fe673fa tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e6b5d39-0010-4501-a5dc-3dffa2eff38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f7f3382-4543-4609-8cd2-48a285e66703', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:54 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474 1073741824 Nov 02 12:44:54 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3aae7b80-a5e7-4352-9258-172f5fe673fa tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31781151-59ee-4abe-86af-5c3ac55ad34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:54 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-3aae7b80-a5e7-4352-9258-172f5fe673fa tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Volume volume-1f7f3382-4543-4609-8cd2-48a285e66703 (1f7f3382-4543-4609-8cd2-48a285e66703): created successfully Nov 02 12:44:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3aae7b80-a5e7-4352-9258-172f5fe673fa tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31781151-59ee-4abe-86af-5c3ac55ad34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3aae7b80-a5e7-4352-9258-172f5fe673fa tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Flow 'volume_create_manager' (dde6e7f3-1149-4dcd-a8ea-bb76ad218ddf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:44:55 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-3aae7b80-a5e7-4352-9258-172f5fe673fa tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Created volume successfully. Nov 02 12:44:55 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6d42a679-a05a-4cc2-b0bc-8ca11ca3c3be tempest-VolumeDependencyTests-798409840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474 1073741824" returned: 0 in 0.587s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6d42a679-a05a-4cc2-b0bc-8ca11ca3c3be tempest-VolumeDependencyTests-798409840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:55 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474 Nov 02 12:44:55 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:55 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6d42a679-a05a-4cc2-b0bc-8ca11ca3c3be tempest-VolumeDependencyTests-798409840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474" returned: 0 in 0.273s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:55 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-6d42a679-a05a-4cc2-b0bc-8ca11ca3c3be tempest-VolumeDependencyTests-798409840 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:44:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-6d42a679-a05a-4cc2-b0bc-8ca11ca3c3be tempest-VolumeDependencyTests-798409840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:44:55 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-6d42a679-a05a-4cc2-b0bc-8ca11ca3c3be tempest-VolumeDependencyTests-798409840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36753ea1-1434-4d35-a821-dcab78222685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-153f45fd-5276-407a-ae60-1c1e2057f474', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:55 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-6d42a679-a05a-4cc2-b0bc-8ca11ca3c3be tempest-VolumeDependencyTests-798409840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4985a44c-2b6a-433f-a5a8-c78d4e42d9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:55 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-6d42a679-a05a-4cc2-b0bc-8ca11ca3c3be tempest-VolumeDependencyTests-798409840 None] Volume volume-153f45fd-5276-407a-ae60-1c1e2057f474 (153f45fd-5276-407a-ae60-1c1e2057f474): created successfully Nov 02 12:44:55 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-6d42a679-a05a-4cc2-b0bc-8ca11ca3c3be tempest-VolumeDependencyTests-798409840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4985a44c-2b6a-433f-a5a8-c78d4e42d9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:55 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-6d42a679-a05a-4cc2-b0bc-8ca11ca3c3be tempest-VolumeDependencyTests-798409840 None] Flow 'volume_create_manager' (12f83b86-8288-4d94-b8e9-dc2057479f62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:44:55 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-6d42a679-a05a-4cc2-b0bc-8ca11ca3c3be tempest-VolumeDependencyTests-798409840 None] Created volume successfully. Nov 02 12:44:56 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-696d67c0-fc66-4496-97fb-70eaf63cbb97 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:44:56 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-696d67c0-fc66-4496-97fb-70eaf63cbb97 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Flow 'volume_create_manager' (f7b93349-ca33-4998-a24d-bbaceb89704e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:44:56 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-696d67c0-fc66-4496-97fb-70eaf63cbb97 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9acf3343-5934-44a9-b9b3-894c3cda029d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:56 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-696d67c0-fc66-4496-97fb-70eaf63cbb97 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9acf3343-5934-44a9-b9b3-894c3cda029d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-917133637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6800b32d-15a3-4049-b8b4-c94eae57dc92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='150559a7fae843dea9b82c162dd79272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:44:56Z,use_quota=True,user_id='b75b81a3f03e455da73af86f707c5e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:56 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-696d67c0-fc66-4496-97fb-70eaf63cbb97 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd110c85-40af-4517-8788-d64c3c51a835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:56 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-696d67c0-fc66-4496-97fb-70eaf63cbb97 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd110c85-40af-4517-8788-d64c3c51a835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:56 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-696d67c0-fc66-4496-97fb-70eaf63cbb97 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a55c021-aa4f-48cb-92c6-2ad719fb5770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:56 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-696d67c0-fc66-4496-97fb-70eaf63cbb97 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a55c021-aa4f-48cb-92c6-2ad719fb5770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6800b32d-15a3-4049-b8b4-c94eae57dc92', 'volume_name': 'volume-6800b32d-15a3-4049-b8b4-c94eae57dc92', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:56 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-696d67c0-fc66-4496-97fb-70eaf63cbb97 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afe17839-e8e0-47b4-b40e-163802005e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:56 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-696d67c0-fc66-4496-97fb-70eaf63cbb97 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afe17839-e8e0-47b4-b40e-163802005e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:56 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-696d67c0-fc66-4496-97fb-70eaf63cbb97 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d085fc2-f82d-4617-b0c6-0e25a70d7393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:56 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-696d67c0-fc66-4496-97fb-70eaf63cbb97 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Volume 6800b32d-15a3-4049-b8b4-c94eae57dc92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6800b32d-15a3-4049-b8b4-c94eae57dc92', 'volume_size': 1} Nov 02 12:44:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-696d67c0-fc66-4496-97fb-70eaf63cbb97 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:44:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-696d67c0-fc66-4496-97fb-70eaf63cbb97 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:44:56 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-696d67c0-fc66-4496-97fb-70eaf63cbb97 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-917133637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6800b32d-15a3-4049-b8b4-c94eae57dc92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='150559a7fae843dea9b82c162dd79272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:44:56Z,use_quota=True,user_id='b75b81a3f03e455da73af86f707c5e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:44:56 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-696d67c0-fc66-4496-97fb-70eaf63cbb97 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Creating volume 6800b32d-15a3-4049-b8b4-c94eae57dc92 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:44:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-696d67c0-fc66-4496-97fb-70eaf63cbb97 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:44:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-696d67c0-fc66-4496-97fb-70eaf63cbb97 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:44:56 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-696d67c0-fc66-4496-97fb-70eaf63cbb97 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:44:56 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-696d67c0-fc66-4496-97fb-70eaf63cbb97 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:44:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-696d67c0-fc66-4496-97fb-70eaf63cbb97 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:44:56 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-696d67c0-fc66-4496-97fb-70eaf63cbb97 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:44:56 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-696d67c0-fc66-4496-97fb-70eaf63cbb97 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:44:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-696d67c0-fc66-4496-97fb-70eaf63cbb97 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6800b32d-15a3-4049-b8b4-c94eae57dc92 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:56 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6800b32d-15a3-4049-b8b4-c94eae57dc92 1073741824 Nov 02 12:44:56 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3bc66a4e-2d0f-47a9-af95-2d979af56a21 tempest-VolumeDependencyTests-798409840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:44:57 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-60204f6c-0bac-449d-9838-f8d708dd5141 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:44:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-60204f6c-0bac-449d-9838-f8d708dd5141 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Flow 'volume_create_manager' (fffdb20a-d598-4f05-a6c4-cf76b1287952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:44:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-60204f6c-0bac-449d-9838-f8d708dd5141 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (677bd0a8-8d65-4dcc-be02-9679e7b54d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-60204f6c-0bac-449d-9838-f8d708dd5141 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (677bd0a8-8d65-4dcc-be02-9679e7b54d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1806012618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5df21596-21b3-4978-ac27-ffe0f89acadc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='150559a7fae843dea9b82c162dd79272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:44:57Z,use_quota=True,user_id='b75b81a3f03e455da73af86f707c5e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-60204f6c-0bac-449d-9838-f8d708dd5141 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae21d9ec-a8b7-4f7a-b397-29a75ebaaa3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-60204f6c-0bac-449d-9838-f8d708dd5141 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae21d9ec-a8b7-4f7a-b397-29a75ebaaa3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-60204f6c-0bac-449d-9838-f8d708dd5141 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51852a7c-8975-4c20-96d6-22cf6416c87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-60204f6c-0bac-449d-9838-f8d708dd5141 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51852a7c-8975-4c20-96d6-22cf6416c87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5df21596-21b3-4978-ac27-ffe0f89acadc', 'volume_name': 'volume-5df21596-21b3-4978-ac27-ffe0f89acadc', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-60204f6c-0bac-449d-9838-f8d708dd5141 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7409cad-a494-415e-8cd6-f84b1bc5d026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-60204f6c-0bac-449d-9838-f8d708dd5141 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7409cad-a494-415e-8cd6-f84b1bc5d026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-60204f6c-0bac-449d-9838-f8d708dd5141 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5565a11b-d33a-4ee8-9f39-229344db6dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:57 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-60204f6c-0bac-449d-9838-f8d708dd5141 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Volume 5df21596-21b3-4978-ac27-ffe0f89acadc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5df21596-21b3-4978-ac27-ffe0f89acadc', 'volume_size': 1} Nov 02 12:44:57 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-60204f6c-0bac-449d-9838-f8d708dd5141 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:44:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-696d67c0-fc66-4496-97fb-70eaf63cbb97 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6800b32d-15a3-4049-b8b4-c94eae57dc92 1073741824" returned: 0 in 0.793s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-696d67c0-fc66-4496-97fb-70eaf63cbb97 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6800b32d-15a3-4049-b8b4-c94eae57dc92 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:57 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6800b32d-15a3-4049-b8b4-c94eae57dc92 Nov 02 12:44:57 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:57 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-696d67c0-fc66-4496-97fb-70eaf63cbb97 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6800b32d-15a3-4049-b8b4-c94eae57dc92" returned: 0 in 0.385s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:57 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-696d67c0-fc66-4496-97fb-70eaf63cbb97 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:44:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-696d67c0-fc66-4496-97fb-70eaf63cbb97 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:44:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3bc66a4e-2d0f-47a9-af95-2d979af56a21 tempest-VolumeDependencyTests-798409840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.194s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:44:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-696d67c0-fc66-4496-97fb-70eaf63cbb97 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d085fc2-f82d-4617-b0c6-0e25a70d7393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6800b32d-15a3-4049-b8b4-c94eae57dc92', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:57 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-696d67c0-fc66-4496-97fb-70eaf63cbb97 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4229393d-b03f-4d3b-8fca-9420c346bddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:57 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-3bc66a4e-2d0f-47a9-af95-2d979af56a21 tempest-VolumeDependencyTests-798409840 None] Creating offline snapshot 0842fc62-382e-4b7e-bab1-73a731b3695e of volume 153f45fd-5276-407a-ae60-1c1e2057f474 {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa890d75-cddf-4645-a6ad-2bdaaecc09d7]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3bc66a4e-2d0f-47a9-af95-2d979af56a21 tempest-VolumeDependencyTests-798409840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:58 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-696d67c0-fc66-4496-97fb-70eaf63cbb97 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Volume volume-6800b32d-15a3-4049-b8b4-c94eae57dc92 (6800b32d-15a3-4049-b8b4-c94eae57dc92): created successfully Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-696d67c0-fc66-4496-97fb-70eaf63cbb97 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4229393d-b03f-4d3b-8fca-9420c346bddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-696d67c0-fc66-4496-97fb-70eaf63cbb97 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Flow 'volume_create_manager' (f7b93349-ca33-4998-a24d-bbaceb89704e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Flow 'volume_create_manager' (12f9f8fd-c457-49bd-b4ef-45c7de5a795e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe2363af-2ea9-4272-8053-44dd3ea5ceef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-8596048b-95d2-4019-940b-035e04bd6f41 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8596048b-95d2-4019-940b-035e04bd6f41 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Flow 'volume_create_manager' (d5d46854-8802-4efc-a3a5-9efdacf652ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8596048b-95d2-4019-940b-035e04bd6f41 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (499f9746-d4de-420d-87a9-78d8b9affa48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe2363af-2ea9-4272-8053-44dd3ea5ceef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03dbb308-6be5-4edd-81ac-8084e4ab47e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0bc7804376f4894ad9ebc0d10f2d63e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:44:58Z,use_quota=True,user_id='3a7d7ccc5a634916b24227983e18ec72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6b32ef4-ea90-421a-8bf9-ba1852c9bb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6b32ef4-ea90-421a-8bf9-ba1852c9bb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9c69155-33a8-4128-a3cc-1b6db13a8333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.image.glance [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Creating Keystone auth plugin from conf {{(pid=86515) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 12:44:58 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474 Nov 02 12:44:58 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:58 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-696d67c0-fc66-4496-97fb-70eaf63cbb97 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Created volume successfully. Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac7ffb6c-56ba-431c-ac46-5b9a2ede096f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ac7ffb6c-56ba-431c-ac46-5b9a2ede096f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Flow 'volume_create_manager' (0df81f3f-2418-4025-a485-da611308564b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ac7ffb6c-56ba-431c-ac46-5b9a2ede096f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d03df57-cfd6-421c-a4cb-2f4b49fe5a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8596048b-95d2-4019-940b-035e04bd6f41 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (499f9746-d4de-420d-87a9-78d8b9affa48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1233135084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4696670-b8ac-49eb-89c6-fa6b70f6d9c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='150559a7fae843dea9b82c162dd79272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:44:58Z,use_quota=True,user_id='b75b81a3f03e455da73af86f707c5e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8596048b-95d2-4019-940b-035e04bd6f41 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca9f5015-c7ce-47f8-a865-701bedb7d22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8596048b-95d2-4019-940b-035e04bd6f41 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca9f5015-c7ce-47f8-a865-701bedb7d22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8596048b-95d2-4019-940b-035e04bd6f41 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd0fca0-5d49-4c7d-884e-20efeaa8a04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8596048b-95d2-4019-940b-035e04bd6f41 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd0fca0-5d49-4c7d-884e-20efeaa8a04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4696670-b8ac-49eb-89c6-fa6b70f6d9c8', 'volume_name': 'volume-f4696670-b8ac-49eb-89c6-fa6b70f6d9c8', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8596048b-95d2-4019-940b-035e04bd6f41 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e908af3-4ed0-48d9-948b-81f6274a6335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8596048b-95d2-4019-940b-035e04bd6f41 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e908af3-4ed0-48d9-948b-81f6274a6335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8596048b-95d2-4019-940b-035e04bd6f41 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e863f2-6797-48b5-98c9-794cc2898647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:58 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-8596048b-95d2-4019-940b-035e04bd6f41 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Volume f4696670-b8ac-49eb-89c6-fa6b70f6d9c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4696670-b8ac-49eb-89c6-fa6b70f6d9c8', 'volume_size': 1} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8596048b-95d2-4019-940b-035e04bd6f41 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ac7ffb6c-56ba-431c-ac46-5b9a2ede096f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d03df57-cfd6-421c-a4cb-2f4b49fe5a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-642233919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce0d959e-462f-4f83-a29d-5a605281ad22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='150559a7fae843dea9b82c162dd79272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:44:58Z,use_quota=True,user_id='b75b81a3f03e455da73af86f707c5e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ac7ffb6c-56ba-431c-ac46-5b9a2ede096f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9164e1e-3956-46ac-92d7-a5e256ae6d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ac7ffb6c-56ba-431c-ac46-5b9a2ede096f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9164e1e-3956-46ac-92d7-a5e256ae6d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ac7ffb6c-56ba-431c-ac46-5b9a2ede096f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36486b6-284f-4194-ae36-fac7866db241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ac7ffb6c-56ba-431c-ac46-5b9a2ede096f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36486b6-284f-4194-ae36-fac7866db241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce0d959e-462f-4f83-a29d-5a605281ad22', 'volume_name': 'volume-ce0d959e-462f-4f83-a29d-5a605281ad22', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ac7ffb6c-56ba-431c-ac46-5b9a2ede096f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a961c075-df51-4503-b743-d07f0e3902d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ac7ffb6c-56ba-431c-ac46-5b9a2ede096f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a961c075-df51-4503-b743-d07f0e3902d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ac7ffb6c-56ba-431c-ac46-5b9a2ede096f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0bc3e55-feb4-4abf-8b37-33d1cc5f89e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:58 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-ac7ffb6c-56ba-431c-ac46-5b9a2ede096f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Volume ce0d959e-462f-4f83-a29d-5a605281ad22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce0d959e-462f-4f83-a29d-5a605281ad22', 'volume_size': 1} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ac7ffb6c-56ba-431c-ac46-5b9a2ede096f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:44:58 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3bc66a4e-2d0f-47a9-af95-2d979af56a21 tempest-VolumeDependencyTests-798409840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474" returned: 0 in 0.533s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3bc66a4e-2d0f-47a9-af95-2d979af56a21 tempest-VolumeDependencyTests-798409840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474.0842fc62-382e-4b7e-bab1-73a731b3695e 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:58 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474.0842fc62-382e-4b7e-bab1-73a731b3695e 1G Nov 02 12:44:58 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-09225e6b-5d09-4109-948c-e735a4bf6699 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-09225e6b-5d09-4109-948c-e735a4bf6699 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Flow 'volume_create_manager' (b1f75905-e2a5-4504-9b96-96a74c3d47ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-09225e6b-5d09-4109-948c-e735a4bf6699 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cc2f851-6b40-4599-b169-6833827b730c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-09225e6b-5d09-4109-948c-e735a4bf6699 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cc2f851-6b40-4599-b169-6833827b730c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-307221492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b6c4d0-6f19-4d69-a1b5-aaeec763f7f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='150559a7fae843dea9b82c162dd79272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:44:58Z,use_quota=True,user_id='b75b81a3f03e455da73af86f707c5e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-09225e6b-5d09-4109-948c-e735a4bf6699 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02d5c8fd-0d11-4137-890d-02aca4afb498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-09225e6b-5d09-4109-948c-e735a4bf6699 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02d5c8fd-0d11-4137-890d-02aca4afb498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-09225e6b-5d09-4109-948c-e735a4bf6699 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24638eab-8a01-44c8-9b38-713d8f5d3c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-09225e6b-5d09-4109-948c-e735a4bf6699 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24638eab-8a01-44c8-9b38-713d8f5d3c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48b6c4d0-6f19-4d69-a1b5-aaeec763f7f5', 'volume_name': 'volume-48b6c4d0-6f19-4d69-a1b5-aaeec763f7f5', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-09225e6b-5d09-4109-948c-e735a4bf6699 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (286b2212-65c2-4f5a-9fcd-7da1158853fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-09225e6b-5d09-4109-948c-e735a4bf6699 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (286b2212-65c2-4f5a-9fcd-7da1158853fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-09225e6b-5d09-4109-948c-e735a4bf6699 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2af503a-86f8-4954-8a4b-128b1ade7452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:58 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-09225e6b-5d09-4109-948c-e735a4bf6699 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Volume 48b6c4d0-6f19-4d69-a1b5-aaeec763f7f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48b6c4d0-6f19-4d69-a1b5-aaeec763f7f5', 'volume_size': 1} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-09225e6b-5d09-4109-948c-e735a4bf6699 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Flow 'volume_create_manager' (93c1a830-97ff-49d0-bdde-de82cb086f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec3c34f-353a-4f03-8fe6-9ed1413996b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec3c34f-353a-4f03-8fe6-9ed1413996b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c35e6f85-4fb5-40ff-af84-7e5276fb954d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96987f6832714e3c8dcf3a18ea8578fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:44:59Z,use_quota=True,user_id='4ae50e2e753f44fba5725183c59bbb8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d829f72e-5273-437a-bf9e-ccf115ab4467),volume_type_id=d829f72e-5273-437a-bf9e-ccf115ab4467)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5bf0275-5210-4017-a5af-ae11baa49c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5bf0275-5210-4017-a5af-ae11baa49c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ee749ce-65cb-45e3-8a40-a330a0d08c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.image.glance [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Creating Keystone auth plugin from conf {{(pid=86515) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9c69155-33a8-4128-a3cc-1b6db13a8333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '03dbb308-6be5-4edd-81ac-8084e4ab47e8', 'volume_name': 'volume-03dbb308-6be5-4edd-81ac-8084e4ab47e8', 'volume_size': 1, 'image_id': 'aba305e8-3d01-4170-ba8f-1a15c93099f0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aba305e8-3d01-4170-ba8f-1a15c93099f0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1f49f57bdcedacf5f1f235a4e5802d48', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b0bc7804376f4894ad9ebc0d10f2d63e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd36d3517c12f9c9b9f3b29fcd15e3721ac547a7895d22a41dd810e3271f523aa1c2313e49f70141d81f8983617da5aab49360d5f04782de904359c1e0409be85', 'id': 'aba305e8-3d01-4170-ba8f-1a15c93099f0', 'created_at': datetime.datetime(2026, 11, 2, 11, 44, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 44, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aba305e8-3d01-4170-ba8f-1a15c93099f0/file', 'properties': {}}, 'image_service': }' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36887763-1736-4c65-89ee-f928543f2044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36887763-1736-4c65-89ee-f928543f2044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6500e57-4f21-4485-b0b1-59fccd0b8eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:58 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Volume 03dbb308-6be5-4edd-81ac-8084e4ab47e8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-03dbb308-6be5-4edd-81ac-8084e4ab47e8', 'volume_size': 1, 'image_id': 'aba305e8-3d01-4170-ba8f-1a15c93099f0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aba305e8-3d01-4170-ba8f-1a15c93099f0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1f49f57bdcedacf5f1f235a4e5802d48', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b0bc7804376f4894ad9ebc0d10f2d63e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd36d3517c12f9c9b9f3b29fcd15e3721ac547a7895d22a41dd810e3271f523aa1c2313e49f70141d81f8983617da5aab49360d5f04782de904359c1e0409be85', 'id': 'aba305e8-3d01-4170-ba8f-1a15c93099f0', 'created_at': datetime.datetime(2026, 11, 2, 11, 44, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 44, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aba305e8-3d01-4170-ba8f-1a15c93099f0/file', 'properties': {}}, 'image_service': } Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Trying to clone 03dbb308-6be5-4edd-81ac-8084e4ab47e8 from image aba305e8-3d01-4170-ba8f-1a15c93099f0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/aba305e8-3d01-4170-ba8f-1a15c93099f0', 'metadata': {}}]). {{(pid=86515) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1127}} Nov 02 12:44:58 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_aba305e8-3d01-4170-ba8f-1a15c93099f0_zxjtnnabdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86515) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 12:44:58 devstack cinder-volume[86515]: INFO cinder.image.image_utils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Image download 0.00 MB at 0.00 MB/s Nov 02 12:44:59 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d006552-4984-456f-96e8-8027f533a175]: (4, 'raw') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:44:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aba305e8-3d01-4170-ba8f-1a15c93099f0_zxjtnnabdevstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:59 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3bc66a4e-2d0f-47a9-af95-2d979af56a21 tempest-VolumeDependencyTests-798409840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474.0842fc62-382e-4b7e-bab1-73a731b3695e 1G" returned: 0 in 0.544s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3bc66a4e-2d0f-47a9-af95-2d979af56a21 tempest-VolumeDependencyTests-798409840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-153f45fd-5276-407a-ae60-1c1e2057f474 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474.0842fc62-382e-4b7e-bab1-73a731b3695e {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:59 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-153f45fd-5276-407a-ae60-1c1e2057f474 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474.0842fc62-382e-4b7e-bab1-73a731b3695e Nov 02 12:44:59 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:59 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ee749ce-65cb-45e3-8a40-a330a0d08c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c35e6f85-4fb5-40ff-af84-7e5276fb954d', 'volume_name': 'volume-c35e6f85-4fb5-40ff-af84-7e5276fb954d', 'volume_size': 1, 'image_id': '26774e02-5e9f-492d-bf0c-7fd6e67406cb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26774e02-5e9f-492d-bf0c-7fd6e67406cb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd28d159e16ca6a9d32bb9a7cb09998ce', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '96987f6832714e3c8dcf3a18ea8578fe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6fee943f34fe9ef0b4e6315d52934e3d07b06d1a5a4fcdac1d6d8adce775403e48cf8442071db6ded1dce40060156415bc702df6e479b930869ca41ca3147f9c', 'id': '26774e02-5e9f-492d-bf0c-7fd6e67406cb', 'created_at': datetime.datetime(2026, 11, 2, 11, 44, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 44, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26774e02-5e9f-492d-bf0c-7fd6e67406cb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:59 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d23d72a1-6a6f-45e2-9e55-d7eefa6dfecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:59 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d23d72a1-6a6f-45e2-9e55-d7eefa6dfecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:44:59 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (130c4b02-1274-448e-a483-9f208e9ecb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:44:59 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Volume c35e6f85-4fb5-40ff-af84-7e5276fb954d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c35e6f85-4fb5-40ff-af84-7e5276fb954d', 'volume_size': 1, 'image_id': '26774e02-5e9f-492d-bf0c-7fd6e67406cb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26774e02-5e9f-492d-bf0c-7fd6e67406cb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd28d159e16ca6a9d32bb9a7cb09998ce', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '96987f6832714e3c8dcf3a18ea8578fe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6fee943f34fe9ef0b4e6315d52934e3d07b06d1a5a4fcdac1d6d8adce775403e48cf8442071db6ded1dce40060156415bc702df6e479b930869ca41ca3147f9c', 'id': '26774e02-5e9f-492d-bf0c-7fd6e67406cb', 'created_at': datetime.datetime(2026, 11, 2, 11, 44, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 44, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26774e02-5e9f-492d-bf0c-7fd6e67406cb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 02 12:44:59 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Trying to clone c35e6f85-4fb5-40ff-af84-7e5276fb954d from image 26774e02-5e9f-492d-bf0c-7fd6e67406cb at location (None, [{'url': 'file:///opt/stack/data/glance/images/26774e02-5e9f-492d-bf0c-7fd6e67406cb', 'metadata': {}}]). {{(pid=86515) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1127}} Nov 02 12:44:59 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aba305e8-3d01-4170-ba8f-1a15c93099f0_zxjtnnabdevstack@QuobyteHD Nov 02 12:44:59 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:59 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_26774e02-5e9f-492d-bf0c-7fd6e67406cb_qkjciuaidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86515) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 12:44:59 devstack cinder-volume[86515]: INFO cinder.image.image_utils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Image download 0.00 MB at 0.00 MB/s Nov 02 12:44:59 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8e0425-fe10-4c61-9e69-27c9b094bf29]: (4, 'raw') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:44:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26774e02-5e9f-492d-bf0c-7fd6e67406cb_qkjciuaidevstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:59 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aba305e8-3d01-4170-ba8f-1a15c93099f0_zxjtnnabdevstack@QuobyteHD" returned: 0 in 0.354s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aba305e8-3d01-4170-ba8f-1a15c93099f0_zxjtnnabdevstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:59 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26774e02-5e9f-492d-bf0c-7fd6e67406cb_qkjciuaidevstack@QuobyteHD Nov 02 12:44:59 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:59 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3bc66a4e-2d0f-47a9-af95-2d979af56a21 tempest-VolumeDependencyTests-798409840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-153f45fd-5276-407a-ae60-1c1e2057f474 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474.0842fc62-382e-4b7e-bab1-73a731b3695e" returned: 0 in 0.391s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:59 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-3bc66a4e-2d0f-47a9-af95-2d979af56a21 tempest-VolumeDependencyTests-798409840 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474.0842fc62-382e-4b7e-bab1-73a731b3695e is being set with open permissions: ugo+rw Nov 02 12:44:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3bc66a4e-2d0f-47a9-af95-2d979af56a21 tempest-VolumeDependencyTests-798409840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474.0842fc62-382e-4b7e-bab1-73a731b3695e {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:59 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474.0842fc62-382e-4b7e-bab1-73a731b3695e Nov 02 12:44:59 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:59 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aba305e8-3d01-4170-ba8f-1a15c93099f0_zxjtnnabdevstack@QuobyteHD Nov 02 12:44:59 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:59 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26774e02-5e9f-492d-bf0c-7fd6e67406cb_qkjciuaidevstack@QuobyteHD" returned: 0 in 0.345s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26774e02-5e9f-492d-bf0c-7fd6e67406cb_qkjciuaidevstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:59 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3bc66a4e-2d0f-47a9-af95-2d979af56a21 tempest-VolumeDependencyTests-798409840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474.0842fc62-382e-4b7e-bab1-73a731b3695e" returned: 0 in 0.262s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:59 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26774e02-5e9f-492d-bf0c-7fd6e67406cb_qkjciuaidevstack@QuobyteHD Nov 02 12:44:59 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3bc66a4e-2d0f-47a9-af95-2d979af56a21 tempest-VolumeDependencyTests-798409840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:59 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Nov 02 12:44:59 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474.info Nov 02 12:44:59 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:44:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aba305e8-3d01-4170-ba8f-1a15c93099f0_zxjtnnabdevstack@QuobyteHD" returned: 1 in 0.401s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:44:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aba305e8-3d01-4170-ba8f-1a15c93099f0_zxjtnnabdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:44:59 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Temporary image aba305e8-3d01-4170-ba8f-1a15c93099f0 is fetched for user 3a7d7ccc5a634916b24227983e18ec72. {{(pid=86515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 12:44:59 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[323076cd-b2c3-4ffe-ba0f-460317aea043]: (4, 'raw') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:44:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aba305e8-3d01-4170-ba8f-1a15c93099f0_zxjtnnabdevstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:44:59 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aba305e8-3d01-4170-ba8f-1a15c93099f0_zxjtnnabdevstack@QuobyteHD Nov 02 12:44:59 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:00 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26774e02-5e9f-492d-bf0c-7fd6e67406cb_qkjciuaidevstack@QuobyteHD" returned: 1 in 0.369s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26774e02-5e9f-492d-bf0c-7fd6e67406cb_qkjciuaidevstack@QuobyteHD' failed. Not Retrying. {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:45:00 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Temporary image 26774e02-5e9f-492d-bf0c-7fd6e67406cb is fetched for user 4ae50e2e753f44fba5725183c59bbb8d. {{(pid=86515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 12:45:00 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3bc66a4e-2d0f-47a9-af95-2d979af56a21 tempest-VolumeDependencyTests-798409840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474.info" returned: 0 in 0.302s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:00 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-3bc66a4e-2d0f-47a9-af95-2d979af56a21 tempest-VolumeDependencyTests-798409840 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474.info is being set with open permissions: ugo+rw Nov 02 12:45:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3bc66a4e-2d0f-47a9-af95-2d979af56a21 tempest-VolumeDependencyTests-798409840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:00 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b20515e-5350-4d8d-a59f-593c5429beed]: (4, 'raw') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26774e02-5e9f-492d-bf0c-7fd6e67406cb_qkjciuaidevstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:00 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474.info Nov 02 12:45:00 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:00 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26774e02-5e9f-492d-bf0c-7fd6e67406cb_qkjciuaidevstack@QuobyteHD Nov 02 12:45:00 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:00 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aba305e8-3d01-4170-ba8f-1a15c93099f0_zxjtnnabdevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aba305e8-3d01-4170-ba8f-1a15c93099f0_zxjtnnabdevstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:00 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aba305e8-3d01-4170-ba8f-1a15c93099f0_zxjtnnabdevstack@QuobyteHD Nov 02 12:45:00 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:00 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3bc66a4e-2d0f-47a9-af95-2d979af56a21 tempest-VolumeDependencyTests-798409840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474.info" returned: 0 in 0.308s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3bc66a4e-2d0f-47a9-af95-2d979af56a21 tempest-VolumeDependencyTests-798409840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.651s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-60204f6c-0bac-449d-9838-f8d708dd5141 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.120s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:00 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-60204f6c-0bac-449d-9838-f8d708dd5141 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1806012618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5df21596-21b3-4978-ac27-ffe0f89acadc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='150559a7fae843dea9b82c162dd79272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:44:57Z,use_quota=True,user_id='b75b81a3f03e455da73af86f707c5e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:45:00 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-60204f6c-0bac-449d-9838-f8d708dd5141 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Creating volume 5df21596-21b3-4978-ac27-ffe0f89acadc {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:45:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-60204f6c-0bac-449d-9838-f8d708dd5141 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-60204f6c-0bac-449d-9838-f8d708dd5141 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:00 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-60204f6c-0bac-449d-9838-f8d708dd5141 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:00 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-60204f6c-0bac-449d-9838-f8d708dd5141 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-60204f6c-0bac-449d-9838-f8d708dd5141 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:00 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-60204f6c-0bac-449d-9838-f8d708dd5141 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:45:00 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-60204f6c-0bac-449d-9838-f8d708dd5141 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:45:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-60204f6c-0bac-449d-9838-f8d708dd5141 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5df21596-21b3-4978-ac27-ffe0f89acadc 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:00 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26774e02-5e9f-492d-bf0c-7fd6e67406cb_qkjciuaidevstack@QuobyteHD" returned: 0 in 0.358s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26774e02-5e9f-492d-bf0c-7fd6e67406cb_qkjciuaidevstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:00 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5df21596-21b3-4978-ac27-ffe0f89acadc 1073741824 Nov 02 12:45:00 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:00 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-3bc66a4e-2d0f-47a9-af95-2d979af56a21 tempest-VolumeDependencyTests-798409840 None] Create snapshot completed successfully Nov 02 12:45:00 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aba305e8-3d01-4170-ba8f-1a15c93099f0_zxjtnnabdevstack@QuobyteHD" returned: 1 in 0.360s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aba305e8-3d01-4170-ba8f-1a15c93099f0_zxjtnnabdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:45:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:00 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26774e02-5e9f-492d-bf0c-7fd6e67406cb_qkjciuaidevstack@QuobyteHD Nov 02 12:45:00 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:00 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26774e02-5e9f-492d-bf0c-7fd6e67406cb_qkjciuaidevstack@QuobyteHD" returned: 1 in 0.372s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26774e02-5e9f-492d-bf0c-7fd6e67406cb_qkjciuaidevstack@QuobyteHD' failed. Not Retrying. {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:45:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:00 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-60204f6c-0bac-449d-9838-f8d708dd5141 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5df21596-21b3-4978-ac27-ffe0f89acadc 1073741824" returned: 0 in 0.506s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-60204f6c-0bac-449d-9838-f8d708dd5141 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5df21596-21b3-4978-ac27-ffe0f89acadc {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:01 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5df21596-21b3-4978-ac27-ffe0f89acadc Nov 02 12:45:01 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:01 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-60204f6c-0bac-449d-9838-f8d708dd5141 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5df21596-21b3-4978-ac27-ffe0f89acadc" returned: 0 in 0.236s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:01 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-60204f6c-0bac-449d-9838-f8d708dd5141 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:45:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-60204f6c-0bac-449d-9838-f8d708dd5141 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8596048b-95d2-4019-940b-035e04bd6f41 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.807s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:01 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8596048b-95d2-4019-940b-035e04bd6f41 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1233135084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4696670-b8ac-49eb-89c6-fa6b70f6d9c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='150559a7fae843dea9b82c162dd79272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:44:58Z,use_quota=True,user_id='b75b81a3f03e455da73af86f707c5e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:45:01 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-8596048b-95d2-4019-940b-035e04bd6f41 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Creating volume f4696670-b8ac-49eb-89c6-fa6b70f6d9c8 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:45:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8596048b-95d2-4019-940b-035e04bd6f41 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8596048b-95d2-4019-940b-035e04bd6f41 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:01 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8596048b-95d2-4019-940b-035e04bd6f41 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:01 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8596048b-95d2-4019-940b-035e04bd6f41 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8596048b-95d2-4019-940b-035e04bd6f41 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:01 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8596048b-95d2-4019-940b-035e04bd6f41 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:45:01 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-8596048b-95d2-4019-940b-035e04bd6f41 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:45:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8596048b-95d2-4019-940b-035e04bd6f41 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f4696670-b8ac-49eb-89c6-fa6b70f6d9c8 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-60204f6c-0bac-449d-9838-f8d708dd5141 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5565a11b-d33a-4ee8-9f39-229344db6dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5df21596-21b3-4978-ac27-ffe0f89acadc', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-60204f6c-0bac-449d-9838-f8d708dd5141 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6293985-b882-4016-ab1f-628fef1494f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:01 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f4696670-b8ac-49eb-89c6-fa6b70f6d9c8 1073741824 Nov 02 12:45:01 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:01 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-60204f6c-0bac-449d-9838-f8d708dd5141 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Volume volume-5df21596-21b3-4978-ac27-ffe0f89acadc (5df21596-21b3-4978-ac27-ffe0f89acadc): created successfully Nov 02 12:45:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-60204f6c-0bac-449d-9838-f8d708dd5141 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6293985-b882-4016-ab1f-628fef1494f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-60204f6c-0bac-449d-9838-f8d708dd5141 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Flow 'volume_create_manager' (fffdb20a-d598-4f05-a6c4-cf76b1287952) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:01 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-60204f6c-0bac-449d-9838-f8d708dd5141 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Created volume successfully. Nov 02 12:45:01 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8596048b-95d2-4019-940b-035e04bd6f41 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f4696670-b8ac-49eb-89c6-fa6b70f6d9c8 1073741824" returned: 0 in 0.539s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8596048b-95d2-4019-940b-035e04bd6f41 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f4696670-b8ac-49eb-89c6-fa6b70f6d9c8 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:01 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f4696670-b8ac-49eb-89c6-fa6b70f6d9c8 Nov 02 12:45:01 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:01 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:45:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Flow 'volume_create_manager' (dbc63bf2-94ba-48aa-913f-ce752eaa93bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e7d199-e06d-4387-a70b-b5a9b4060f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e7d199-e06d-4387-a70b-b5a9b4060f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2052430860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81fdbad2-8094-4d01-a62e-795295e3ab41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d048840d98f42179e0b11ac201a20a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0842fc62-382e-4b7e-bab1-73a731b3695e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:02Z,use_quota=True,user_id='8e245873c387412e87d33e42c2fdacd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac0cc61-803c-4d8f-914e-975ee0ade69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac0cc61-803c-4d8f-914e-975ee0ade69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c38bc62d-2a23-463f-9f17-2e67dea6bde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c38bc62d-2a23-463f-9f17-2e67dea6bde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '81fdbad2-8094-4d01-a62e-795295e3ab41', 'volume_name': 'volume-81fdbad2-8094-4d01-a62e-795295e3ab41', 'volume_size': 1, 'snapshot_id': '0842fc62-382e-4b7e-bab1-73a731b3695e'}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (087474ee-f473-46cc-a4c5-5059376273f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (087474ee-f473-46cc-a4c5-5059376273f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6260b313-7c00-4f23-93c2-959c16bf11ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:02 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Volume 81fdbad2-8094-4d01-a62e-795295e3ab41: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-81fdbad2-8094-4d01-a62e-795295e3ab41', 'volume_size': 1, 'snapshot_id': '0842fc62-382e-4b7e-bab1-73a731b3695e'} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:02 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8596048b-95d2-4019-940b-035e04bd6f41 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f4696670-b8ac-49eb-89c6-fa6b70f6d9c8" returned: 0 in 0.276s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8596048b-95d2-4019-940b-035e04bd6f41 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8596048b-95d2-4019-940b-035e04bd6f41 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ac7ffb6c-56ba-431c-ac46-5b9a2ede096f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.597s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ac7ffb6c-56ba-431c-ac46-5b9a2ede096f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-642233919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce0d959e-462f-4f83-a29d-5a605281ad22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='150559a7fae843dea9b82c162dd79272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:44:58Z,use_quota=True,user_id='b75b81a3f03e455da73af86f707c5e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-ac7ffb6c-56ba-431c-ac46-5b9a2ede096f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Creating volume ce0d959e-462f-4f83-a29d-5a605281ad22 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ac7ffb6c-56ba-431c-ac46-5b9a2ede096f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ac7ffb6c-56ba-431c-ac46-5b9a2ede096f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ac7ffb6c-56ba-431c-ac46-5b9a2ede096f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ac7ffb6c-56ba-431c-ac46-5b9a2ede096f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ac7ffb6c-56ba-431c-ac46-5b9a2ede096f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ac7ffb6c-56ba-431c-ac46-5b9a2ede096f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:45:02 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-ac7ffb6c-56ba-431c-ac46-5b9a2ede096f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ac7ffb6c-56ba-431c-ac46-5b9a2ede096f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ce0d959e-462f-4f83-a29d-5a605281ad22 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8596048b-95d2-4019-940b-035e04bd6f41 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9e863f2-6797-48b5-98c9-794cc2898647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4696670-b8ac-49eb-89c6-fa6b70f6d9c8', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8596048b-95d2-4019-940b-035e04bd6f41 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e228cb0e-0aaa-4199-ba45-fd1b91afe0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:02 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ce0d959e-462f-4f83-a29d-5a605281ad22 1073741824 Nov 02 12:45:02 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:02 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-8596048b-95d2-4019-940b-035e04bd6f41 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Volume volume-f4696670-b8ac-49eb-89c6-fa6b70f6d9c8 (f4696670-b8ac-49eb-89c6-fa6b70f6d9c8): created successfully Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8596048b-95d2-4019-940b-035e04bd6f41 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e228cb0e-0aaa-4199-ba45-fd1b91afe0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8596048b-95d2-4019-940b-035e04bd6f41 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Flow 'volume_create_manager' (d5d46854-8802-4efc-a3a5-9efdacf652ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:02 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-8596048b-95d2-4019-940b-035e04bd6f41 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Created volume successfully. Nov 02 12:45:02 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ac7ffb6c-56ba-431c-ac46-5b9a2ede096f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ce0d959e-462f-4f83-a29d-5a605281ad22 1073741824" returned: 0 in 0.503s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ac7ffb6c-56ba-431c-ac46-5b9a2ede096f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ce0d959e-462f-4f83-a29d-5a605281ad22 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:02 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ce0d959e-462f-4f83-a29d-5a605281ad22 Nov 02 12:45:02 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:02 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ac7ffb6c-56ba-431c-ac46-5b9a2ede096f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ce0d959e-462f-4f83-a29d-5a605281ad22" returned: 0 in 0.255s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ac7ffb6c-56ba-431c-ac46-5b9a2ede096f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ac7ffb6c-56ba-431c-ac46-5b9a2ede096f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-09225e6b-5d09-4109-948c-e735a4bf6699 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.105s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-09225e6b-5d09-4109-948c-e735a4bf6699 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-307221492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b6c4d0-6f19-4d69-a1b5-aaeec763f7f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='150559a7fae843dea9b82c162dd79272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:44:58Z,use_quota=True,user_id='b75b81a3f03e455da73af86f707c5e19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-09225e6b-5d09-4109-948c-e735a4bf6699 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Creating volume 48b6c4d0-6f19-4d69-a1b5-aaeec763f7f5 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-09225e6b-5d09-4109-948c-e735a4bf6699 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-09225e6b-5d09-4109-948c-e735a4bf6699 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-09225e6b-5d09-4109-948c-e735a4bf6699 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-09225e6b-5d09-4109-948c-e735a4bf6699 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-09225e6b-5d09-4109-948c-e735a4bf6699 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-09225e6b-5d09-4109-948c-e735a4bf6699 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:45:02 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-09225e6b-5d09-4109-948c-e735a4bf6699 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-09225e6b-5d09-4109-948c-e735a4bf6699 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-48b6c4d0-6f19-4d69-a1b5-aaeec763f7f5 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ac7ffb6c-56ba-431c-ac46-5b9a2ede096f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0bc3e55-feb4-4abf-8b37-33d1cc5f89e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce0d959e-462f-4f83-a29d-5a605281ad22', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ac7ffb6c-56ba-431c-ac46-5b9a2ede096f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46eec3c0-2e51-46b7-a355-1dcf9ad9a759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:02 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-48b6c4d0-6f19-4d69-a1b5-aaeec763f7f5 1073741824 Nov 02 12:45:02 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:02 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-ac7ffb6c-56ba-431c-ac46-5b9a2ede096f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Volume volume-ce0d959e-462f-4f83-a29d-5a605281ad22 (ce0d959e-462f-4f83-a29d-5a605281ad22): created successfully Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ac7ffb6c-56ba-431c-ac46-5b9a2ede096f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46eec3c0-2e51-46b7-a355-1dcf9ad9a759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ac7ffb6c-56ba-431c-ac46-5b9a2ede096f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Flow 'volume_create_manager' (0df81f3f-2418-4025-a485-da611308564b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:02 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-ac7ffb6c-56ba-431c-ac46-5b9a2ede096f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Created volume successfully. Nov 02 12:45:03 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-09225e6b-5d09-4109-948c-e735a4bf6699 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-48b6c4d0-6f19-4d69-a1b5-aaeec763f7f5 1073741824" returned: 0 in 0.435s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-09225e6b-5d09-4109-948c-e735a4bf6699 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-48b6c4d0-6f19-4d69-a1b5-aaeec763f7f5 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:03 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-48b6c4d0-6f19-4d69-a1b5-aaeec763f7f5 Nov 02 12:45:03 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:03 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-09225e6b-5d09-4109-948c-e735a4bf6699 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-48b6c4d0-6f19-4d69-a1b5-aaeec763f7f5" returned: 0 in 0.233s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:03 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-09225e6b-5d09-4109-948c-e735a4bf6699 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:45:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-09225e6b-5d09-4109-948c-e735a4bf6699 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.010s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:03 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03dbb308-6be5-4edd-81ac-8084e4ab47e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0bc7804376f4894ad9ebc0d10f2d63e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:44:58Z,use_quota=True,user_id='3a7d7ccc5a634916b24227983e18ec72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:45:03 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Creating volume 03dbb308-6be5-4edd-81ac-8084e4ab47e8 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:45:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:03 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:03 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:03 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:45:03 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:45:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-03dbb308-6be5-4edd-81ac-8084e4ab47e8 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:03 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-03dbb308-6be5-4edd-81ac-8084e4ab47e8 1073741824 Nov 02 12:45:03 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-09225e6b-5d09-4109-948c-e735a4bf6699 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2af503a-86f8-4954-8a4b-128b1ade7452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48b6c4d0-6f19-4d69-a1b5-aaeec763f7f5', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-09225e6b-5d09-4109-948c-e735a4bf6699 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44dafa0-037a-49de-930d-e15a7911e4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:03 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-09225e6b-5d09-4109-948c-e735a4bf6699 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Volume volume-48b6c4d0-6f19-4d69-a1b5-aaeec763f7f5 (48b6c4d0-6f19-4d69-a1b5-aaeec763f7f5): created successfully Nov 02 12:45:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-09225e6b-5d09-4109-948c-e735a4bf6699 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44dafa0-037a-49de-930d-e15a7911e4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-09225e6b-5d09-4109-948c-e735a4bf6699 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Flow 'volume_create_manager' (b1f75905-e2a5-4504-9b96-96a74c3d47ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:03 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-09225e6b-5d09-4109-948c-e735a4bf6699 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Created volume successfully. Nov 02 12:45:04 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8d87dc36-0c57-45d8-a7f0-27c36d50ce4b tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Acquiring lock "cinder-48b6c4d0-6f19-4d69-a1b5-aaeec763f7f5-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:04 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8d87dc36-0c57-45d8-a7f0-27c36d50ce4b tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "cinder-48b6c4d0-6f19-4d69-a1b5-aaeec763f7f5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:04 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8d87dc36-0c57-45d8-a7f0-27c36d50ce4b tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Acquiring lock "cinder-quobyte-48b6c4d0-6f19-4d69-a1b5-aaeec763f7f5" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:04 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8d87dc36-0c57-45d8-a7f0-27c36d50ce4b tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "cinder-quobyte-48b6c4d0-6f19-4d69-a1b5-aaeec763f7f5" acquired by "delete_volume" :: waited 0.018s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:04 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-03dbb308-6be5-4edd-81ac-8084e4ab47e8 1073741824" returned: 0 in 0.584s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:04 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae61deb3-430c-4184-8ee1-6586bbb6c065]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8d87dc36-0c57-45d8-a7f0-27c36d50ce4b tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-48b6c4d0-6f19-4d69-a1b5-aaeec763f7f5 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-03dbb308-6be5-4edd-81ac-8084e4ab47e8 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:04 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-03dbb308-6be5-4edd-81ac-8084e4ab47e8 Nov 02 12:45:04 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:04 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-48b6c4d0-6f19-4d69-a1b5-aaeec763f7f5 Nov 02 12:45:04 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:04 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-03dbb308-6be5-4edd-81ac-8084e4ab47e8" returned: 0 in 0.313s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:04 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:45:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.737s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:04 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c35e6f85-4fb5-40ff-af84-7e5276fb954d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96987f6832714e3c8dcf3a18ea8578fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:44:59Z,use_quota=True,user_id='4ae50e2e753f44fba5725183c59bbb8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d829f72e-5273-437a-bf9e-ccf115ab4467),volume_type_id=d829f72e-5273-437a-bf9e-ccf115ab4467)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:45:04 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Creating volume c35e6f85-4fb5-40ff-af84-7e5276fb954d {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:45:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:04 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:04 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:04 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:45:04 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:45:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c35e6f85-4fb5-40ff-af84-7e5276fb954d 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:04 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:04 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c35e6f85-4fb5-40ff-af84-7e5276fb954d 1073741824 Nov 02 12:45:04 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8d87dc36-0c57-45d8-a7f0-27c36d50ce4b tempest-CreateVolumesFromSourceVolumeTest-347036412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-48b6c4d0-6f19-4d69-a1b5-aaeec763f7f5" returned: 0 in 0.412s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8d87dc36-0c57-45d8-a7f0-27c36d50ce4b tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-48b6c4d0-6f19-4d69-a1b5-aaeec763f7f5 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:04 devstack cinder-volume[86515]: DEBUG cinder.volume.volume_utils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Attempting download of aba305e8-3d01-4170-ba8f-1a15c93099f0 ((None, [{'url': 'file:///opt/stack/data/glance/images/aba305e8-3d01-4170-ba8f-1a15c93099f0', 'metadata': {}}])) to volume 03dbb308-6be5-4edd-81ac-8084e4ab47e8. {{(pid=86515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 12:45:04 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-48b6c4d0-6f19-4d69-a1b5-aaeec763f7f5 Nov 02 12:45:04 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:04 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5201997-98f1-4622-92ce-c15cba130bdc]: (4, 'raw') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aba305e8-3d01-4170-ba8f-1a15c93099f0_cna1tq8k {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:04 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aba305e8-3d01-4170-ba8f-1a15c93099f0_cna1tq8k Nov 02 12:45:04 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:04 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8d87dc36-0c57-45d8-a7f0-27c36d50ce4b tempest-CreateVolumesFromSourceVolumeTest-347036412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-48b6c4d0-6f19-4d69-a1b5-aaeec763f7f5" returned: 0 in 0.337s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:04 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8d87dc36-0c57-45d8-a7f0-27c36d50ce4b tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "cinder-quobyte-48b6c4d0-6f19-4d69-a1b5-aaeec763f7f5" released by "delete_volume" :: held 0.803s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-8d87dc36-0c57-45d8-a7f0-27c36d50ce4b tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Created reservations ['f79c58ac-81d5-42a6-8789-16a9f8fe8452', '015b0729-3d70-448d-bf47-6d0aaed96d11', '26e5adaa-6563-4b06-bbf3-756e15d2612c', '32ada05f-bec1-43fd-8bf7-0115919103e5'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:05 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:05 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aba305e8-3d01-4170-ba8f-1a15c93099f0_cna1tq8k" returned: 0 in 0.413s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aba305e8-3d01-4170-ba8f-1a15c93099f0_cna1tq8k {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c35e6f85-4fb5-40ff-af84-7e5276fb954d 1073741824" returned: 0 in 0.553s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8d87dc36-0c57-45d8-a7f0-27c36d50ce4b tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8d87dc36-0c57-45d8-a7f0-27c36d50ce4b tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8d87dc36-0c57-45d8-a7f0-27c36d50ce4b tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8d87dc36-0c57-45d8-a7f0-27c36d50ce4b tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8d87dc36-0c57-45d8-a7f0-27c36d50ce4b tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8d87dc36-0c57-45d8-a7f0-27c36d50ce4b tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:05 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c35e6f85-4fb5-40ff-af84-7e5276fb954d {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:05 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:05 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aba305e8-3d01-4170-ba8f-1a15c93099f0_cna1tq8k Nov 02 12:45:05 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:05 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c35e6f85-4fb5-40ff-af84-7e5276fb954d Nov 02 12:45:05 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e4f414c4-38f0-4e6f-bc1a-6bc6a5e4b518 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Acquiring lock "cinder-ce0d959e-462f-4f83-a29d-5a605281ad22-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e4f414c4-38f0-4e6f-bc1a-6bc6a5e4b518 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "cinder-ce0d959e-462f-4f83-a29d-5a605281ad22-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e4f414c4-38f0-4e6f-bc1a-6bc6a5e4b518 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Acquiring lock "cinder-quobyte-ce0d959e-462f-4f83-a29d-5a605281ad22" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e4f414c4-38f0-4e6f-bc1a-6bc6a5e4b518 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "cinder-quobyte-ce0d959e-462f-4f83-a29d-5a605281ad22" acquired by "delete_volume" :: waited 0.022s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:05 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8d87dc36-0c57-45d8-a7f0-27c36d50ce4b tempest-CreateVolumesFromSourceVolumeTest-347036412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.299s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-8d87dc36-0c57-45d8-a7f0-27c36d50ce4b tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:45:05 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-8d87dc36-0c57-45d8-a7f0-27c36d50ce4b tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Deleted volume successfully. Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbf978f-8f60-4f76-9726-117ad08808ab]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e4f414c4-38f0-4e6f-bc1a-6bc6a5e4b518 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ce0d959e-462f-4f83-a29d-5a605281ad22 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:05 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8d87dc36-0c57-45d8-a7f0-27c36d50ce4b tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "cinder-48b6c4d0-6f19-4d69-a1b5-aaeec763f7f5-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aba305e8-3d01-4170-ba8f-1a15c93099f0_cna1tq8k" returned: 1 in 0.416s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aba305e8-3d01-4170-ba8f-1a15c93099f0_cna1tq8k' failed. Not Retrying. {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e62452-3f98-4561-99f4-17c6d4c566b3]: (4, 'raw') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aba305e8-3d01-4170-ba8f-1a15c93099f0_zxjtnnabdevstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:05 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c35e6f85-4fb5-40ff-af84-7e5276fb954d" returned: 0 in 0.382s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.576s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Acquiring lock "cinder-quobyte-0842fc62-382e-4b7e-bab1-73a731b3695e-81fdbad2-8094-4d01-a62e-795295e3ab41" by "_create_volume_from_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Lock "cinder-quobyte-0842fc62-382e-4b7e-bab1-73a731b3695e-81fdbad2-8094-4d01-a62e-795295e3ab41" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Creating volume 81fdbad2-8094-4d01-a62e-795295e3ab41 from snapshot 0842fc62-382e-4b7e-bab1-73a731b3695e {{(pid=86515) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:05 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ce0d959e-462f-4f83-a29d-5a605281ad22 Nov 02 12:45:05 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Acquiring lock "cinder-quobyte-81fdbad2-8094-4d01-a62e-795295e3ab41" by "_copy_volume_from_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:05 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aba305e8-3d01-4170-ba8f-1a15c93099f0_zxjtnnabdevstack@QuobyteHD Nov 02 12:45:05 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG cinder.volume.volume_utils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Attempting download of 26774e02-5e9f-492d-bf0c-7fd6e67406cb ((None, [{'url': 'file:///opt/stack/data/glance/images/26774e02-5e9f-492d-bf0c-7fd6e67406cb', 'metadata': {}}])) to volume c35e6f85-4fb5-40ff-af84-7e5276fb954d. {{(pid=86515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Lock "cinder-quobyte-81fdbad2-8094-4d01-a62e-795295e3ab41" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] snapshot: 0842fc62-382e-4b7e-bab1-73a731b3695e, volume: 81fdbad2-8094-4d01-a62e-795295e3ab41, {{(pid=86515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[803f8e17-6b7e-46fb-955d-955b75e780b0]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474.0842fc62-382e-4b7e-bab1-73a731b3695e {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d82bbf-0027-472c-8147-f9a665b1131a]: (4, 'raw') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26774e02-5e9f-492d-bf0c-7fd6e67406cb_pmk98qsf {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:05 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aba305e8-3d01-4170-ba8f-1a15c93099f0_zxjtnnabdevstack@QuobyteHD" returned: 0 in 0.354s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aba305e8-3d01-4170-ba8f-1a15c93099f0_zxjtnnabdevstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:05 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474.0842fc62-382e-4b7e-bab1-73a731b3695e Nov 02 12:45:05 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:05 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26774e02-5e9f-492d-bf0c-7fd6e67406cb_pmk98qsf Nov 02 12:45:05 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:05 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e4f414c4-38f0-4e6f-bc1a-6bc6a5e4b518 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ce0d959e-462f-4f83-a29d-5a605281ad22" returned: 0 in 0.486s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e4f414c4-38f0-4e6f-bc1a-6bc6a5e4b518 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ce0d959e-462f-4f83-a29d-5a605281ad22 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:06 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ce0d959e-462f-4f83-a29d-5a605281ad22 Nov 02 12:45:06 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aba305e8-3d01-4170-ba8f-1a15c93099f0_zxjtnnabdevstack@QuobyteHD Nov 02 12:45:06 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:06 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:06 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_26774e02-5e9f-492d-bf0c-7fd6e67406cb_pmk98qsf" returned: 0 in 0.379s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26774e02-5e9f-492d-bf0c-7fd6e67406cb_pmk98qsf {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:06 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474.0842fc62-382e-4b7e-bab1-73a731b3695e" returned: 0 in 0.479s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:06 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-153f45fd-5276-407a-ae60-1c1e2057f474(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:45:06 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf32594-41bc-42a1-a03e-aeee23ac05ed]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:06 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26774e02-5e9f-492d-bf0c-7fd6e67406cb_pmk98qsf Nov 02 12:45:06 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:06 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aba305e8-3d01-4170-ba8f-1a15c93099f0_zxjtnnabdevstack@QuobyteHD" returned: 1 in 0.406s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aba305e8-3d01-4170-ba8f-1a15c93099f0_zxjtnnabdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:45:06 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] aba305e8-3d01-4170-ba8f-1a15c93099f0 was raw, converting to qcow2 {{(pid=86515) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 12:45:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_aba305e8-3d01-4170-ba8f-1a15c93099f0_zxjtnnabdevstack@QuobyteHD /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-03dbb308-6be5-4edd-81ac-8084e4ab47e8 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:06 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_aba305e8-3d01-4170-ba8f-1a15c93099f0_zxjtnnabdevstack@QuobyteHD /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-03dbb308-6be5-4edd-81ac-8084e4ab47e8 Nov 02 12:45:06 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:06 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474 Nov 02 12:45:06 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:06 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e4f414c4-38f0-4e6f-bc1a-6bc6a5e4b518 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ce0d959e-462f-4f83-a29d-5a605281ad22" returned: 0 in 0.481s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:06 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e4f414c4-38f0-4e6f-bc1a-6bc6a5e4b518 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "cinder-quobyte-ce0d959e-462f-4f83-a29d-5a605281ad22" released by "delete_volume" :: held 1.052s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:06 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-e4f414c4-38f0-4e6f-bc1a-6bc6a5e4b518 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Created reservations ['b17717f6-cc4d-4d86-8554-75c993a26eaf', '31838d19-143e-46c1-a02a-e80bbb918143', '03abed4d-953a-4c16-8324-62e52c4c784b', 'f1647db9-bd23-497c-810a-82a548444134'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:06 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26774e02-5e9f-492d-bf0c-7fd6e67406cb_pmk98qsf" returned: 1 in 0.492s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_26774e02-5e9f-492d-bf0c-7fd6e67406cb_pmk98qsf' failed. Not Retrying. {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:45:06 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d9f650-60a3-49f8-a864-5ad478cad4b0]: (4, 'raw') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26774e02-5e9f-492d-bf0c-7fd6e67406cb_qkjciuaidevstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e4f414c4-38f0-4e6f-bc1a-6bc6a5e4b518 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e4f414c4-38f0-4e6f-bc1a-6bc6a5e4b518 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:06 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e4f414c4-38f0-4e6f-bc1a-6bc6a5e4b518 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:06 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e4f414c4-38f0-4e6f-bc1a-6bc6a5e4b518 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e4f414c4-38f0-4e6f-bc1a-6bc6a5e4b518 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e4f414c4-38f0-4e6f-bc1a-6bc6a5e4b518 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:06 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:45:06 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:06 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474" returned: 0 in 0.525s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:06 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] will copy from snapshot at /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474 {{(pid=86515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 12:45:06 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Creating direct copy from snapshot {{(pid=86515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 12:45:06 devstack cinder-volume[86515]: DEBUG cinder.utils [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Path /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-81fdbad2-8094-4d01-a62e-795295e3ab41 not found in is_blk_device check {{(pid=86515) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 12:45:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-81fdbad2-8094-4d01-a62e-795295e3ab41 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:06 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26774e02-5e9f-492d-bf0c-7fd6e67406cb_qkjciuaidevstack@QuobyteHD Nov 02 12:45:06 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:06 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-81fdbad2-8094-4d01-a62e-795295e3ab41 Nov 02 12:45:06 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:06 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_aba305e8-3d01-4170-ba8f-1a15c93099f0_zxjtnnabdevstack@QuobyteHD /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-03dbb308-6be5-4edd-81ac-8084e4ab47e8" returned: 0 in 0.666s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:06 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_aba305e8-3d01-4170-ba8f-1a15c93099f0_zxjtnnabdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-03dbb308-6be5-4edd-81ac-8084e4ab47e8 {{(pid=86515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 12:45:06 devstack cinder-volume[86515]: INFO cinder.image.image_utils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 12:45:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-03dbb308-6be5-4edd-81ac-8084e4ab47e8 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:07 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-03dbb308-6be5-4edd-81ac-8084e4ab47e8 1G Nov 02 12:45:07 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:07 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_26774e02-5e9f-492d-bf0c-7fd6e67406cb_qkjciuaidevstack@QuobyteHD" returned: 0 in 0.426s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26774e02-5e9f-492d-bf0c-7fd6e67406cb_qkjciuaidevstack@QuobyteHD {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:07 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e4f414c4-38f0-4e6f-bc1a-6bc6a5e4b518 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.374s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:07 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-e4f414c4-38f0-4e6f-bc1a-6bc6a5e4b518 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:45:07 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-e4f414c4-38f0-4e6f-bc1a-6bc6a5e4b518 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Deleted volume successfully. Nov 02 12:45:07 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e4f414c4-38f0-4e6f-bc1a-6bc6a5e4b518 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "cinder-ce0d959e-462f-4f83-a29d-5a605281ad22-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:07 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26774e02-5e9f-492d-bf0c-7fd6e67406cb_qkjciuaidevstack@QuobyteHD Nov 02 12:45:07 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:07 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-03dbb308-6be5-4edd-81ac-8084e4ab47e8 1G" returned: 0 in 0.516s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:07 devstack cinder-volume[86515]: DEBUG cinder.volume.volume_utils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Downloaded image aba305e8-3d01-4170-ba8f-1a15c93099f0 ((None, [{'url': 'file:///opt/stack/data/glance/images/aba305e8-3d01-4170-ba8f-1a15c93099f0', 'metadata': {}}])) to volume 03dbb308-6be5-4edd-81ac-8084e4ab47e8 successfully. {{(pid=86515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 12:45:07 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Temporary image aba305e8-3d01-4170-ba8f-1a15c93099f0 for user 3a7d7ccc5a634916b24227983e18ec72 is deleted. {{(pid=86515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 12:45:07 devstack cinder-volume[86515]: DEBUG cinder.volume.volume_utils [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Marking volume 03dbb308-6be5-4edd-81ac-8084e4ab47e8 as bootable. {{(pid=86515) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 12:45:07 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Copying metadata from image aba305e8-3d01-4170-ba8f-1a15c93099f0 to 03dbb308-6be5-4edd-81ac-8084e4ab47e8. {{(pid=86515) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 12:45:07 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Creating volume glance metadata for volume 03dbb308-6be5-4edd-81ac-8084e4ab47e8 backed by image aba305e8-3d01-4170-ba8f-1a15c93099f0 with: {'image_id': 'aba305e8-3d01-4170-ba8f-1a15c93099f0', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '1f49f57bdcedacf5f1f235a4e5802d48', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86515) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 12:45:07 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26774e02-5e9f-492d-bf0c-7fd6e67406cb_qkjciuaidevstack@QuobyteHD" returned: 1 in 0.572s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_26774e02-5e9f-492d-bf0c-7fd6e67406cb_qkjciuaidevstack@QuobyteHD' failed. Not Retrying. {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 12:45:07 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] 26774e02-5e9f-492d-bf0c-7fd6e67406cb was raw, converting to qcow2 {{(pid=86515) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 12:45:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_26774e02-5e9f-492d-bf0c-7fd6e67406cb_qkjciuaidevstack@QuobyteHD /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c35e6f85-4fb5-40ff-af84-7e5276fb954d {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:07 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_26774e02-5e9f-492d-bf0c-7fd6e67406cb_qkjciuaidevstack@QuobyteHD /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c35e6f85-4fb5-40ff-af84-7e5276fb954d Nov 02 12:45:07 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6500e57-4f21-4485-b0b1-59fccd0b8eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03dbb308-6be5-4edd-81ac-8084e4ab47e8', 'volume_size': 1, 'image_id': 'aba305e8-3d01-4170-ba8f-1a15c93099f0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aba305e8-3d01-4170-ba8f-1a15c93099f0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1f49f57bdcedacf5f1f235a4e5802d48', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b0bc7804376f4894ad9ebc0d10f2d63e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd36d3517c12f9c9b9f3b29fcd15e3721ac547a7895d22a41dd810e3271f523aa1c2313e49f70141d81f8983617da5aab49360d5f04782de904359c1e0409be85', 'id': 'aba305e8-3d01-4170-ba8f-1a15c93099f0', 'created_at': datetime.datetime(2026, 11, 2, 11, 44, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 44, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aba305e8-3d01-4170-ba8f-1a15c93099f0/file', 'properties': {}}, 'image_service': }' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e82a07-75b7-498a-ac89-5c6135b5326d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:07 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-57fd40c1-026b-42a6-9e3a-694e688b1e1f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Acquiring lock "cinder-f4696670-b8ac-49eb-89c6-fa6b70f6d9c8-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:07 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Volume volume-03dbb308-6be5-4edd-81ac-8084e4ab47e8 (03dbb308-6be5-4edd-81ac-8084e4ab47e8): created successfully Nov 02 12:45:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e82a07-75b7-498a-ac89-5c6135b5326d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:07 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Flow 'volume_create_manager' (12f9f8fd-c457-49bd-b4ef-45c7de5a795e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:07 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-57fd40c1-026b-42a6-9e3a-694e688b1e1f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "cinder-f4696670-b8ac-49eb-89c6-fa6b70f6d9c8-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:07 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-1de337bd-8cbc-4a9e-9f64-2974cd57f07f tempest-VolumeImageDependencyTests-1932378916 None] Created volume successfully. Nov 02 12:45:07 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-57fd40c1-026b-42a6-9e3a-694e688b1e1f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Acquiring lock "cinder-quobyte-f4696670-b8ac-49eb-89c6-fa6b70f6d9c8" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:07 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-57fd40c1-026b-42a6-9e3a-694e688b1e1f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "cinder-quobyte-f4696670-b8ac-49eb-89c6-fa6b70f6d9c8" acquired by "delete_volume" :: waited 0.025s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:08 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8d88a0-b6dd-4b56-a724-85a6dc5c7283]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-57fd40c1-026b-42a6-9e3a-694e688b1e1f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f4696670-b8ac-49eb-89c6-fa6b70f6d9c8 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:08 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f4696670-b8ac-49eb-89c6-fa6b70f6d9c8 Nov 02 12:45:08 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:08 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-57fd40c1-026b-42a6-9e3a-694e688b1e1f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f4696670-b8ac-49eb-89c6-fa6b70f6d9c8" returned: 0 in 0.805s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-57fd40c1-026b-42a6-9e3a-694e688b1e1f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f4696670-b8ac-49eb-89c6-fa6b70f6d9c8 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:08 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f4696670-b8ac-49eb-89c6-fa6b70f6d9c8 Nov 02 12:45:08 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b23c7531-7d6a-4d6f-8f9f-bf862ca9ae76 tempest-VolumeImageDependencyTests-1932378916 None] Acquiring lock "cinder-03dbb308-6be5-4edd-81ac-8084e4ab47e8-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:08 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:08 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b23c7531-7d6a-4d6f-8f9f-bf862ca9ae76 tempest-VolumeImageDependencyTests-1932378916 None] Lock "cinder-03dbb308-6be5-4edd-81ac-8084e4ab47e8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:08 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_26774e02-5e9f-492d-bf0c-7fd6e67406cb_qkjciuaidevstack@QuobyteHD /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c35e6f85-4fb5-40ff-af84-7e5276fb954d" returned: 0 in 1.291s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:08 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_26774e02-5e9f-492d-bf0c-7fd6e67406cb_qkjciuaidevstack@QuobyteHD, size 0.00 MB, duration 1.29 sec, destination /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c35e6f85-4fb5-40ff-af84-7e5276fb954d {{(pid=86515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 12:45:08 devstack cinder-volume[86515]: INFO cinder.image.image_utils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 12:45:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c35e6f85-4fb5-40ff-af84-7e5276fb954d 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:09 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c35e6f85-4fb5-40ff-af84-7e5276fb954d 1G Nov 02 12:45:09 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:09 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b23c7531-7d6a-4d6f-8f9f-bf862ca9ae76 tempest-VolumeImageDependencyTests-1932378916 None] Acquiring lock "cinder-quobyte-03dbb308-6be5-4edd-81ac-8084e4ab47e8" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:09 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b23c7531-7d6a-4d6f-8f9f-bf862ca9ae76 tempest-VolumeImageDependencyTests-1932378916 None] Lock "cinder-quobyte-03dbb308-6be5-4edd-81ac-8084e4ab47e8" acquired by "delete_volume" :: waited 0.058s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:09 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50d0f3d-df8f-40c7-bc9d-127b585d1357]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b23c7531-7d6a-4d6f-8f9f-bf862ca9ae76 tempest-VolumeImageDependencyTests-1932378916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-03dbb308-6be5-4edd-81ac-8084e4ab47e8 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:09 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-57fd40c1-026b-42a6-9e3a-694e688b1e1f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-f4696670-b8ac-49eb-89c6-fa6b70f6d9c8" returned: 0 in 0.476s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:09 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-57fd40c1-026b-42a6-9e3a-694e688b1e1f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "cinder-quobyte-f4696670-b8ac-49eb-89c6-fa6b70f6d9c8" released by "delete_volume" :: held 1.391s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:09 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-57fd40c1-026b-42a6-9e3a-694e688b1e1f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Created reservations ['e4c2910d-314f-4bd2-9713-5fce052cc0d8', '7339a063-0a70-4944-a3ed-f07a38b2fc56', '87df5846-4ada-4953-820e-c45cedb222dc', '5e17ec6c-c0c8-4d4a-85ac-8ee73dcbd252'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:09 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-03dbb308-6be5-4edd-81ac-8084e4ab47e8 Nov 02 12:45:09 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-57fd40c1-026b-42a6-9e3a-694e688b1e1f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-57fd40c1-026b-42a6-9e3a-694e688b1e1f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:09 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-57fd40c1-026b-42a6-9e3a-694e688b1e1f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:09 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-57fd40c1-026b-42a6-9e3a-694e688b1e1f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-57fd40c1-026b-42a6-9e3a-694e688b1e1f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-57fd40c1-026b-42a6-9e3a-694e688b1e1f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:09 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:45:09 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:09 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c35e6f85-4fb5-40ff-af84-7e5276fb954d 1G" returned: 0 in 0.923s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:09 devstack cinder-volume[86515]: DEBUG cinder.volume.volume_utils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Downloaded image 26774e02-5e9f-492d-bf0c-7fd6e67406cb ((None, [{'url': 'file:///opt/stack/data/glance/images/26774e02-5e9f-492d-bf0c-7fd6e67406cb', 'metadata': {}}])) to volume c35e6f85-4fb5-40ff-af84-7e5276fb954d successfully. {{(pid=86515) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 12:45:09 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Temporary image 26774e02-5e9f-492d-bf0c-7fd6e67406cb for user 4ae50e2e753f44fba5725183c59bbb8d is deleted. {{(pid=86515) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 12:45:09 devstack cinder-volume[86515]: DEBUG cinder.volume.volume_utils [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Marking volume c35e6f85-4fb5-40ff-af84-7e5276fb954d as bootable. {{(pid=86515) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 12:45:09 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Copying metadata from image 26774e02-5e9f-492d-bf0c-7fd6e67406cb to c35e6f85-4fb5-40ff-af84-7e5276fb954d. {{(pid=86515) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 12:45:09 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Creating volume glance metadata for volume c35e6f85-4fb5-40ff-af84-7e5276fb954d backed by image 26774e02-5e9f-492d-bf0c-7fd6e67406cb with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '26774e02-5e9f-492d-bf0c-7fd6e67406cb', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd28d159e16ca6a9d32bb9a7cb09998ce', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86515) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 12:45:10 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (130c4b02-1274-448e-a483-9f208e9ecb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c35e6f85-4fb5-40ff-af84-7e5276fb954d', 'volume_size': 1, 'image_id': '26774e02-5e9f-492d-bf0c-7fd6e67406cb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/26774e02-5e9f-492d-bf0c-7fd6e67406cb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd28d159e16ca6a9d32bb9a7cb09998ce', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '96987f6832714e3c8dcf3a18ea8578fe', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6fee943f34fe9ef0b4e6315d52934e3d07b06d1a5a4fcdac1d6d8adce775403e48cf8442071db6ded1dce40060156415bc702df6e479b930869ca41ca3147f9c', 'id': '26774e02-5e9f-492d-bf0c-7fd6e67406cb', 'created_at': datetime.datetime(2026, 11, 2, 11, 44, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 11, 44, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/26774e02-5e9f-492d-bf0c-7fd6e67406cb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:10 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:10 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:10 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd84e0af-86df-4076-804d-4c27871d79b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b23c7531-7d6a-4d6f-8f9f-bf862ca9ae76 tempest-VolumeImageDependencyTests-1932378916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-03dbb308-6be5-4edd-81ac-8084e4ab47e8" returned: 0 in 0.910s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-57fd40c1-026b-42a6-9e3a-694e688b1e1f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.521s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b23c7531-7d6a-4d6f-8f9f-bf862ca9ae76 tempest-VolumeImageDependencyTests-1932378916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-03dbb308-6be5-4edd-81ac-8084e4ab47e8 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:10 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-57fd40c1-026b-42a6-9e3a-694e688b1e1f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:45:10 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-57fd40c1-026b-42a6-9e3a-694e688b1e1f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Deleted volume successfully. Nov 02 12:45:10 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-03dbb308-6be5-4edd-81ac-8084e4ab47e8 Nov 02 12:45:10 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Volume volume-c35e6f85-4fb5-40ff-af84-7e5276fb954d (c35e6f85-4fb5-40ff-af84-7e5276fb954d): created successfully Nov 02 12:45:10 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:10 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd84e0af-86df-4076-804d-4c27871d79b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:10 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Flow 'volume_create_manager' (93c1a830-97ff-49d0-bdde-de82cb086f7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:10 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-57fd40c1-026b-42a6-9e3a-694e688b1e1f tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "cinder-f4696670-b8ac-49eb-89c6-fa6b70f6d9c8-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:10 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-a9889a70-2e64-4735-b103-f46d8a977d58 tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Created volume successfully. Nov 02 12:45:10 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-1e9920f2-1dc7-4f00-abf3-1b04fccdd0a0 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Acquiring lock "cinder-5df21596-21b3-4978-ac27-ffe0f89acadc-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:10 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-1e9920f2-1dc7-4f00-abf3-1b04fccdd0a0 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "cinder-5df21596-21b3-4978-ac27-ffe0f89acadc-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:10 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-1e9920f2-1dc7-4f00-abf3-1b04fccdd0a0 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Acquiring lock "cinder-quobyte-5df21596-21b3-4978-ac27-ffe0f89acadc" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:10 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-1e9920f2-1dc7-4f00-abf3-1b04fccdd0a0 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "cinder-quobyte-5df21596-21b3-4978-ac27-ffe0f89acadc" acquired by "delete_volume" :: waited 0.018s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:10 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9803978-141f-4148-9bf0-6a89e2da6f7d]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1e9920f2-1dc7-4f00-abf3-1b04fccdd0a0 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5df21596-21b3-4978-ac27-ffe0f89acadc {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:10 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d946ad62-fa20-4dbb-842d-1d304246f5df tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Acquiring lock "cinder-c35e6f85-4fb5-40ff-af84-7e5276fb954d-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:10 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d946ad62-fa20-4dbb-842d-1d304246f5df tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Lock "cinder-c35e6f85-4fb5-40ff-af84-7e5276fb954d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:10 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:10 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5df21596-21b3-4978-ac27-ffe0f89acadc Nov 02 12:45:10 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b23c7531-7d6a-4d6f-8f9f-bf862ca9ae76 tempest-VolumeImageDependencyTests-1932378916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-03dbb308-6be5-4edd-81ac-8084e4ab47e8" returned: 0 in 0.716s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:10 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d946ad62-fa20-4dbb-842d-1d304246f5df tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Acquiring lock "cinder-quobyte-c35e6f85-4fb5-40ff-af84-7e5276fb954d" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:10 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b23c7531-7d6a-4d6f-8f9f-bf862ca9ae76 tempest-VolumeImageDependencyTests-1932378916 None] Lock "cinder-quobyte-03dbb308-6be5-4edd-81ac-8084e4ab47e8" released by "delete_volume" :: held 1.755s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:10 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d946ad62-fa20-4dbb-842d-1d304246f5df tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Lock "cinder-quobyte-c35e6f85-4fb5-40ff-af84-7e5276fb954d" acquired by "delete_volume" :: waited 0.044s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:11 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f72082-344b-4ba3-ab75-07d5731216dd]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d946ad62-fa20-4dbb-842d-1d304246f5df tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c35e6f85-4fb5-40ff-af84-7e5276fb954d {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:11 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-b23c7531-7d6a-4d6f-8f9f-bf862ca9ae76 tempest-VolumeImageDependencyTests-1932378916 None] Created reservations ['d0aeef33-85e0-4ae4-9d01-7e8260b41317', 'a680a4f3-33f2-4470-9bfb-d0755953d20f', 'a826a2c8-c5c2-44c6-872f-d9776127497c', '10f29753-fe78-40d2-b6bb-3cf531a3fe60'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b23c7531-7d6a-4d6f-8f9f-bf862ca9ae76 tempest-VolumeImageDependencyTests-1932378916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b23c7531-7d6a-4d6f-8f9f-bf862ca9ae76 tempest-VolumeImageDependencyTests-1932378916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:11 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b23c7531-7d6a-4d6f-8f9f-bf862ca9ae76 tempest-VolumeImageDependencyTests-1932378916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:11 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b23c7531-7d6a-4d6f-8f9f-bf862ca9ae76 tempest-VolumeImageDependencyTests-1932378916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b23c7531-7d6a-4d6f-8f9f-bf862ca9ae76 tempest-VolumeImageDependencyTests-1932378916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b23c7531-7d6a-4d6f-8f9f-bf862ca9ae76 tempest-VolumeImageDependencyTests-1932378916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:11 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c35e6f85-4fb5-40ff-af84-7e5276fb954d Nov 02 12:45:11 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:11 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:45:11 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:11 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1e9920f2-1dc7-4f00-abf3-1b04fccdd0a0 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5df21596-21b3-4978-ac27-ffe0f89acadc" returned: 0 in 0.947s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1e9920f2-1dc7-4f00-abf3-1b04fccdd0a0 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5df21596-21b3-4978-ac27-ffe0f89acadc {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:11 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5df21596-21b3-4978-ac27-ffe0f89acadc Nov 02 12:45:11 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:11 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b23c7531-7d6a-4d6f-8f9f-bf862ca9ae76 tempest-VolumeImageDependencyTests-1932378916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.549s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:11 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-b23c7531-7d6a-4d6f-8f9f-bf862ca9ae76 tempest-VolumeImageDependencyTests-1932378916 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:45:11 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-b23c7531-7d6a-4d6f-8f9f-bf862ca9ae76 tempest-VolumeImageDependencyTests-1932378916 None] Deleted volume successfully. Nov 02 12:45:11 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b23c7531-7d6a-4d6f-8f9f-bf862ca9ae76 tempest-VolumeImageDependencyTests-1932378916 None] Lock "cinder-03dbb308-6be5-4edd-81ac-8084e4ab47e8-delete_volume" released by "delete_volume" :: held 2.939s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:12 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d946ad62-fa20-4dbb-842d-1d304246f5df tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c35e6f85-4fb5-40ff-af84-7e5276fb954d" returned: 0 in 1.055s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d946ad62-fa20-4dbb-842d-1d304246f5df tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c35e6f85-4fb5-40ff-af84-7e5276fb954d {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:12 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c35e6f85-4fb5-40ff-af84-7e5276fb954d Nov 02 12:45:12 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:12 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1e9920f2-1dc7-4f00-abf3-1b04fccdd0a0 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5df21596-21b3-4978-ac27-ffe0f89acadc" returned: 0 in 0.649s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:12 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-1e9920f2-1dc7-4f00-abf3-1b04fccdd0a0 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "cinder-quobyte-5df21596-21b3-4978-ac27-ffe0f89acadc" released by "delete_volume" :: held 1.696s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:12 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-1e9920f2-1dc7-4f00-abf3-1b04fccdd0a0 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Created reservations ['8ee9bd3c-7bde-404d-9045-b6aaedd07990', '347af4c7-dca7-4f9f-a30e-0f47f7939cc0', '49d3d2c3-7693-41d8-aeb1-c542d39d504b', '16adae59-15eb-4ea6-aa63-779a57aa7128'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1e9920f2-1dc7-4f00-abf3-1b04fccdd0a0 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1e9920f2-1dc7-4f00-abf3-1b04fccdd0a0 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:12 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-1e9920f2-1dc7-4f00-abf3-1b04fccdd0a0 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:12 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-1e9920f2-1dc7-4f00-abf3-1b04fccdd0a0 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1e9920f2-1dc7-4f00-abf3-1b04fccdd0a0 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1e9920f2-1dc7-4f00-abf3-1b04fccdd0a0 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:12 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d946ad62-fa20-4dbb-842d-1d304246f5df tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c35e6f85-4fb5-40ff-af84-7e5276fb954d" returned: 0 in 0.465s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:12 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:45:12 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:12 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d946ad62-fa20-4dbb-842d-1d304246f5df tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Lock "cinder-quobyte-c35e6f85-4fb5-40ff-af84-7e5276fb954d" released by "delete_volume" :: held 1.636s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:12 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-d946ad62-fa20-4dbb-842d-1d304246f5df tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Created reservations ['69d9db61-ea00-4de9-bfe2-723d01dc8152', '25c6be87-9711-4043-a2ed-ca46d06cf353', 'c2e476bf-c630-43e6-a8cf-b727635ef35b', '3deec320-0d86-4571-b145-1e48df0a8cbf'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:12 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-252e224d-686b-4ecb-b179-732f121ab813 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Acquiring lock "cinder-6800b32d-15a3-4049-b8b4-c94eae57dc92-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:13 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-252e224d-686b-4ecb-b179-732f121ab813 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "cinder-6800b32d-15a3-4049-b8b4-c94eae57dc92-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d946ad62-fa20-4dbb-842d-1d304246f5df tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d946ad62-fa20-4dbb-842d-1d304246f5df tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:13 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d946ad62-fa20-4dbb-842d-1d304246f5df tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:13 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d946ad62-fa20-4dbb-842d-1d304246f5df tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d946ad62-fa20-4dbb-842d-1d304246f5df tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d946ad62-fa20-4dbb-842d-1d304246f5df tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:13 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:13 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:45:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1e9920f2-1dc7-4f00-abf3-1b04fccdd0a0 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.622s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:13 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:13 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-1e9920f2-1dc7-4f00-abf3-1b04fccdd0a0 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:45:13 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-1e9920f2-1dc7-4f00-abf3-1b04fccdd0a0 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Deleted volume successfully. Nov 02 12:45:13 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-252e224d-686b-4ecb-b179-732f121ab813 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Acquiring lock "cinder-quobyte-6800b32d-15a3-4049-b8b4-c94eae57dc92" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:13 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-252e224d-686b-4ecb-b179-732f121ab813 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "cinder-quobyte-6800b32d-15a3-4049-b8b4-c94eae57dc92" acquired by "delete_volume" :: waited 0.026s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:13 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-1e9920f2-1dc7-4f00-abf3-1b04fccdd0a0 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "cinder-5df21596-21b3-4978-ac27-ffe0f89acadc-delete_volume" released by "delete_volume" :: held 2.797s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:13 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3324204-7ead-423f-bae1-14a1223fdb0b]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-252e224d-686b-4ecb-b179-732f121ab813 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6800b32d-15a3-4049-b8b4-c94eae57dc92 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:13 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d946ad62-fa20-4dbb-842d-1d304246f5df tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.408s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:13 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-d946ad62-fa20-4dbb-842d-1d304246f5df tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:45:13 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-d946ad62-fa20-4dbb-842d-1d304246f5df tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Deleted volume successfully. Nov 02 12:45:13 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6800b32d-15a3-4049-b8b4-c94eae57dc92 Nov 02 12:45:13 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:13 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d946ad62-fa20-4dbb-842d-1d304246f5df tempest-VolumeAndVolumeTypeFromImageTest-1997732200 None] Lock "cinder-c35e6f85-4fb5-40ff-af84-7e5276fb954d-delete_volume" released by "delete_volume" :: held 2.717s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:14 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-252e224d-686b-4ecb-b179-732f121ab813 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6800b32d-15a3-4049-b8b4-c94eae57dc92" returned: 0 in 0.877s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-252e224d-686b-4ecb-b179-732f121ab813 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6800b32d-15a3-4049-b8b4-c94eae57dc92 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:14 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6800b32d-15a3-4049-b8b4-c94eae57dc92 Nov 02 12:45:14 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:14 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-252e224d-686b-4ecb-b179-732f121ab813 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6800b32d-15a3-4049-b8b4-c94eae57dc92" returned: 0 in 0.684s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:14 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-252e224d-686b-4ecb-b179-732f121ab813 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "cinder-quobyte-6800b32d-15a3-4049-b8b4-c94eae57dc92" released by "delete_volume" :: held 1.675s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:15 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-252e224d-686b-4ecb-b179-732f121ab813 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Created reservations ['0d51d321-ef2f-4e06-a4bc-48cc42062f96', '4976c7f8-e826-4eea-8ba8-f30c07c78810', '2e9de37e-f7ae-4482-86fa-a3be9c6f32b5', 'ec484119-02d9-4a2c-a794-6fa901bc5fd9'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-252e224d-686b-4ecb-b179-732f121ab813 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-252e224d-686b-4ecb-b179-732f121ab813 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:15 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-252e224d-686b-4ecb-b179-732f121ab813 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:15 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-252e224d-686b-4ecb-b179-732f121ab813 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-252e224d-686b-4ecb-b179-732f121ab813 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-252e224d-686b-4ecb-b179-732f121ab813 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:15 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:45:15 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:15 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-bf38f5ad-af34-4483-a116-2362f37ab249 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Acquiring lock "cinder-1f7f3382-4543-4609-8cd2-48a285e66703-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:15 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-bf38f5ad-af34-4483-a116-2362f37ab249 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "cinder-1f7f3382-4543-4609-8cd2-48a285e66703-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:15 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-bf38f5ad-af34-4483-a116-2362f37ab249 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Acquiring lock "cinder-quobyte-1f7f3382-4543-4609-8cd2-48a285e66703" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:15 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-bf38f5ad-af34-4483-a116-2362f37ab249 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "cinder-quobyte-1f7f3382-4543-4609-8cd2-48a285e66703" acquired by "delete_volume" :: waited 0.021s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:15 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[9941566c-539b-4be9-8592-0a9469c19d5f]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bf38f5ad-af34-4483-a116-2362f37ab249 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1f7f3382-4543-4609-8cd2-48a285e66703 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:15 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-252e224d-686b-4ecb-b179-732f121ab813 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.716s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:15 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-252e224d-686b-4ecb-b179-732f121ab813 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:45:15 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-252e224d-686b-4ecb-b179-732f121ab813 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Deleted volume successfully. Nov 02 12:45:15 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-252e224d-686b-4ecb-b179-732f121ab813 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "cinder-6800b32d-15a3-4049-b8b4-c94eae57dc92-delete_volume" released by "delete_volume" :: held 2.979s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:16 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1f7f3382-4543-4609-8cd2-48a285e66703 Nov 02 12:45:16 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-81fdbad2-8094-4d01-a62e-795295e3ab41" returned: 0 in 9.347s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:16 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Image conversion details: src /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474, size 1024.00 MB, duration 9.35 sec, destination /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-81fdbad2-8094-4d01-a62e-795295e3ab41 {{(pid=86515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 12:45:16 devstack cinder-volume[86515]: INFO cinder.image.image_utils [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Converted 1024.00 MB image at 109.54 MB/s Nov 02 12:45:16 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-81fdbad2-8094-4d01-a62e-795295e3ab41 is being set with open permissions: ugo+rw Nov 02 12:45:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-81fdbad2-8094-4d01-a62e-795295e3ab41 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:16 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-81fdbad2-8094-4d01-a62e-795295e3ab41 Nov 02 12:45:16 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:16 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-81fdbad2-8094-4d01-a62e-795295e3ab41" returned: 0 in 0.290s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:16 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Lock "cinder-quobyte-81fdbad2-8094-4d01-a62e-795295e3ab41" released by "_copy_volume_from_snapshot" :: held 10.753s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:16 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bf38f5ad-af34-4483-a116-2362f37ab249 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1f7f3382-4543-4609-8cd2-48a285e66703" returned: 0 in 0.599s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bf38f5ad-af34-4483-a116-2362f37ab249 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1f7f3382-4543-4609-8cd2-48a285e66703 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:16 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1f7f3382-4543-4609-8cd2-48a285e66703 Nov 02 12:45:16 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:16 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Lock "cinder-quobyte-0842fc62-382e-4b7e-bab1-73a731b3695e-81fdbad2-8094-4d01-a62e-795295e3ab41" released by "_create_volume_from_snapshot" :: held 10.868s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.893s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:16 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6260b313-7c00-4f23-93c2-959c16bf11ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81fdbad2-8094-4d01-a62e-795295e3ab41', 'volume_size': 1, 'snapshot_id': '0842fc62-382e-4b7e-bab1-73a731b3695e'}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:16 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (598b7c11-49c7-4710-b08b-0f2a9a5a78a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:16 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Volume volume-81fdbad2-8094-4d01-a62e-795295e3ab41 (81fdbad2-8094-4d01-a62e-795295e3ab41): created successfully Nov 02 12:45:16 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (598b7c11-49c7-4710-b08b-0f2a9a5a78a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:16 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Flow 'volume_create_manager' (dbc63bf2-94ba-48aa-913f-ce752eaa93bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:16 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-59b224e5-3c9b-4f37-a342-254f100ec9a8 tempest-VolumeDependencyTests-798409840 None] Created volume successfully. Nov 02 12:45:16 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bf38f5ad-af34-4483-a116-2362f37ab249 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1f7f3382-4543-4609-8cd2-48a285e66703" returned: 0 in 0.367s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:16 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-bf38f5ad-af34-4483-a116-2362f37ab249 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "cinder-quobyte-1f7f3382-4543-4609-8cd2-48a285e66703" released by "delete_volume" :: held 1.046s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:16 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-bf38f5ad-af34-4483-a116-2362f37ab249 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Created reservations ['c628d6d5-17d7-4c94-9d10-9ca42be292eb', 'b97712f0-7807-432f-99fd-95e04c37ad2a', '43cec57c-2a3d-4940-98d3-669c4af9f340', '300baa85-9513-44ca-abf8-4def670ee645'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-bf38f5ad-af34-4483-a116-2362f37ab249 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-bf38f5ad-af34-4483-a116-2362f37ab249 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:16 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-bf38f5ad-af34-4483-a116-2362f37ab249 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:16 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-bf38f5ad-af34-4483-a116-2362f37ab249 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-bf38f5ad-af34-4483-a116-2362f37ab249 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bf38f5ad-af34-4483-a116-2362f37ab249 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:16 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:45:16 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:17 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bf38f5ad-af34-4483-a116-2362f37ab249 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.274s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:17 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-bf38f5ad-af34-4483-a116-2362f37ab249 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:45:17 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-bf38f5ad-af34-4483-a116-2362f37ab249 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Deleted volume successfully. Nov 02 12:45:17 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-bf38f5ad-af34-4483-a116-2362f37ab249 tempest-CreateVolumesFromSourceVolumeTest-347036412 None] Lock "cinder-1f7f3382-4543-4609-8cd2-48a285e66703-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:17 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-10c46afa-c71e-4b3d-bc64-38a79b8b4da6 tempest-VolumeDependencyTests-798409840 None] Acquiring lock "cinder-0842fc62-382e-4b7e-bab1-73a731b3695e-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:17 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-10c46afa-c71e-4b3d-bc64-38a79b8b4da6 tempest-VolumeDependencyTests-798409840 None] Lock "cinder-0842fc62-382e-4b7e-bab1-73a731b3695e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:17 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-10c46afa-c71e-4b3d-bc64-38a79b8b4da6 tempest-VolumeDependencyTests-798409840 None] Acquiring lock "cinder-quobyte-153f45fd-5276-407a-ae60-1c1e2057f474" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:17 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-10c46afa-c71e-4b3d-bc64-38a79b8b4da6 tempest-VolumeDependencyTests-798409840 None] Lock "cinder-quobyte-153f45fd-5276-407a-ae60-1c1e2057f474" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:17 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-10c46afa-c71e-4b3d-bc64-38a79b8b4da6 tempest-VolumeDependencyTests-798409840 None] Acquiring lock "cinder-quobyte-0842fc62-382e-4b7e-bab1-73a731b3695e" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:17 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-10c46afa-c71e-4b3d-bc64-38a79b8b4da6 tempest-VolumeDependencyTests-798409840 None] Lock "cinder-quobyte-0842fc62-382e-4b7e-bab1-73a731b3695e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-10c46afa-c71e-4b3d-bc64-38a79b8b4da6 tempest-VolumeDependencyTests-798409840 None] Deleting offline snapshot 0842fc62-382e-4b7e-bab1-73a731b3695e of volume 153f45fd-5276-407a-ae60-1c1e2057f474 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:45:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-10c46afa-c71e-4b3d-bc64-38a79b8b4da6 tempest-VolumeDependencyTests-798409840 None] snapshot_file for this snap is: volume-153f45fd-5276-407a-ae60-1c1e2057f474.0842fc62-382e-4b7e-bab1-73a731b3695e {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:45:17 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b36882-6e21-4390-bfc8-b99bbf444e28]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-10c46afa-c71e-4b3d-bc64-38a79b8b4da6 tempest-VolumeDependencyTests-798409840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474.0842fc62-382e-4b7e-bab1-73a731b3695e {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:17 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab50fd17-1675-48f1-aa0b-5ca37da72baa tempest-CinderUnicodeTest-1539770609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:45:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ab50fd17-1675-48f1-aa0b-5ca37da72baa tempest-CinderUnicodeTest-1539770609 None] Flow 'volume_create_manager' (702e6587-fc87-4394-aee7-79bf1eeeed7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ab50fd17-1675-48f1-aa0b-5ca37da72baa tempest-CinderUnicodeTest-1539770609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac3eebc1-f150-49f7-a563-32925a79feb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ab50fd17-1675-48f1-aa0b-5ca37da72baa tempest-CinderUnicodeTest-1539770609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac3eebc1-f150-49f7-a563-32925a79feb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28db15ee-4f2f-4682-9781-37971f19579c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdfd3cdfed9d4873b0563022de5d22b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:18Z,use_quota=True,user_id='ae2a1c8eb99d465c93a57bd360912226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:17 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474.0842fc62-382e-4b7e-bab1-73a731b3695e Nov 02 12:45:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ab50fd17-1675-48f1-aa0b-5ca37da72baa tempest-CinderUnicodeTest-1539770609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40762723-b642-4e89-985a-843c8239afeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:17 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ab50fd17-1675-48f1-aa0b-5ca37da72baa tempest-CinderUnicodeTest-1539770609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40762723-b642-4e89-985a-843c8239afeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ab50fd17-1675-48f1-aa0b-5ca37da72baa tempest-CinderUnicodeTest-1539770609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b05919da-c95f-4cd6-a58a-144220f4bf5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ab50fd17-1675-48f1-aa0b-5ca37da72baa tempest-CinderUnicodeTest-1539770609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b05919da-c95f-4cd6-a58a-144220f4bf5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28db15ee-4f2f-4682-9781-37971f19579c', 'volume_name': 'volume-28db15ee-4f2f-4682-9781-37971f19579c', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ab50fd17-1675-48f1-aa0b-5ca37da72baa tempest-CinderUnicodeTest-1539770609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9a6153e-9ce2-43e1-8299-00f52d55d9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ab50fd17-1675-48f1-aa0b-5ca37da72baa tempest-CinderUnicodeTest-1539770609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9a6153e-9ce2-43e1-8299-00f52d55d9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:17 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ab50fd17-1675-48f1-aa0b-5ca37da72baa tempest-CinderUnicodeTest-1539770609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d1a7f93-2c3d-4cbf-82c0-600e5bd8f965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:17 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-ab50fd17-1675-48f1-aa0b-5ca37da72baa tempest-CinderUnicodeTest-1539770609 None] Volume 28db15ee-4f2f-4682-9781-37971f19579c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28db15ee-4f2f-4682-9781-37971f19579c', 'volume_size': 1} Nov 02 12:45:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ab50fd17-1675-48f1-aa0b-5ca37da72baa tempest-CinderUnicodeTest-1539770609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ab50fd17-1675-48f1-aa0b-5ca37da72baa tempest-CinderUnicodeTest-1539770609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ab50fd17-1675-48f1-aa0b-5ca37da72baa tempest-CinderUnicodeTest-1539770609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28db15ee-4f2f-4682-9781-37971f19579c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdfd3cdfed9d4873b0563022de5d22b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:18Z,use_quota=True,user_id='ae2a1c8eb99d465c93a57bd360912226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:45:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-ab50fd17-1675-48f1-aa0b-5ca37da72baa tempest-CinderUnicodeTest-1539770609 None] Creating volume 28db15ee-4f2f-4682-9781-37971f19579c {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:45:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ab50fd17-1675-48f1-aa0b-5ca37da72baa tempest-CinderUnicodeTest-1539770609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ab50fd17-1675-48f1-aa0b-5ca37da72baa tempest-CinderUnicodeTest-1539770609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ab50fd17-1675-48f1-aa0b-5ca37da72baa tempest-CinderUnicodeTest-1539770609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ab50fd17-1675-48f1-aa0b-5ca37da72baa tempest-CinderUnicodeTest-1539770609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ab50fd17-1675-48f1-aa0b-5ca37da72baa tempest-CinderUnicodeTest-1539770609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ab50fd17-1675-48f1-aa0b-5ca37da72baa tempest-CinderUnicodeTest-1539770609 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:45:17 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-ab50fd17-1675-48f1-aa0b-5ca37da72baa tempest-CinderUnicodeTest-1539770609 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:45:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ab50fd17-1675-48f1-aa0b-5ca37da72baa tempest-CinderUnicodeTest-1539770609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-28db15ee-4f2f-4682-9781-37971f19579c 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:17 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-28db15ee-4f2f-4682-9781-37971f19579c 1073741824 Nov 02 12:45:17 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:18 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-10c46afa-c71e-4b3d-bc64-38a79b8b4da6 tempest-VolumeDependencyTests-798409840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474.0842fc62-382e-4b7e-bab1-73a731b3695e" returned: 0 in 0.448s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:18 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-10c46afa-c71e-4b3d-bc64-38a79b8b4da6 tempest-VolumeDependencyTests-798409840 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-153f45fd-5276-407a-ae60-1c1e2057f474(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:45:18 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a16e32f-5b5a-4d7a-bdf4-248a448ddafb]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-10c46afa-c71e-4b3d-bc64-38a79b8b4da6 tempest-VolumeDependencyTests-798409840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:18 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474 Nov 02 12:45:18 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:18 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ab50fd17-1675-48f1-aa0b-5ca37da72baa tempest-CinderUnicodeTest-1539770609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-28db15ee-4f2f-4682-9781-37971f19579c 1073741824" returned: 0 in 0.572s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ab50fd17-1675-48f1-aa0b-5ca37da72baa tempest-CinderUnicodeTest-1539770609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-28db15ee-4f2f-4682-9781-37971f19579c {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:18 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-28db15ee-4f2f-4682-9781-37971f19579c Nov 02 12:45:18 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:18 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-10c46afa-c71e-4b3d-bc64-38a79b8b4da6 tempest-VolumeDependencyTests-798409840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474" returned: 0 in 0.642s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:18 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-10c46afa-c71e-4b3d-bc64-38a79b8b4da6 tempest-VolumeDependencyTests-798409840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474.0842fc62-382e-4b7e-bab1-73a731b3695e {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ab50fd17-1675-48f1-aa0b-5ca37da72baa tempest-CinderUnicodeTest-1539770609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-28db15ee-4f2f-4682-9781-37971f19579c" returned: 0 in 0.358s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:18 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ab50fd17-1675-48f1-aa0b-5ca37da72baa tempest-CinderUnicodeTest-1539770609 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:45:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ab50fd17-1675-48f1-aa0b-5ca37da72baa tempest-CinderUnicodeTest-1539770609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:18 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474.0842fc62-382e-4b7e-bab1-73a731b3695e Nov 02 12:45:18 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ab50fd17-1675-48f1-aa0b-5ca37da72baa tempest-CinderUnicodeTest-1539770609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d1a7f93-2c3d-4cbf-82c0-600e5bd8f965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28db15ee-4f2f-4682-9781-37971f19579c', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ab50fd17-1675-48f1-aa0b-5ca37da72baa tempest-CinderUnicodeTest-1539770609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d708900-8247-4530-a8fc-b1f2538f79d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:18 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-ab50fd17-1675-48f1-aa0b-5ca37da72baa tempest-CinderUnicodeTest-1539770609 None] Volume volume-28db15ee-4f2f-4682-9781-37971f19579c (28db15ee-4f2f-4682-9781-37971f19579c): created successfully Nov 02 12:45:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ab50fd17-1675-48f1-aa0b-5ca37da72baa tempest-CinderUnicodeTest-1539770609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d708900-8247-4530-a8fc-b1f2538f79d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:18 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ab50fd17-1675-48f1-aa0b-5ca37da72baa tempest-CinderUnicodeTest-1539770609 None] Flow 'volume_create_manager' (702e6587-fc87-4394-aee7-79bf1eeeed7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:18 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-ab50fd17-1675-48f1-aa0b-5ca37da72baa tempest-CinderUnicodeTest-1539770609 None] Created volume successfully. Nov 02 12:45:19 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-10c46afa-c71e-4b3d-bc64-38a79b8b4da6 tempest-VolumeDependencyTests-798409840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474.0842fc62-382e-4b7e-bab1-73a731b3695e" returned: 0 in 0.429s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-10c46afa-c71e-4b3d-bc64-38a79b8b4da6 tempest-VolumeDependencyTests-798409840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474.0842fc62-382e-4b7e-bab1-73a731b3695e {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:19 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474.0842fc62-382e-4b7e-bab1-73a731b3695e Nov 02 12:45:19 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:19 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-10c46afa-c71e-4b3d-bc64-38a79b8b4da6 tempest-VolumeDependencyTests-798409840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474.0842fc62-382e-4b7e-bab1-73a731b3695e" returned: 0 in 0.281s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:19 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-10c46afa-c71e-4b3d-bc64-38a79b8b4da6 tempest-VolumeDependencyTests-798409840 None] Lock "cinder-quobyte-0842fc62-382e-4b7e-bab1-73a731b3695e" released by "_delete_snapshot" :: held 1.959s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:19 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-10c46afa-c71e-4b3d-bc64-38a79b8b4da6 tempest-VolumeDependencyTests-798409840 None] Lock "cinder-quobyte-153f45fd-5276-407a-ae60-1c1e2057f474" released by "delete_snapshot" :: held 1.985s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:19 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-10c46afa-c71e-4b3d-bc64-38a79b8b4da6 tempest-VolumeDependencyTests-798409840 None] Created reservations ['cf25e824-2e06-4fcb-a347-32c4e61810fb', 'b4db0348-cf25-45e0-b858-2f4938c1481c', '16e79793-79bc-4d6e-83e9-a391e44847cd', '7df0525f-5d64-4b3e-9745-0e3a3bd7634f'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:19 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-10c46afa-c71e-4b3d-bc64-38a79b8b4da6 tempest-VolumeDependencyTests-798409840 None] Delete snapshot completed successfully. Nov 02 12:45:19 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-10c46afa-c71e-4b3d-bc64-38a79b8b4da6 tempest-VolumeDependencyTests-798409840 None] Lock "cinder-0842fc62-382e-4b7e-bab1-73a731b3695e-delete_snapshot" released by "delete_snapshot" :: held 2.254s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:20 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea45f61b-0f82-4710-94cc-7cd67890661b tempest-CreateVolumesFromImageTest-2141915423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:45:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ea45f61b-0f82-4710-94cc-7cd67890661b tempest-CreateVolumesFromImageTest-2141915423 None] Flow 'volume_create_manager' (fa00c2d7-cfea-428f-84e3-56c243aee075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ea45f61b-0f82-4710-94cc-7cd67890661b tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (168395e3-f2ec-464d-9d9b-5b26e3832ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ea45f61b-0f82-4710-94cc-7cd67890661b tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (168395e3-f2ec-464d-9d9b-5b26e3832ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-284447177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=590077bc-279c-44f1-aab3-cf3631380227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35f1019f5cc3434cbda9466ec3c14dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:20Z,use_quota=True,user_id='1a65336325824c04b88ab6e8dd0057e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ea45f61b-0f82-4710-94cc-7cd67890661b tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb3b2b4e-b535-4d5b-81fb-64d423ecd1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ea45f61b-0f82-4710-94cc-7cd67890661b tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb3b2b4e-b535-4d5b-81fb-64d423ecd1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ea45f61b-0f82-4710-94cc-7cd67890661b tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5801e4a6-134d-4557-b160-31adafd95f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ea45f61b-0f82-4710-94cc-7cd67890661b tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5801e4a6-134d-4557-b160-31adafd95f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '590077bc-279c-44f1-aab3-cf3631380227', 'volume_name': 'volume-590077bc-279c-44f1-aab3-cf3631380227', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ea45f61b-0f82-4710-94cc-7cd67890661b tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a87abedf-b63c-4a45-81f6-62a8a11cc715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ea45f61b-0f82-4710-94cc-7cd67890661b tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a87abedf-b63c-4a45-81f6-62a8a11cc715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ea45f61b-0f82-4710-94cc-7cd67890661b tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1b17cf-4035-4d72-a920-3ed02c783f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:20 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-ea45f61b-0f82-4710-94cc-7cd67890661b tempest-CreateVolumesFromImageTest-2141915423 None] Volume 590077bc-279c-44f1-aab3-cf3631380227: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-590077bc-279c-44f1-aab3-cf3631380227', 'volume_size': 1} Nov 02 12:45:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ea45f61b-0f82-4710-94cc-7cd67890661b tempest-CreateVolumesFromImageTest-2141915423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ea45f61b-0f82-4710-94cc-7cd67890661b tempest-CreateVolumesFromImageTest-2141915423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ea45f61b-0f82-4710-94cc-7cd67890661b tempest-CreateVolumesFromImageTest-2141915423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-284447177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=590077bc-279c-44f1-aab3-cf3631380227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35f1019f5cc3434cbda9466ec3c14dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:20Z,use_quota=True,user_id='1a65336325824c04b88ab6e8dd0057e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:45:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-ea45f61b-0f82-4710-94cc-7cd67890661b tempest-CreateVolumesFromImageTest-2141915423 None] Creating volume 590077bc-279c-44f1-aab3-cf3631380227 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:45:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ea45f61b-0f82-4710-94cc-7cd67890661b tempest-CreateVolumesFromImageTest-2141915423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ea45f61b-0f82-4710-94cc-7cd67890661b tempest-CreateVolumesFromImageTest-2141915423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ea45f61b-0f82-4710-94cc-7cd67890661b tempest-CreateVolumesFromImageTest-2141915423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ea45f61b-0f82-4710-94cc-7cd67890661b tempest-CreateVolumesFromImageTest-2141915423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ea45f61b-0f82-4710-94cc-7cd67890661b tempest-CreateVolumesFromImageTest-2141915423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ea45f61b-0f82-4710-94cc-7cd67890661b tempest-CreateVolumesFromImageTest-2141915423 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:45:20 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-ea45f61b-0f82-4710-94cc-7cd67890661b tempest-CreateVolumesFromImageTest-2141915423 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:45:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ea45f61b-0f82-4710-94cc-7cd67890661b tempest-CreateVolumesFromImageTest-2141915423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-590077bc-279c-44f1-aab3-cf3631380227 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:20 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-590077bc-279c-44f1-aab3-cf3631380227 1073741824 Nov 02 12:45:20 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:20 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-15a98de2-f26d-4593-888d-dd0232b2c027 tempest-CinderUnicodeTest-1539770609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:45:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-15a98de2-f26d-4593-888d-dd0232b2c027 tempest-CinderUnicodeTest-1539770609 None] Flow 'volume_create_manager' (4b1c997f-70ba-4ab0-a5ce-19a95a11aab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-15a98de2-f26d-4593-888d-dd0232b2c027 tempest-CinderUnicodeTest-1539770609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (325c8e71-2675-45d8-bb4c-060099ef08e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-15a98de2-f26d-4593-888d-dd0232b2c027 tempest-CinderUnicodeTest-1539770609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (325c8e71-2675-45d8-bb4c-060099ef08e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1353356106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d3061ca-f132-4dec-a1f1-83dfbc409385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdfd3cdfed9d4873b0563022de5d22b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:21Z,use_quota=True,user_id='ae2a1c8eb99d465c93a57bd360912226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-15a98de2-f26d-4593-888d-dd0232b2c027 tempest-CinderUnicodeTest-1539770609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb39a0e0-1876-4aac-8c39-930ed90437c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-15a98de2-f26d-4593-888d-dd0232b2c027 tempest-CinderUnicodeTest-1539770609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb39a0e0-1876-4aac-8c39-930ed90437c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-15a98de2-f26d-4593-888d-dd0232b2c027 tempest-CinderUnicodeTest-1539770609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbb81500-aebb-4625-98e7-f5e66b1cd459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-15a98de2-f26d-4593-888d-dd0232b2c027 tempest-CinderUnicodeTest-1539770609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbb81500-aebb-4625-98e7-f5e66b1cd459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d3061ca-f132-4dec-a1f1-83dfbc409385', 'volume_name': 'volume-8d3061ca-f132-4dec-a1f1-83dfbc409385', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-15a98de2-f26d-4593-888d-dd0232b2c027 tempest-CinderUnicodeTest-1539770609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fc09a42-a048-4565-9329-d24712b91f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-15a98de2-f26d-4593-888d-dd0232b2c027 tempest-CinderUnicodeTest-1539770609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fc09a42-a048-4565-9329-d24712b91f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-15a98de2-f26d-4593-888d-dd0232b2c027 tempest-CinderUnicodeTest-1539770609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b745ebf-2f78-41c5-aaea-8f98624df74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:20 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-15a98de2-f26d-4593-888d-dd0232b2c027 tempest-CinderUnicodeTest-1539770609 None] Volume 8d3061ca-f132-4dec-a1f1-83dfbc409385: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d3061ca-f132-4dec-a1f1-83dfbc409385', 'volume_size': 1} Nov 02 12:45:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-15a98de2-f26d-4593-888d-dd0232b2c027 tempest-CinderUnicodeTest-1539770609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:20 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-6a63388b-32e3-4315-8f9e-6224b0ce65b6 tempest-VolumeDependencyTests-798409840 None] Acquiring lock "cinder-153f45fd-5276-407a-ae60-1c1e2057f474-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-6a63388b-32e3-4315-8f9e-6224b0ce65b6 tempest-VolumeDependencyTests-798409840 None] Lock "cinder-153f45fd-5276-407a-ae60-1c1e2057f474-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1457562-d5f7-4d55-85d7-b72284ed2581 tempest-CreateVolumesFromImageTest-2141915423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f1457562-d5f7-4d55-85d7-b72284ed2581 tempest-CreateVolumesFromImageTest-2141915423 None] Flow 'volume_create_manager' (48f3e9e7-0293-4cbc-aa2b-402294688c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f1457562-d5f7-4d55-85d7-b72284ed2581 tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf9ce65-2066-424d-86b7-8d6ea5786453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f1457562-d5f7-4d55-85d7-b72284ed2581 tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acf9ce65-2066-424d-86b7-8d6ea5786453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-189683012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2df8944-6455-48a5-b08a-3907fbc2648f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35f1019f5cc3434cbda9466ec3c14dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:21Z,use_quota=True,user_id='1a65336325824c04b88ab6e8dd0057e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f1457562-d5f7-4d55-85d7-b72284ed2581 tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c10497df-1ec3-40fe-9750-9250795eb0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f1457562-d5f7-4d55-85d7-b72284ed2581 tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c10497df-1ec3-40fe-9750-9250795eb0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f1457562-d5f7-4d55-85d7-b72284ed2581 tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47fb4eb1-1a24-454b-81c4-70aff7237067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f1457562-d5f7-4d55-85d7-b72284ed2581 tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47fb4eb1-1a24-454b-81c4-70aff7237067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2df8944-6455-48a5-b08a-3907fbc2648f', 'volume_name': 'volume-a2df8944-6455-48a5-b08a-3907fbc2648f', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f1457562-d5f7-4d55-85d7-b72284ed2581 tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16cc529a-4ca1-422b-993f-6caca32442d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f1457562-d5f7-4d55-85d7-b72284ed2581 tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16cc529a-4ca1-422b-993f-6caca32442d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f1457562-d5f7-4d55-85d7-b72284ed2581 tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db3cc6dc-5129-45f7-aa6d-13fd38946ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:21 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-f1457562-d5f7-4d55-85d7-b72284ed2581 tempest-CreateVolumesFromImageTest-2141915423 None] Volume a2df8944-6455-48a5-b08a-3907fbc2648f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2df8944-6455-48a5-b08a-3907fbc2648f', 'volume_size': 1} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f1457562-d5f7-4d55-85d7-b72284ed2581 tempest-CreateVolumesFromImageTest-2141915423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-6a63388b-32e3-4315-8f9e-6224b0ce65b6 tempest-VolumeDependencyTests-798409840 None] Acquiring lock "cinder-quobyte-153f45fd-5276-407a-ae60-1c1e2057f474" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-6a63388b-32e3-4315-8f9e-6224b0ce65b6 tempest-VolumeDependencyTests-798409840 None] Lock "cinder-quobyte-153f45fd-5276-407a-ae60-1c1e2057f474" acquired by "delete_volume" :: waited 0.024s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[096ac296-c2af-457f-8cc2-c6f60d619480]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6a63388b-32e3-4315-8f9e-6224b0ce65b6 tempest-VolumeDependencyTests-798409840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:21 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474 Nov 02 12:45:21 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-09bb9a7d-8849-4c98-b94a-672560c7513d tempest-CreateVolumesFromImageTest-2141915423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-09bb9a7d-8849-4c98-b94a-672560c7513d tempest-CreateVolumesFromImageTest-2141915423 None] Flow 'volume_create_manager' (f5c7ddd1-f4bf-4b50-bc7c-55b070254c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-09bb9a7d-8849-4c98-b94a-672560c7513d tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47bf007e-ae98-46cf-8d41-470b70fc5991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-09bb9a7d-8849-4c98-b94a-672560c7513d tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47bf007e-ae98-46cf-8d41-470b70fc5991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1684029839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9028bd11-a4f8-4ead-bcd2-9b36bca9903e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35f1019f5cc3434cbda9466ec3c14dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:21Z,use_quota=True,user_id='1a65336325824c04b88ab6e8dd0057e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-09bb9a7d-8849-4c98-b94a-672560c7513d tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e7419b1-defd-49c2-9b56-75e47f7cb774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-09bb9a7d-8849-4c98-b94a-672560c7513d tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e7419b1-defd-49c2-9b56-75e47f7cb774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:21 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-09bb9a7d-8849-4c98-b94a-672560c7513d tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ecbcb82-385b-4c12-b1bd-c919230f3f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-09bb9a7d-8849-4c98-b94a-672560c7513d tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ecbcb82-385b-4c12-b1bd-c919230f3f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9028bd11-a4f8-4ead-bcd2-9b36bca9903e', 'volume_name': 'volume-9028bd11-a4f8-4ead-bcd2-9b36bca9903e', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-09bb9a7d-8849-4c98-b94a-672560c7513d tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19d7ac97-a05c-49a5-8059-9c1ae65e83f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-09bb9a7d-8849-4c98-b94a-672560c7513d tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19d7ac97-a05c-49a5-8059-9c1ae65e83f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-09bb9a7d-8849-4c98-b94a-672560c7513d tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a356bfa-0c20-47a8-b55b-040ae2262001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:21 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-09bb9a7d-8849-4c98-b94a-672560c7513d tempest-CreateVolumesFromImageTest-2141915423 None] Volume 9028bd11-a4f8-4ead-bcd2-9b36bca9903e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9028bd11-a4f8-4ead-bcd2-9b36bca9903e', 'volume_size': 1} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-09bb9a7d-8849-4c98-b94a-672560c7513d tempest-CreateVolumesFromImageTest-2141915423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ea45f61b-0f82-4710-94cc-7cd67890661b tempest-CreateVolumesFromImageTest-2141915423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-590077bc-279c-44f1-aab3-cf3631380227 1073741824" returned: 0 in 0.790s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ea45f61b-0f82-4710-94cc-7cd67890661b tempest-CreateVolumesFromImageTest-2141915423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-590077bc-279c-44f1-aab3-cf3631380227 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:21 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-590077bc-279c-44f1-aab3-cf3631380227 Nov 02 12:45:21 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:21 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6a63388b-32e3-4315-8f9e-6224b0ce65b6 tempest-VolumeDependencyTests-798409840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474" returned: 0 in 0.520s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6a63388b-32e3-4315-8f9e-6224b0ce65b6 tempest-VolumeDependencyTests-798409840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:21 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474 Nov 02 12:45:21 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:21 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ea45f61b-0f82-4710-94cc-7cd67890661b tempest-CreateVolumesFromImageTest-2141915423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-590077bc-279c-44f1-aab3-cf3631380227" returned: 0 in 0.362s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ea45f61b-0f82-4710-94cc-7cd67890661b tempest-CreateVolumesFromImageTest-2141915423 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ea45f61b-0f82-4710-94cc-7cd67890661b tempest-CreateVolumesFromImageTest-2141915423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-15a98de2-f26d-4593-888d-dd0232b2c027 tempest-CinderUnicodeTest-1539770609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.988s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-15a98de2-f26d-4593-888d-dd0232b2c027 tempest-CinderUnicodeTest-1539770609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1353356106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d3061ca-f132-4dec-a1f1-83dfbc409385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdfd3cdfed9d4873b0563022de5d22b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:21Z,use_quota=True,user_id='ae2a1c8eb99d465c93a57bd360912226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-15a98de2-f26d-4593-888d-dd0232b2c027 tempest-CinderUnicodeTest-1539770609 None] Creating volume 8d3061ca-f132-4dec-a1f1-83dfbc409385 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-15a98de2-f26d-4593-888d-dd0232b2c027 tempest-CinderUnicodeTest-1539770609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-15a98de2-f26d-4593-888d-dd0232b2c027 tempest-CinderUnicodeTest-1539770609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-15a98de2-f26d-4593-888d-dd0232b2c027 tempest-CinderUnicodeTest-1539770609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-15a98de2-f26d-4593-888d-dd0232b2c027 tempest-CinderUnicodeTest-1539770609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-15a98de2-f26d-4593-888d-dd0232b2c027 tempest-CinderUnicodeTest-1539770609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-15a98de2-f26d-4593-888d-dd0232b2c027 tempest-CinderUnicodeTest-1539770609 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:45:21 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-15a98de2-f26d-4593-888d-dd0232b2c027 tempest-CinderUnicodeTest-1539770609 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:45:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-15a98de2-f26d-4593-888d-dd0232b2c027 tempest-CinderUnicodeTest-1539770609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-29c3ca87-de48-497d-af3c-c7357ea7308f tempest-CreateVolumesFromImageTest-2141915423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-29c3ca87-de48-497d-af3c-c7357ea7308f tempest-CreateVolumesFromImageTest-2141915423 None] Flow 'volume_create_manager' (ce167c71-b831-4b4f-b05a-c123b9c60a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-29c3ca87-de48-497d-af3c-c7357ea7308f tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5eb4750-9420-4fe7-9faa-9a3a6f6b6dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:22 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385 1073741824 Nov 02 12:45:22 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ea45f61b-0f82-4710-94cc-7cd67890661b tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1b17cf-4035-4d72-a920-3ed02c783f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-590077bc-279c-44f1-aab3-cf3631380227', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ea45f61b-0f82-4710-94cc-7cd67890661b tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8ae2fa0-7f98-4354-8fcc-7e224464c788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-29c3ca87-de48-497d-af3c-c7357ea7308f tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5eb4750-9420-4fe7-9faa-9a3a6f6b6dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-448837350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c59b4439-d7ff-4b46-997d-2913a9694c8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35f1019f5cc3434cbda9466ec3c14dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:22Z,use_quota=True,user_id='1a65336325824c04b88ab6e8dd0057e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-29c3ca87-de48-497d-af3c-c7357ea7308f tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a32c2360-a139-4f5b-aae5-7d67a9dd346c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-29c3ca87-de48-497d-af3c-c7357ea7308f tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a32c2360-a139-4f5b-aae5-7d67a9dd346c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-29c3ca87-de48-497d-af3c-c7357ea7308f tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ede40dc0-01c4-403e-b0e6-3114f918134a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-29c3ca87-de48-497d-af3c-c7357ea7308f tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ede40dc0-01c4-403e-b0e6-3114f918134a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c59b4439-d7ff-4b46-997d-2913a9694c8f', 'volume_name': 'volume-c59b4439-d7ff-4b46-997d-2913a9694c8f', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-29c3ca87-de48-497d-af3c-c7357ea7308f tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b99a4dfb-b773-401f-b83a-c3ae132f9f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-29c3ca87-de48-497d-af3c-c7357ea7308f tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b99a4dfb-b773-401f-b83a-c3ae132f9f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-29c3ca87-de48-497d-af3c-c7357ea7308f tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (156428ef-5140-4d72-8248-8855473a9418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:22 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-29c3ca87-de48-497d-af3c-c7357ea7308f tempest-CreateVolumesFromImageTest-2141915423 None] Volume c59b4439-d7ff-4b46-997d-2913a9694c8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c59b4439-d7ff-4b46-997d-2913a9694c8f', 'volume_size': 1} Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-29c3ca87-de48-497d-af3c-c7357ea7308f tempest-CreateVolumesFromImageTest-2141915423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:22 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-ea45f61b-0f82-4710-94cc-7cd67890661b tempest-CreateVolumesFromImageTest-2141915423 None] Volume volume-590077bc-279c-44f1-aab3-cf3631380227 (590077bc-279c-44f1-aab3-cf3631380227): created successfully Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ea45f61b-0f82-4710-94cc-7cd67890661b tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8ae2fa0-7f98-4354-8fcc-7e224464c788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ea45f61b-0f82-4710-94cc-7cd67890661b tempest-CreateVolumesFromImageTest-2141915423 None] Flow 'volume_create_manager' (fa00c2d7-cfea-428f-84e3-56c243aee075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:22 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:22 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-ea45f61b-0f82-4710-94cc-7cd67890661b tempest-CreateVolumesFromImageTest-2141915423 None] Created volume successfully. Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6a63388b-32e3-4315-8f9e-6224b0ce65b6 tempest-VolumeDependencyTests-798409840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-153f45fd-5276-407a-ae60-1c1e2057f474" returned: 0 in 0.435s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-6a63388b-32e3-4315-8f9e-6224b0ce65b6 tempest-VolumeDependencyTests-798409840 None] Lock "cinder-quobyte-153f45fd-5276-407a-ae60-1c1e2057f474" released by "delete_volume" :: held 1.052s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-6a63388b-32e3-4315-8f9e-6224b0ce65b6 tempest-VolumeDependencyTests-798409840 None] Created reservations ['5d739e95-b544-44df-a325-a4360f5d2b55', '13f23bb3-b7cc-442a-9934-64f222d6c130', '7e122b1b-4240-47d0-93b2-4d509275bfa8', '6f9bf0d6-0c89-4e96-ab7e-e45a2e293aaf'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-6a63388b-32e3-4315-8f9e-6224b0ce65b6 tempest-VolumeDependencyTests-798409840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-6a63388b-32e3-4315-8f9e-6224b0ce65b6 tempest-VolumeDependencyTests-798409840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-6a63388b-32e3-4315-8f9e-6224b0ce65b6 tempest-VolumeDependencyTests-798409840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-6a63388b-32e3-4315-8f9e-6224b0ce65b6 tempest-VolumeDependencyTests-798409840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-6a63388b-32e3-4315-8f9e-6224b0ce65b6 tempest-VolumeDependencyTests-798409840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6a63388b-32e3-4315-8f9e-6224b0ce65b6 tempest-VolumeDependencyTests-798409840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:22 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:45:22 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-226041f0-22b8-47bc-9767-26888a96e6f3 tempest-CreateVolumesFromImageTest-2141915423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-226041f0-22b8-47bc-9767-26888a96e6f3 tempest-CreateVolumesFromImageTest-2141915423 None] Flow 'volume_create_manager' (11c34995-710b-4411-99a5-1ffa842509df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-226041f0-22b8-47bc-9767-26888a96e6f3 tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6ef356-8088-449a-8119-e9b050058071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-226041f0-22b8-47bc-9767-26888a96e6f3 tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6ef356-8088-449a-8119-e9b050058071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2134870164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6759f6af-16f3-46de-82f1-8203e3fef157,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35f1019f5cc3434cbda9466ec3c14dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:23Z,use_quota=True,user_id='1a65336325824c04b88ab6e8dd0057e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-226041f0-22b8-47bc-9767-26888a96e6f3 tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7864f0c3-b416-49ff-a6f1-8167b15ee244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-226041f0-22b8-47bc-9767-26888a96e6f3 tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7864f0c3-b416-49ff-a6f1-8167b15ee244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-226041f0-22b8-47bc-9767-26888a96e6f3 tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a65838e-e12a-4d12-a242-2435e299653a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-226041f0-22b8-47bc-9767-26888a96e6f3 tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a65838e-e12a-4d12-a242-2435e299653a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6759f6af-16f3-46de-82f1-8203e3fef157', 'volume_name': 'volume-6759f6af-16f3-46de-82f1-8203e3fef157', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-226041f0-22b8-47bc-9767-26888a96e6f3 tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f7f411-d7ab-48a1-b43f-0a57276bf2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-226041f0-22b8-47bc-9767-26888a96e6f3 tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f7f411-d7ab-48a1-b43f-0a57276bf2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-226041f0-22b8-47bc-9767-26888a96e6f3 tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecffd390-82b3-4e4e-b3de-38246fce6549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:22 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-226041f0-22b8-47bc-9767-26888a96e6f3 tempest-CreateVolumesFromImageTest-2141915423 None] Volume 6759f6af-16f3-46de-82f1-8203e3fef157: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6759f6af-16f3-46de-82f1-8203e3fef157', 'volume_size': 1} Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-226041f0-22b8-47bc-9767-26888a96e6f3 tempest-CreateVolumesFromImageTest-2141915423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:22 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-15a98de2-f26d-4593-888d-dd0232b2c027 tempest-CinderUnicodeTest-1539770609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385 1073741824" returned: 0 in 0.840s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:22 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6a63388b-32e3-4315-8f9e-6224b0ce65b6 tempest-VolumeDependencyTests-798409840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.358s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-6a63388b-32e3-4315-8f9e-6224b0ce65b6 tempest-VolumeDependencyTests-798409840 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:45:22 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-6a63388b-32e3-4315-8f9e-6224b0ce65b6 tempest-VolumeDependencyTests-798409840 None] Deleted volume successfully. Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-15a98de2-f26d-4593-888d-dd0232b2c027 tempest-CinderUnicodeTest-1539770609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:22 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-6a63388b-32e3-4315-8f9e-6224b0ce65b6 tempest-VolumeDependencyTests-798409840 None] Lock "cinder-153f45fd-5276-407a-ae60-1c1e2057f474-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:22 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385 Nov 02 12:45:22 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:23 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-15a98de2-f26d-4593-888d-dd0232b2c027 tempest-CinderUnicodeTest-1539770609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385" returned: 0 in 0.265s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:23 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-15a98de2-f26d-4593-888d-dd0232b2c027 tempest-CinderUnicodeTest-1539770609 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:45:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-15a98de2-f26d-4593-888d-dd0232b2c027 tempest-CinderUnicodeTest-1539770609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f1457562-d5f7-4d55-85d7-b72284ed2581 tempest-CreateVolumesFromImageTest-2141915423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.986s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:23 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f1457562-d5f7-4d55-85d7-b72284ed2581 tempest-CreateVolumesFromImageTest-2141915423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-189683012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2df8944-6455-48a5-b08a-3907fbc2648f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35f1019f5cc3434cbda9466ec3c14dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:21Z,use_quota=True,user_id='1a65336325824c04b88ab6e8dd0057e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:45:23 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-f1457562-d5f7-4d55-85d7-b72284ed2581 tempest-CreateVolumesFromImageTest-2141915423 None] Creating volume a2df8944-6455-48a5-b08a-3907fbc2648f {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:45:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f1457562-d5f7-4d55-85d7-b72284ed2581 tempest-CreateVolumesFromImageTest-2141915423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f1457562-d5f7-4d55-85d7-b72284ed2581 tempest-CreateVolumesFromImageTest-2141915423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:23 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f1457562-d5f7-4d55-85d7-b72284ed2581 tempest-CreateVolumesFromImageTest-2141915423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:23 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f1457562-d5f7-4d55-85d7-b72284ed2581 tempest-CreateVolumesFromImageTest-2141915423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f1457562-d5f7-4d55-85d7-b72284ed2581 tempest-CreateVolumesFromImageTest-2141915423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:23 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f1457562-d5f7-4d55-85d7-b72284ed2581 tempest-CreateVolumesFromImageTest-2141915423 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:45:23 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-f1457562-d5f7-4d55-85d7-b72284ed2581 tempest-CreateVolumesFromImageTest-2141915423 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:45:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f1457562-d5f7-4d55-85d7-b72284ed2581 tempest-CreateVolumesFromImageTest-2141915423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a2df8944-6455-48a5-b08a-3907fbc2648f 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:23 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a2df8944-6455-48a5-b08a-3907fbc2648f 1073741824 Nov 02 12:45:23 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:23 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-15a98de2-f26d-4593-888d-dd0232b2c027 tempest-CinderUnicodeTest-1539770609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b745ebf-2f78-41c5-aaea-8f98624df74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d3061ca-f132-4dec-a1f1-83dfbc409385', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:23 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-15a98de2-f26d-4593-888d-dd0232b2c027 tempest-CinderUnicodeTest-1539770609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca19194-539e-481e-aaa2-63b0aa48a88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:23 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-15a98de2-f26d-4593-888d-dd0232b2c027 tempest-CinderUnicodeTest-1539770609 None] Volume volume-8d3061ca-f132-4dec-a1f1-83dfbc409385 (8d3061ca-f132-4dec-a1f1-83dfbc409385): created successfully Nov 02 12:45:23 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-15a98de2-f26d-4593-888d-dd0232b2c027 tempest-CinderUnicodeTest-1539770609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca19194-539e-481e-aaa2-63b0aa48a88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:23 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-15a98de2-f26d-4593-888d-dd0232b2c027 tempest-CinderUnicodeTest-1539770609 None] Flow 'volume_create_manager' (4b1c997f-70ba-4ab0-a5ce-19a95a11aab9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:23 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-60b2c2b9-7b0e-495f-963e-657aef99e8dc tempest-VolumeDependencyTests-798409840 None] Acquiring lock "cinder-81fdbad2-8094-4d01-a62e-795295e3ab41-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:23 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-15a98de2-f26d-4593-888d-dd0232b2c027 tempest-CinderUnicodeTest-1539770609 None] Created volume successfully. Nov 02 12:45:23 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-60b2c2b9-7b0e-495f-963e-657aef99e8dc tempest-VolumeDependencyTests-798409840 None] Lock "cinder-81fdbad2-8094-4d01-a62e-795295e3ab41-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:23 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-60b2c2b9-7b0e-495f-963e-657aef99e8dc tempest-VolumeDependencyTests-798409840 None] Acquiring lock "cinder-quobyte-81fdbad2-8094-4d01-a62e-795295e3ab41" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:23 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-60b2c2b9-7b0e-495f-963e-657aef99e8dc tempest-VolumeDependencyTests-798409840 None] Lock "cinder-quobyte-81fdbad2-8094-4d01-a62e-795295e3ab41" acquired by "delete_volume" :: waited 0.027s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:23 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdc5761-980d-44fe-8c87-04b6a7d8d857]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-60b2c2b9-7b0e-495f-963e-657aef99e8dc tempest-VolumeDependencyTests-798409840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-81fdbad2-8094-4d01-a62e-795295e3ab41 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:23 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-81fdbad2-8094-4d01-a62e-795295e3ab41 Nov 02 12:45:23 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:23 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f1457562-d5f7-4d55-85d7-b72284ed2581 tempest-CreateVolumesFromImageTest-2141915423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a2df8944-6455-48a5-b08a-3907fbc2648f 1073741824" returned: 0 in 0.638s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f1457562-d5f7-4d55-85d7-b72284ed2581 tempest-CreateVolumesFromImageTest-2141915423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a2df8944-6455-48a5-b08a-3907fbc2648f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:23 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a2df8944-6455-48a5-b08a-3907fbc2648f Nov 02 12:45:23 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:23 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-60b2c2b9-7b0e-495f-963e-657aef99e8dc tempest-VolumeDependencyTests-798409840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-81fdbad2-8094-4d01-a62e-795295e3ab41" returned: 0 in 0.499s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-60b2c2b9-7b0e-495f-963e-657aef99e8dc tempest-VolumeDependencyTests-798409840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-81fdbad2-8094-4d01-a62e-795295e3ab41 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:23 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-81fdbad2-8094-4d01-a62e-795295e3ab41 Nov 02 12:45:23 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:24 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f1457562-d5f7-4d55-85d7-b72284ed2581 tempest-CreateVolumesFromImageTest-2141915423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a2df8944-6455-48a5-b08a-3907fbc2648f" returned: 0 in 0.309s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:24 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f1457562-d5f7-4d55-85d7-b72284ed2581 tempest-CreateVolumesFromImageTest-2141915423 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:45:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f1457562-d5f7-4d55-85d7-b72284ed2581 tempest-CreateVolumesFromImageTest-2141915423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-09bb9a7d-8849-4c98-b94a-672560c7513d tempest-CreateVolumesFromImageTest-2141915423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.635s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:24 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-09bb9a7d-8849-4c98-b94a-672560c7513d tempest-CreateVolumesFromImageTest-2141915423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1684029839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9028bd11-a4f8-4ead-bcd2-9b36bca9903e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35f1019f5cc3434cbda9466ec3c14dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:21Z,use_quota=True,user_id='1a65336325824c04b88ab6e8dd0057e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:45:24 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-09bb9a7d-8849-4c98-b94a-672560c7513d tempest-CreateVolumesFromImageTest-2141915423 None] Creating volume 9028bd11-a4f8-4ead-bcd2-9b36bca9903e {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:45:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-09bb9a7d-8849-4c98-b94a-672560c7513d tempest-CreateVolumesFromImageTest-2141915423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-09bb9a7d-8849-4c98-b94a-672560c7513d tempest-CreateVolumesFromImageTest-2141915423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:24 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-09bb9a7d-8849-4c98-b94a-672560c7513d tempest-CreateVolumesFromImageTest-2141915423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:24 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-09bb9a7d-8849-4c98-b94a-672560c7513d tempest-CreateVolumesFromImageTest-2141915423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-09bb9a7d-8849-4c98-b94a-672560c7513d tempest-CreateVolumesFromImageTest-2141915423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:24 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-09bb9a7d-8849-4c98-b94a-672560c7513d tempest-CreateVolumesFromImageTest-2141915423 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:45:24 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-09bb9a7d-8849-4c98-b94a-672560c7513d tempest-CreateVolumesFromImageTest-2141915423 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:45:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-09bb9a7d-8849-4c98-b94a-672560c7513d tempest-CreateVolumesFromImageTest-2141915423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9028bd11-a4f8-4ead-bcd2-9b36bca9903e 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:24 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-60b2c2b9-7b0e-495f-963e-657aef99e8dc tempest-VolumeDependencyTests-798409840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-81fdbad2-8094-4d01-a62e-795295e3ab41" returned: 0 in 0.332s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:24 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9028bd11-a4f8-4ead-bcd2-9b36bca9903e 1073741824 Nov 02 12:45:24 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f1457562-d5f7-4d55-85d7-b72284ed2581 tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db3cc6dc-5129-45f7-aa6d-13fd38946ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2df8944-6455-48a5-b08a-3907fbc2648f', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f1457562-d5f7-4d55-85d7-b72284ed2581 tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aed62df-d250-47fc-9984-07ee919737c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:24 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-60b2c2b9-7b0e-495f-963e-657aef99e8dc tempest-VolumeDependencyTests-798409840 None] Lock "cinder-quobyte-81fdbad2-8094-4d01-a62e-795295e3ab41" released by "delete_volume" :: held 0.899s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-43a22990-72b8-408d-b7cb-2332c9c92930 tempest-CinderUnicodeTest-1539770609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:24 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-f1457562-d5f7-4d55-85d7-b72284ed2581 tempest-CreateVolumesFromImageTest-2141915423 None] Volume volume-a2df8944-6455-48a5-b08a-3907fbc2648f (a2df8944-6455-48a5-b08a-3907fbc2648f): created successfully Nov 02 12:45:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f1457562-d5f7-4d55-85d7-b72284ed2581 tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aed62df-d250-47fc-9984-07ee919737c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:24 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-f1457562-d5f7-4d55-85d7-b72284ed2581 tempest-CreateVolumesFromImageTest-2141915423 None] Flow 'volume_create_manager' (48f3e9e7-0293-4cbc-aa2b-402294688c53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:24 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-f1457562-d5f7-4d55-85d7-b72284ed2581 tempest-CreateVolumesFromImageTest-2141915423 None] Created volume successfully. Nov 02 12:45:24 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-60b2c2b9-7b0e-495f-963e-657aef99e8dc tempest-VolumeDependencyTests-798409840 None] Created reservations ['5049fd9a-282f-4cf1-a9a6-36574ff7e981', '8b1d230d-245b-418b-92bb-ed43bf18dd6c', '13b8f641-334f-44a0-a229-98647523b296', 'a6680fc3-56ce-44e4-af0d-6c36721726c1'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-60b2c2b9-7b0e-495f-963e-657aef99e8dc tempest-VolumeDependencyTests-798409840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-60b2c2b9-7b0e-495f-963e-657aef99e8dc tempest-VolumeDependencyTests-798409840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:24 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-60b2c2b9-7b0e-495f-963e-657aef99e8dc tempest-VolumeDependencyTests-798409840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:24 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-60b2c2b9-7b0e-495f-963e-657aef99e8dc tempest-VolumeDependencyTests-798409840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-60b2c2b9-7b0e-495f-963e-657aef99e8dc tempest-VolumeDependencyTests-798409840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-60b2c2b9-7b0e-495f-963e-657aef99e8dc tempest-VolumeDependencyTests-798409840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:24 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:45:24 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:24 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-60b2c2b9-7b0e-495f-963e-657aef99e8dc tempest-VolumeDependencyTests-798409840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.321s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:24 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-60b2c2b9-7b0e-495f-963e-657aef99e8dc tempest-VolumeDependencyTests-798409840 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:45:24 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-60b2c2b9-7b0e-495f-963e-657aef99e8dc tempest-VolumeDependencyTests-798409840 None] Deleted volume successfully. Nov 02 12:45:24 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-09bb9a7d-8849-4c98-b94a-672560c7513d tempest-CreateVolumesFromImageTest-2141915423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9028bd11-a4f8-4ead-bcd2-9b36bca9903e 1073741824" returned: 0 in 0.590s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:24 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-60b2c2b9-7b0e-495f-963e-657aef99e8dc tempest-VolumeDependencyTests-798409840 None] Lock "cinder-81fdbad2-8094-4d01-a62e-795295e3ab41-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-09bb9a7d-8849-4c98-b94a-672560c7513d tempest-CreateVolumesFromImageTest-2141915423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9028bd11-a4f8-4ead-bcd2-9b36bca9903e {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:24 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9028bd11-a4f8-4ead-bcd2-9b36bca9903e Nov 02 12:45:24 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:25 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-09bb9a7d-8849-4c98-b94a-672560c7513d tempest-CreateVolumesFromImageTest-2141915423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9028bd11-a4f8-4ead-bcd2-9b36bca9903e" returned: 0 in 0.274s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:25 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-09bb9a7d-8849-4c98-b94a-672560c7513d tempest-CreateVolumesFromImageTest-2141915423 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:45:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-09bb9a7d-8849-4c98-b94a-672560c7513d tempest-CreateVolumesFromImageTest-2141915423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-29c3ca87-de48-497d-af3c-c7357ea7308f tempest-CreateVolumesFromImageTest-2141915423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.976s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:25 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-29c3ca87-de48-497d-af3c-c7357ea7308f tempest-CreateVolumesFromImageTest-2141915423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-448837350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c59b4439-d7ff-4b46-997d-2913a9694c8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35f1019f5cc3434cbda9466ec3c14dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:22Z,use_quota=True,user_id='1a65336325824c04b88ab6e8dd0057e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:45:25 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-29c3ca87-de48-497d-af3c-c7357ea7308f tempest-CreateVolumesFromImageTest-2141915423 None] Creating volume c59b4439-d7ff-4b46-997d-2913a9694c8f {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:45:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-29c3ca87-de48-497d-af3c-c7357ea7308f tempest-CreateVolumesFromImageTest-2141915423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-29c3ca87-de48-497d-af3c-c7357ea7308f tempest-CreateVolumesFromImageTest-2141915423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:25 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-29c3ca87-de48-497d-af3c-c7357ea7308f tempest-CreateVolumesFromImageTest-2141915423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:25 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-29c3ca87-de48-497d-af3c-c7357ea7308f tempest-CreateVolumesFromImageTest-2141915423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-29c3ca87-de48-497d-af3c-c7357ea7308f tempest-CreateVolumesFromImageTest-2141915423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:25 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-29c3ca87-de48-497d-af3c-c7357ea7308f tempest-CreateVolumesFromImageTest-2141915423 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:45:25 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-29c3ca87-de48-497d-af3c-c7357ea7308f tempest-CreateVolumesFromImageTest-2141915423 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:45:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-29c3ca87-de48-497d-af3c-c7357ea7308f tempest-CreateVolumesFromImageTest-2141915423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c59b4439-d7ff-4b46-997d-2913a9694c8f 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-09bb9a7d-8849-4c98-b94a-672560c7513d tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a356bfa-0c20-47a8-b55b-040ae2262001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9028bd11-a4f8-4ead-bcd2-9b36bca9903e', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-09bb9a7d-8849-4c98-b94a-672560c7513d tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1c3c53c-505c-40e2-b01e-1092d05b3f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:25 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c59b4439-d7ff-4b46-997d-2913a9694c8f 1073741824 Nov 02 12:45:25 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:25 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-09bb9a7d-8849-4c98-b94a-672560c7513d tempest-CreateVolumesFromImageTest-2141915423 None] Volume volume-9028bd11-a4f8-4ead-bcd2-9b36bca9903e (9028bd11-a4f8-4ead-bcd2-9b36bca9903e): created successfully Nov 02 12:45:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-09bb9a7d-8849-4c98-b94a-672560c7513d tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1c3c53c-505c-40e2-b01e-1092d05b3f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:25 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-09bb9a7d-8849-4c98-b94a-672560c7513d tempest-CreateVolumesFromImageTest-2141915423 None] Flow 'volume_create_manager' (f5c7ddd1-f4bf-4b50-bc7c-55b070254c70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:25 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-09bb9a7d-8849-4c98-b94a-672560c7513d tempest-CreateVolumesFromImageTest-2141915423 None] Created volume successfully. Nov 02 12:45:25 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-29c3ca87-de48-497d-af3c-c7357ea7308f tempest-CreateVolumesFromImageTest-2141915423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c59b4439-d7ff-4b46-997d-2913a9694c8f 1073741824" returned: 0 in 0.548s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:25 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-29c3ca87-de48-497d-af3c-c7357ea7308f tempest-CreateVolumesFromImageTest-2141915423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c59b4439-d7ff-4b46-997d-2913a9694c8f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:25 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c59b4439-d7ff-4b46-997d-2913a9694c8f Nov 02 12:45:25 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:26 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-29c3ca87-de48-497d-af3c-c7357ea7308f tempest-CreateVolumesFromImageTest-2141915423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c59b4439-d7ff-4b46-997d-2913a9694c8f" returned: 0 in 0.387s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:26 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-29c3ca87-de48-497d-af3c-c7357ea7308f tempest-CreateVolumesFromImageTest-2141915423 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:45:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-29c3ca87-de48-497d-af3c-c7357ea7308f tempest-CreateVolumesFromImageTest-2141915423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-226041f0-22b8-47bc-9767-26888a96e6f3 tempest-CreateVolumesFromImageTest-2141915423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.312s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:26 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-226041f0-22b8-47bc-9767-26888a96e6f3 tempest-CreateVolumesFromImageTest-2141915423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2134870164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6759f6af-16f3-46de-82f1-8203e3fef157,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35f1019f5cc3434cbda9466ec3c14dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:23Z,use_quota=True,user_id='1a65336325824c04b88ab6e8dd0057e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:45:26 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-226041f0-22b8-47bc-9767-26888a96e6f3 tempest-CreateVolumesFromImageTest-2141915423 None] Creating volume 6759f6af-16f3-46de-82f1-8203e3fef157 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:45:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-226041f0-22b8-47bc-9767-26888a96e6f3 tempest-CreateVolumesFromImageTest-2141915423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-226041f0-22b8-47bc-9767-26888a96e6f3 tempest-CreateVolumesFromImageTest-2141915423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:26 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-226041f0-22b8-47bc-9767-26888a96e6f3 tempest-CreateVolumesFromImageTest-2141915423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:26 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-226041f0-22b8-47bc-9767-26888a96e6f3 tempest-CreateVolumesFromImageTest-2141915423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-226041f0-22b8-47bc-9767-26888a96e6f3 tempest-CreateVolumesFromImageTest-2141915423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:26 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-226041f0-22b8-47bc-9767-26888a96e6f3 tempest-CreateVolumesFromImageTest-2141915423 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:45:26 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-226041f0-22b8-47bc-9767-26888a96e6f3 tempest-CreateVolumesFromImageTest-2141915423 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:45:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-226041f0-22b8-47bc-9767-26888a96e6f3 tempest-CreateVolumesFromImageTest-2141915423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6759f6af-16f3-46de-82f1-8203e3fef157 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-29c3ca87-de48-497d-af3c-c7357ea7308f tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (156428ef-5140-4d72-8248-8855473a9418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c59b4439-d7ff-4b46-997d-2913a9694c8f', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-29c3ca87-de48-497d-af3c-c7357ea7308f tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed81f9b9-2a67-4a44-84e6-232c717096e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:26 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6759f6af-16f3-46de-82f1-8203e3fef157 1073741824 Nov 02 12:45:26 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-29c3ca87-de48-497d-af3c-c7357ea7308f tempest-CreateVolumesFromImageTest-2141915423 None] Volume volume-c59b4439-d7ff-4b46-997d-2913a9694c8f (c59b4439-d7ff-4b46-997d-2913a9694c8f): created successfully Nov 02 12:45:26 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-29c3ca87-de48-497d-af3c-c7357ea7308f tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed81f9b9-2a67-4a44-84e6-232c717096e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-29c3ca87-de48-497d-af3c-c7357ea7308f tempest-CreateVolumesFromImageTest-2141915423 None] Flow 'volume_create_manager' (ce167c71-b831-4b4f-b05a-c123b9c60a97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:26 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-29c3ca87-de48-497d-af3c-c7357ea7308f tempest-CreateVolumesFromImageTest-2141915423 None] Created volume successfully. Nov 02 12:45:26 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-226041f0-22b8-47bc-9767-26888a96e6f3 tempest-CreateVolumesFromImageTest-2141915423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6759f6af-16f3-46de-82f1-8203e3fef157 1073741824" returned: 0 in 0.532s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-226041f0-22b8-47bc-9767-26888a96e6f3 tempest-CreateVolumesFromImageTest-2141915423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6759f6af-16f3-46de-82f1-8203e3fef157 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:26 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6759f6af-16f3-46de-82f1-8203e3fef157 Nov 02 12:45:26 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:26 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-226041f0-22b8-47bc-9767-26888a96e6f3 tempest-CreateVolumesFromImageTest-2141915423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6759f6af-16f3-46de-82f1-8203e3fef157" returned: 0 in 0.259s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:26 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-226041f0-22b8-47bc-9767-26888a96e6f3 tempest-CreateVolumesFromImageTest-2141915423 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:45:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-226041f0-22b8-47bc-9767-26888a96e6f3 tempest-CreateVolumesFromImageTest-2141915423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-43a22990-72b8-408d-b7cb-2332c9c92930 tempest-CinderUnicodeTest-1539770609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.687s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:26 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-226041f0-22b8-47bc-9767-26888a96e6f3 tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecffd390-82b3-4e4e-b3de-38246fce6549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6759f6af-16f3-46de-82f1-8203e3fef157', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:27 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-226041f0-22b8-47bc-9767-26888a96e6f3 tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bfaccfc-f556-471e-bf0e-dcbbffef876e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:27 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-43a22990-72b8-408d-b7cb-2332c9c92930 tempest-CinderUnicodeTest-1539770609 None] Creating offline snapshot fb4857c6-02df-4c80-a32f-4353ff1c0149 of volume 8d3061ca-f132-4dec-a1f1-83dfbc409385 {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:45:27 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-226041f0-22b8-47bc-9767-26888a96e6f3 tempest-CreateVolumesFromImageTest-2141915423 None] Volume volume-6759f6af-16f3-46de-82f1-8203e3fef157 (6759f6af-16f3-46de-82f1-8203e3fef157): created successfully Nov 02 12:45:27 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-226041f0-22b8-47bc-9767-26888a96e6f3 tempest-CreateVolumesFromImageTest-2141915423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bfaccfc-f556-471e-bf0e-dcbbffef876e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:27 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-226041f0-22b8-47bc-9767-26888a96e6f3 tempest-CreateVolumesFromImageTest-2141915423 None] Flow 'volume_create_manager' (11c34995-710b-4411-99a5-1ffa842509df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:27 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70c4f21-0e6f-44bf-9dd8-1120ffb1295d]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-43a22990-72b8-408d-b7cb-2332c9c92930 tempest-CinderUnicodeTest-1539770609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:27 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-226041f0-22b8-47bc-9767-26888a96e6f3 tempest-CreateVolumesFromImageTest-2141915423 None] Created volume successfully. Nov 02 12:45:27 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385 Nov 02 12:45:27 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-002c166e-bd03-4454-9d57-ecdbc27d64c9 tempest-CreateVolumesFromImageTest-2141915423 None] Acquiring lock "cinder-6759f6af-16f3-46de-82f1-8203e3fef157-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:27 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-002c166e-bd03-4454-9d57-ecdbc27d64c9 tempest-CreateVolumesFromImageTest-2141915423 None] Lock "cinder-6759f6af-16f3-46de-82f1-8203e3fef157-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:27 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:27 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-002c166e-bd03-4454-9d57-ecdbc27d64c9 tempest-CreateVolumesFromImageTest-2141915423 None] Acquiring lock "cinder-quobyte-6759f6af-16f3-46de-82f1-8203e3fef157" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:27 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-002c166e-bd03-4454-9d57-ecdbc27d64c9 tempest-CreateVolumesFromImageTest-2141915423 None] Lock "cinder-quobyte-6759f6af-16f3-46de-82f1-8203e3fef157" acquired by "delete_volume" :: waited 0.039s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:27 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e18feef-abae-474e-8daf-12855265f401]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-002c166e-bd03-4454-9d57-ecdbc27d64c9 tempest-CreateVolumesFromImageTest-2141915423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6759f6af-16f3-46de-82f1-8203e3fef157 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:27 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6759f6af-16f3-46de-82f1-8203e3fef157 Nov 02 12:45:27 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:27 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-43a22990-72b8-408d-b7cb-2332c9c92930 tempest-CinderUnicodeTest-1539770609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385" returned: 0 in 0.652s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-43a22990-72b8-408d-b7cb-2332c9c92930 tempest-CinderUnicodeTest-1539770609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385.fb4857c6-02df-4c80-a32f-4353ff1c0149 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:27 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385.fb4857c6-02df-4c80-a32f-4353ff1c0149 1G Nov 02 12:45:27 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:28 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-002c166e-bd03-4454-9d57-ecdbc27d64c9 tempest-CreateVolumesFromImageTest-2141915423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6759f6af-16f3-46de-82f1-8203e3fef157" returned: 0 in 0.496s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-002c166e-bd03-4454-9d57-ecdbc27d64c9 tempest-CreateVolumesFromImageTest-2141915423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6759f6af-16f3-46de-82f1-8203e3fef157 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:28 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6759f6af-16f3-46de-82f1-8203e3fef157 Nov 02 12:45:28 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:28 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-43a22990-72b8-408d-b7cb-2332c9c92930 tempest-CinderUnicodeTest-1539770609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385.fb4857c6-02df-4c80-a32f-4353ff1c0149 1G" returned: 0 in 0.559s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-43a22990-72b8-408d-b7cb-2332c9c92930 tempest-CinderUnicodeTest-1539770609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d3061ca-f132-4dec-a1f1-83dfbc409385 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385.fb4857c6-02df-4c80-a32f-4353ff1c0149 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:28 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d3061ca-f132-4dec-a1f1-83dfbc409385 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385.fb4857c6-02df-4c80-a32f-4353ff1c0149 Nov 02 12:45:28 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:28 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-002c166e-bd03-4454-9d57-ecdbc27d64c9 tempest-CreateVolumesFromImageTest-2141915423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6759f6af-16f3-46de-82f1-8203e3fef157" returned: 0 in 0.303s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-002c166e-bd03-4454-9d57-ecdbc27d64c9 tempest-CreateVolumesFromImageTest-2141915423 None] Lock "cinder-quobyte-6759f6af-16f3-46de-82f1-8203e3fef157" released by "delete_volume" :: held 0.879s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:28 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-002c166e-bd03-4454-9d57-ecdbc27d64c9 tempest-CreateVolumesFromImageTest-2141915423 None] Created reservations ['b5c5521b-2a2b-4c50-9452-256a9d920b71', '41d80d53-ee61-43eb-9708-8fcd06a9da5f', 'e830ecec-e01d-44ff-b6d3-c1837e829e08', '7af3045e-4a94-462f-8c5d-4127aea7d466'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-002c166e-bd03-4454-9d57-ecdbc27d64c9 tempest-CreateVolumesFromImageTest-2141915423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-002c166e-bd03-4454-9d57-ecdbc27d64c9 tempest-CreateVolumesFromImageTest-2141915423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:28 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-002c166e-bd03-4454-9d57-ecdbc27d64c9 tempest-CreateVolumesFromImageTest-2141915423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:28 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-002c166e-bd03-4454-9d57-ecdbc27d64c9 tempest-CreateVolumesFromImageTest-2141915423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-002c166e-bd03-4454-9d57-ecdbc27d64c9 tempest-CreateVolumesFromImageTest-2141915423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-002c166e-bd03-4454-9d57-ecdbc27d64c9 tempest-CreateVolumesFromImageTest-2141915423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:28 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:45:28 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:28 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-43a22990-72b8-408d-b7cb-2332c9c92930 tempest-CinderUnicodeTest-1539770609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d3061ca-f132-4dec-a1f1-83dfbc409385 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385.fb4857c6-02df-4c80-a32f-4353ff1c0149" returned: 0 in 0.387s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:28 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-43a22990-72b8-408d-b7cb-2332c9c92930 tempest-CinderUnicodeTest-1539770609 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385.fb4857c6-02df-4c80-a32f-4353ff1c0149 is being set with open permissions: ugo+rw Nov 02 12:45:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-43a22990-72b8-408d-b7cb-2332c9c92930 tempest-CinderUnicodeTest-1539770609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385.fb4857c6-02df-4c80-a32f-4353ff1c0149 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:28 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385.fb4857c6-02df-4c80-a32f-4353ff1c0149 Nov 02 12:45:28 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:28 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-002c166e-bd03-4454-9d57-ecdbc27d64c9 tempest-CreateVolumesFromImageTest-2141915423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.364s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:28 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-002c166e-bd03-4454-9d57-ecdbc27d64c9 tempest-CreateVolumesFromImageTest-2141915423 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:45:28 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-002c166e-bd03-4454-9d57-ecdbc27d64c9 tempest-CreateVolumesFromImageTest-2141915423 None] Deleted volume successfully. Nov 02 12:45:28 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-002c166e-bd03-4454-9d57-ecdbc27d64c9 tempest-CreateVolumesFromImageTest-2141915423 None] Lock "cinder-6759f6af-16f3-46de-82f1-8203e3fef157-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-43a22990-72b8-408d-b7cb-2332c9c92930 tempest-CinderUnicodeTest-1539770609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385.fb4857c6-02df-4c80-a32f-4353ff1c0149" returned: 0 in 0.307s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-43a22990-72b8-408d-b7cb-2332c9c92930 tempest-CinderUnicodeTest-1539770609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:29 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385.info Nov 02 12:45:29 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b7677673-c281-4e84-a4f4-c0baf392d92a tempest-CreateVolumesFromImageTest-2141915423 None] Acquiring lock "cinder-c59b4439-d7ff-4b46-997d-2913a9694c8f-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b7677673-c281-4e84-a4f4-c0baf392d92a tempest-CreateVolumesFromImageTest-2141915423 None] Lock "cinder-c59b4439-d7ff-4b46-997d-2913a9694c8f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b7677673-c281-4e84-a4f4-c0baf392d92a tempest-CreateVolumesFromImageTest-2141915423 None] Acquiring lock "cinder-quobyte-c59b4439-d7ff-4b46-997d-2913a9694c8f" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b7677673-c281-4e84-a4f4-c0baf392d92a tempest-CreateVolumesFromImageTest-2141915423 None] Lock "cinder-quobyte-c59b4439-d7ff-4b46-997d-2913a9694c8f" acquired by "delete_volume" :: waited 0.022s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:29 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-43a22990-72b8-408d-b7cb-2332c9c92930 tempest-CinderUnicodeTest-1539770609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385.info" returned: 0 in 0.379s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:29 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-43a22990-72b8-408d-b7cb-2332c9c92930 tempest-CinderUnicodeTest-1539770609 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385.info is being set with open permissions: ugo+rw Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-43a22990-72b8-408d-b7cb-2332c9c92930 tempest-CinderUnicodeTest-1539770609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0ae53a-d4c5-43e7-8481-e9a8b285ee17]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b7677673-c281-4e84-a4f4-c0baf392d92a tempest-CreateVolumesFromImageTest-2141915423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c59b4439-d7ff-4b46-997d-2913a9694c8f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:29 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385.info Nov 02 12:45:29 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c2d7d4d-8f87-44da-b707-703619e1b51e tempest-ProjectReaderTests-921411335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2c2d7d4d-8f87-44da-b707-703619e1b51e tempest-ProjectReaderTests-921411335 None] Flow 'volume_create_manager' (ed64350c-7cbb-4e73-b9c3-9ca944fb2308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:29 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c59b4439-d7ff-4b46-997d-2913a9694c8f Nov 02 12:45:29 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2c2d7d4d-8f87-44da-b707-703619e1b51e tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e315375-699a-4511-8b32-0c04797bf2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2c2d7d4d-8f87-44da-b707-703619e1b51e tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e315375-699a-4511-8b32-0c04797bf2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2142694528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f56866-e0b2-4577-a297-6fb1c781283c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0558d822624340139a509d568f744b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:29Z,use_quota=True,user_id='2fe97f4e0d5e40b9a433d3972ba06d21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2c2d7d4d-8f87-44da-b707-703619e1b51e tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9775146-9334-4a0b-b041-ade6a7010c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2c2d7d4d-8f87-44da-b707-703619e1b51e tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9775146-9334-4a0b-b041-ade6a7010c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2c2d7d4d-8f87-44da-b707-703619e1b51e tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be2a5f61-df5c-4220-b872-59007f7c7445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2c2d7d4d-8f87-44da-b707-703619e1b51e tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be2a5f61-df5c-4220-b872-59007f7c7445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61f56866-e0b2-4577-a297-6fb1c781283c', 'volume_name': 'volume-61f56866-e0b2-4577-a297-6fb1c781283c', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2c2d7d4d-8f87-44da-b707-703619e1b51e tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96608dec-9d56-41fb-8562-cdea701132c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2c2d7d4d-8f87-44da-b707-703619e1b51e tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96608dec-9d56-41fb-8562-cdea701132c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2c2d7d4d-8f87-44da-b707-703619e1b51e tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfca8b45-1b29-41fe-8017-d3bf3069f251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:29 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-2c2d7d4d-8f87-44da-b707-703619e1b51e tempest-ProjectReaderTests-921411335 None] Volume 61f56866-e0b2-4577-a297-6fb1c781283c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61f56866-e0b2-4577-a297-6fb1c781283c', 'volume_size': 1} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2c2d7d4d-8f87-44da-b707-703619e1b51e tempest-ProjectReaderTests-921411335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-e886bac6-cf13-40bc-a90a-dbf4a2fa5f90 tempest-ProjectReaderTests-153927055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e886bac6-cf13-40bc-a90a-dbf4a2fa5f90 tempest-ProjectReaderTests-153927055 None] Flow 'volume_create_manager' (41963e12-d434-45fe-8997-9a809305d7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e886bac6-cf13-40bc-a90a-dbf4a2fa5f90 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4338d9fa-d650-4550-9697-8de310c6bbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e886bac6-cf13-40bc-a90a-dbf4a2fa5f90 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4338d9fa-d650-4550-9697-8de310c6bbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-868779562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbdd6aca-2ef1-4109-9953-dfbd8a574b31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='371854aebb9b4c37b51206a234c0f7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:29Z,use_quota=True,user_id='2859c42cc4c64316a323f9dd6c533e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e886bac6-cf13-40bc-a90a-dbf4a2fa5f90 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3489fcd-1b09-406f-8694-a92002803409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e886bac6-cf13-40bc-a90a-dbf4a2fa5f90 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3489fcd-1b09-406f-8694-a92002803409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:29 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e886bac6-cf13-40bc-a90a-dbf4a2fa5f90 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd37c0d-cf36-4e3a-bdc6-b10001570d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e886bac6-cf13-40bc-a90a-dbf4a2fa5f90 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd37c0d-cf36-4e3a-bdc6-b10001570d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbdd6aca-2ef1-4109-9953-dfbd8a574b31', 'volume_name': 'volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e886bac6-cf13-40bc-a90a-dbf4a2fa5f90 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7c656e6-d05e-4028-8fee-e1f661e1372e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e886bac6-cf13-40bc-a90a-dbf4a2fa5f90 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7c656e6-d05e-4028-8fee-e1f661e1372e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e886bac6-cf13-40bc-a90a-dbf4a2fa5f90 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5790fc0e-c727-4205-b584-714bc2c3de0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:29 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-e886bac6-cf13-40bc-a90a-dbf4a2fa5f90 tempest-ProjectReaderTests-153927055 None] Volume cbdd6aca-2ef1-4109-9953-dfbd8a574b31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31', 'volume_size': 1} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e886bac6-cf13-40bc-a90a-dbf4a2fa5f90 tempest-ProjectReaderTests-153927055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-43a22990-72b8-408d-b7cb-2332c9c92930 tempest-CinderUnicodeTest-1539770609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385.info" returned: 0 in 0.333s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-43a22990-72b8-408d-b7cb-2332c9c92930 tempest-CinderUnicodeTest-1539770609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.747s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2c2d7d4d-8f87-44da-b707-703619e1b51e tempest-ProjectReaderTests-921411335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.128s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-2c2d7d4d-8f87-44da-b707-703619e1b51e tempest-ProjectReaderTests-921411335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2142694528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f56866-e0b2-4577-a297-6fb1c781283c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0558d822624340139a509d568f744b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:29Z,use_quota=True,user_id='2fe97f4e0d5e40b9a433d3972ba06d21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-2c2d7d4d-8f87-44da-b707-703619e1b51e tempest-ProjectReaderTests-921411335 None] Creating volume 61f56866-e0b2-4577-a297-6fb1c781283c {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2c2d7d4d-8f87-44da-b707-703619e1b51e tempest-ProjectReaderTests-921411335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2c2d7d4d-8f87-44da-b707-703619e1b51e tempest-ProjectReaderTests-921411335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-2c2d7d4d-8f87-44da-b707-703619e1b51e tempest-ProjectReaderTests-921411335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-2c2d7d4d-8f87-44da-b707-703619e1b51e tempest-ProjectReaderTests-921411335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2c2d7d4d-8f87-44da-b707-703619e1b51e tempest-ProjectReaderTests-921411335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-2c2d7d4d-8f87-44da-b707-703619e1b51e tempest-ProjectReaderTests-921411335 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:45:29 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-2c2d7d4d-8f87-44da-b707-703619e1b51e tempest-ProjectReaderTests-921411335 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2c2d7d4d-8f87-44da-b707-703619e1b51e tempest-ProjectReaderTests-921411335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-61f56866-e0b2-4577-a297-6fb1c781283c 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:29 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-61f56866-e0b2-4577-a297-6fb1c781283c 1073741824 Nov 02 12:45:29 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:29 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:29 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-43a22990-72b8-408d-b7cb-2332c9c92930 tempest-CinderUnicodeTest-1539770609 None] Create snapshot completed successfully Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b7677673-c281-4e84-a4f4-c0baf392d92a tempest-CreateVolumesFromImageTest-2141915423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c59b4439-d7ff-4b46-997d-2913a9694c8f" returned: 0 in 0.409s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b7677673-c281-4e84-a4f4-c0baf392d92a tempest-CreateVolumesFromImageTest-2141915423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c59b4439-d7ff-4b46-997d-2913a9694c8f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:29 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c59b4439-d7ff-4b46-997d-2913a9694c8f Nov 02 12:45:29 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:30 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b7677673-c281-4e84-a4f4-c0baf392d92a tempest-CreateVolumesFromImageTest-2141915423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c59b4439-d7ff-4b46-997d-2913a9694c8f" returned: 0 in 0.247s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b7677673-c281-4e84-a4f4-c0baf392d92a tempest-CreateVolumesFromImageTest-2141915423 None] Lock "cinder-quobyte-c59b4439-d7ff-4b46-997d-2913a9694c8f" released by "delete_volume" :: held 0.715s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-b7677673-c281-4e84-a4f4-c0baf392d92a tempest-CreateVolumesFromImageTest-2141915423 None] Created reservations ['d5d11d88-c7d9-4cd7-87c6-a5b313f81055', 'faa9a765-e9f4-4bfe-ad88-8ecdc9a8b64b', '73f51b86-66ed-4a4f-8c63-33e96373896a', '78a8db58-b8f7-4464-b1aa-048bd7afa8cf'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b7677673-c281-4e84-a4f4-c0baf392d92a tempest-CreateVolumesFromImageTest-2141915423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b7677673-c281-4e84-a4f4-c0baf392d92a tempest-CreateVolumesFromImageTest-2141915423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b7677673-c281-4e84-a4f4-c0baf392d92a tempest-CreateVolumesFromImageTest-2141915423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b7677673-c281-4e84-a4f4-c0baf392d92a tempest-CreateVolumesFromImageTest-2141915423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b7677673-c281-4e84-a4f4-c0baf392d92a tempest-CreateVolumesFromImageTest-2141915423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b7677673-c281-4e84-a4f4-c0baf392d92a tempest-CreateVolumesFromImageTest-2141915423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:30 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:45:30 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:30 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2c2d7d4d-8f87-44da-b707-703619e1b51e tempest-ProjectReaderTests-921411335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-61f56866-e0b2-4577-a297-6fb1c781283c 1073741824" returned: 0 in 0.492s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2c2d7d4d-8f87-44da-b707-703619e1b51e tempest-ProjectReaderTests-921411335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-61f56866-e0b2-4577-a297-6fb1c781283c {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:30 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-61f56866-e0b2-4577-a297-6fb1c781283c Nov 02 12:45:30 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-02749a03-d781-4bc6-9118-cce93fda066e tempest-CreateVolumesFromImageTest-2141915423 None] Acquiring lock "cinder-9028bd11-a4f8-4ead-bcd2-9b36bca9903e-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-02749a03-d781-4bc6-9118-cce93fda066e tempest-CreateVolumesFromImageTest-2141915423 None] Lock "cinder-9028bd11-a4f8-4ead-bcd2-9b36bca9903e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-02749a03-d781-4bc6-9118-cce93fda066e tempest-CreateVolumesFromImageTest-2141915423 None] Acquiring lock "cinder-quobyte-9028bd11-a4f8-4ead-bcd2-9b36bca9903e" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-02749a03-d781-4bc6-9118-cce93fda066e tempest-CreateVolumesFromImageTest-2141915423 None] Lock "cinder-quobyte-9028bd11-a4f8-4ead-bcd2-9b36bca9903e" acquired by "delete_volume" :: waited 0.015s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:30 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b7677673-c281-4e84-a4f4-c0baf392d92a tempest-CreateVolumesFromImageTest-2141915423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.319s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-b7677673-c281-4e84-a4f4-c0baf392d92a tempest-CreateVolumesFromImageTest-2141915423 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:45:30 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-b7677673-c281-4e84-a4f4-c0baf392d92a tempest-CreateVolumesFromImageTest-2141915423 None] Deleted volume successfully. Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[0249df15-52a4-462a-8888-15295c741ea0]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-02749a03-d781-4bc6-9118-cce93fda066e tempest-CreateVolumesFromImageTest-2141915423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9028bd11-a4f8-4ead-bcd2-9b36bca9903e {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:30 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b7677673-c281-4e84-a4f4-c0baf392d92a tempest-CreateVolumesFromImageTest-2141915423 None] Lock "cinder-c59b4439-d7ff-4b46-997d-2913a9694c8f-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-2c2d7d4d-8f87-44da-b707-703619e1b51e tempest-ProjectReaderTests-921411335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-61f56866-e0b2-4577-a297-6fb1c781283c" returned: 0 in 0.294s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-2c2d7d4d-8f87-44da-b707-703619e1b51e tempest-ProjectReaderTests-921411335 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-2c2d7d4d-8f87-44da-b707-703619e1b51e tempest-ProjectReaderTests-921411335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e886bac6-cf13-40bc-a90a-dbf4a2fa5f90 tempest-ProjectReaderTests-153927055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.861s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e886bac6-cf13-40bc-a90a-dbf4a2fa5f90 tempest-ProjectReaderTests-153927055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-868779562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbdd6aca-2ef1-4109-9953-dfbd8a574b31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='371854aebb9b4c37b51206a234c0f7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:29Z,use_quota=True,user_id='2859c42cc4c64316a323f9dd6c533e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-e886bac6-cf13-40bc-a90a-dbf4a2fa5f90 tempest-ProjectReaderTests-153927055 None] Creating volume cbdd6aca-2ef1-4109-9953-dfbd8a574b31 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e886bac6-cf13-40bc-a90a-dbf4a2fa5f90 tempest-ProjectReaderTests-153927055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e886bac6-cf13-40bc-a90a-dbf4a2fa5f90 tempest-ProjectReaderTests-153927055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e886bac6-cf13-40bc-a90a-dbf4a2fa5f90 tempest-ProjectReaderTests-153927055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e886bac6-cf13-40bc-a90a-dbf4a2fa5f90 tempest-ProjectReaderTests-153927055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e886bac6-cf13-40bc-a90a-dbf4a2fa5f90 tempest-ProjectReaderTests-153927055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e886bac6-cf13-40bc-a90a-dbf4a2fa5f90 tempest-ProjectReaderTests-153927055 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:45:30 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-e886bac6-cf13-40bc-a90a-dbf4a2fa5f90 tempest-ProjectReaderTests-153927055 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e886bac6-cf13-40bc-a90a-dbf4a2fa5f90 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:30 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31 1073741824 Nov 02 12:45:30 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2c2d7d4d-8f87-44da-b707-703619e1b51e tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfca8b45-1b29-41fe-8017-d3bf3069f251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61f56866-e0b2-4577-a297-6fb1c781283c', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2c2d7d4d-8f87-44da-b707-703619e1b51e tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb1d920d-765f-4000-89ac-2a6b6b9c9b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:30 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-2c2d7d4d-8f87-44da-b707-703619e1b51e tempest-ProjectReaderTests-921411335 None] Volume volume-61f56866-e0b2-4577-a297-6fb1c781283c (61f56866-e0b2-4577-a297-6fb1c781283c): created successfully Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2c2d7d4d-8f87-44da-b707-703619e1b51e tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb1d920d-765f-4000-89ac-2a6b6b9c9b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-2c2d7d4d-8f87-44da-b707-703619e1b51e tempest-ProjectReaderTests-921411335 None] Flow 'volume_create_manager' (ed64350c-7cbb-4e73-b9c3-9ca944fb2308) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:30 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9028bd11-a4f8-4ead-bcd2-9b36bca9903e Nov 02 12:45:30 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:30 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-2c2d7d4d-8f87-44da-b707-703619e1b51e tempest-ProjectReaderTests-921411335 None] Created volume successfully. Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e7585450-ea70-421e-b05a-d412e9dd6fb4 tempest-CinderUnicodeTest-1539770609 None] Acquiring lock "cinder-fb4857c6-02df-4c80-a32f-4353ff1c0149-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e7585450-ea70-421e-b05a-d412e9dd6fb4 tempest-CinderUnicodeTest-1539770609 None] Lock "cinder-fb4857c6-02df-4c80-a32f-4353ff1c0149-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e7585450-ea70-421e-b05a-d412e9dd6fb4 tempest-CinderUnicodeTest-1539770609 None] Acquiring lock "cinder-quobyte-8d3061ca-f132-4dec-a1f1-83dfbc409385" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e7585450-ea70-421e-b05a-d412e9dd6fb4 tempest-CinderUnicodeTest-1539770609 None] Lock "cinder-quobyte-8d3061ca-f132-4dec-a1f1-83dfbc409385" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e7585450-ea70-421e-b05a-d412e9dd6fb4 tempest-CinderUnicodeTest-1539770609 None] Acquiring lock "cinder-quobyte-fb4857c6-02df-4c80-a32f-4353ff1c0149" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e7585450-ea70-421e-b05a-d412e9dd6fb4 tempest-CinderUnicodeTest-1539770609 None] Lock "cinder-quobyte-fb4857c6-02df-4c80-a32f-4353ff1c0149" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-e7585450-ea70-421e-b05a-d412e9dd6fb4 tempest-CinderUnicodeTest-1539770609 None] Deleting offline snapshot fb4857c6-02df-4c80-a32f-4353ff1c0149 of volume 8d3061ca-f132-4dec-a1f1-83dfbc409385 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-e7585450-ea70-421e-b05a-d412e9dd6fb4 tempest-CinderUnicodeTest-1539770609 None] snapshot_file for this snap is: volume-8d3061ca-f132-4dec-a1f1-83dfbc409385.fb4857c6-02df-4c80-a32f-4353ff1c0149 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd1e351-ae89-4ef1-a4a5-ec5198256e98]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e7585450-ea70-421e-b05a-d412e9dd6fb4 tempest-CinderUnicodeTest-1539770609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385.fb4857c6-02df-4c80-a32f-4353ff1c0149 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:30 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385.fb4857c6-02df-4c80-a32f-4353ff1c0149 Nov 02 12:45:30 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:30 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-02749a03-d781-4bc6-9118-cce93fda066e tempest-CreateVolumesFromImageTest-2141915423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9028bd11-a4f8-4ead-bcd2-9b36bca9903e" returned: 0 in 0.421s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-02749a03-d781-4bc6-9118-cce93fda066e tempest-CreateVolumesFromImageTest-2141915423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9028bd11-a4f8-4ead-bcd2-9b36bca9903e {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:30 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9028bd11-a4f8-4ead-bcd2-9b36bca9903e Nov 02 12:45:30 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:31 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e886bac6-cf13-40bc-a90a-dbf4a2fa5f90 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31 1073741824" returned: 0 in 0.490s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e886bac6-cf13-40bc-a90a-dbf4a2fa5f90 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:31 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31 Nov 02 12:45:31 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:31 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e7585450-ea70-421e-b05a-d412e9dd6fb4 tempest-CinderUnicodeTest-1539770609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385.fb4857c6-02df-4c80-a32f-4353ff1c0149" returned: 0 in 0.402s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-e7585450-ea70-421e-b05a-d412e9dd6fb4 tempest-CinderUnicodeTest-1539770609 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d3061ca-f132-4dec-a1f1-83dfbc409385(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad47333-9a6f-4cb2-a2bc-1c91fe45bfe9]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e7585450-ea70-421e-b05a-d412e9dd6fb4 tempest-CinderUnicodeTest-1539770609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:31 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-02749a03-d781-4bc6-9118-cce93fda066e tempest-CreateVolumesFromImageTest-2141915423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-9028bd11-a4f8-4ead-bcd2-9b36bca9903e" returned: 0 in 0.291s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-02749a03-d781-4bc6-9118-cce93fda066e tempest-CreateVolumesFromImageTest-2141915423 None] Lock "cinder-quobyte-9028bd11-a4f8-4ead-bcd2-9b36bca9903e" released by "delete_volume" :: held 0.782s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-02749a03-d781-4bc6-9118-cce93fda066e tempest-CreateVolumesFromImageTest-2141915423 None] Created reservations ['8ce5b67f-7e4b-48f7-81bd-c669da759b33', '85c9479a-892f-4d77-a820-86008f38ad22', 'e104c8ef-0299-40d6-98df-6e78b4f3e239', '737141c1-c8ab-4de9-a9ce-ba6b57b528e5'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:31 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385 Nov 02 12:45:31 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:31 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e886bac6-cf13-40bc-a90a-dbf4a2fa5f90 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31" returned: 0 in 0.311s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e886bac6-cf13-40bc-a90a-dbf4a2fa5f90 tempest-ProjectReaderTests-153927055 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e886bac6-cf13-40bc-a90a-dbf4a2fa5f90 tempest-ProjectReaderTests-153927055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e886bac6-cf13-40bc-a90a-dbf4a2fa5f90 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5790fc0e-c727-4205-b584-714bc2c3de0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e886bac6-cf13-40bc-a90a-dbf4a2fa5f90 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c4f687c-d30a-4dd3-ba26-aede73081f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:31 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-e886bac6-cf13-40bc-a90a-dbf4a2fa5f90 tempest-ProjectReaderTests-153927055 None] Volume volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31 (cbdd6aca-2ef1-4109-9953-dfbd8a574b31): created successfully Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e886bac6-cf13-40bc-a90a-dbf4a2fa5f90 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c4f687c-d30a-4dd3-ba26-aede73081f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e886bac6-cf13-40bc-a90a-dbf4a2fa5f90 tempest-ProjectReaderTests-153927055 None] Flow 'volume_create_manager' (41963e12-d434-45fe-8997-9a809305d7ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-02749a03-d781-4bc6-9118-cce93fda066e tempest-CreateVolumesFromImageTest-2141915423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-02749a03-d781-4bc6-9118-cce93fda066e tempest-CreateVolumesFromImageTest-2141915423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-02749a03-d781-4bc6-9118-cce93fda066e tempest-CreateVolumesFromImageTest-2141915423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-02749a03-d781-4bc6-9118-cce93fda066e tempest-CreateVolumesFromImageTest-2141915423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-02749a03-d781-4bc6-9118-cce93fda066e tempest-CreateVolumesFromImageTest-2141915423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-02749a03-d781-4bc6-9118-cce93fda066e tempest-CreateVolumesFromImageTest-2141915423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:31 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-e886bac6-cf13-40bc-a90a-dbf4a2fa5f90 tempest-ProjectReaderTests-153927055 None] Created volume successfully. Nov 02 12:45:31 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:45:31 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-477d7731-bc3f-4117-ab3c-318f5eeaf95d tempest-CreateVolumesFromImageTest-2141915423 None] Acquiring lock "cinder-a2df8944-6455-48a5-b08a-3907fbc2648f-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-477d7731-bc3f-4117-ab3c-318f5eeaf95d tempest-CreateVolumesFromImageTest-2141915423 None] Lock "cinder-a2df8944-6455-48a5-b08a-3907fbc2648f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-870b3248-652c-422e-8449-7a8d62b4220d tempest-ProjectReaderTests-921411335 None] Acquiring lock "cinder-61f56866-e0b2-4577-a297-6fb1c781283c-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:31 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-870b3248-652c-422e-8449-7a8d62b4220d tempest-ProjectReaderTests-921411335 None] Lock "cinder-61f56866-e0b2-4577-a297-6fb1c781283c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e7585450-ea70-421e-b05a-d412e9dd6fb4 tempest-CinderUnicodeTest-1539770609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385" returned: 0 in 0.487s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e7585450-ea70-421e-b05a-d412e9dd6fb4 tempest-CinderUnicodeTest-1539770609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385.fb4857c6-02df-4c80-a32f-4353ff1c0149 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-477d7731-bc3f-4117-ab3c-318f5eeaf95d tempest-CreateVolumesFromImageTest-2141915423 None] Acquiring lock "cinder-quobyte-a2df8944-6455-48a5-b08a-3907fbc2648f" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:31 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385.fb4857c6-02df-4c80-a32f-4353ff1c0149 Nov 02 12:45:31 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-477d7731-bc3f-4117-ab3c-318f5eeaf95d tempest-CreateVolumesFromImageTest-2141915423 None] Lock "cinder-quobyte-a2df8944-6455-48a5-b08a-3907fbc2648f" acquired by "delete_volume" :: waited 0.041s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6944be7-8962-4f9f-ba8d-f977bcf530ba]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-477d7731-bc3f-4117-ab3c-318f5eeaf95d tempest-CreateVolumesFromImageTest-2141915423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a2df8944-6455-48a5-b08a-3907fbc2648f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:31 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-02749a03-d781-4bc6-9118-cce93fda066e tempest-CreateVolumesFromImageTest-2141915423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.327s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-02749a03-d781-4bc6-9118-cce93fda066e tempest-CreateVolumesFromImageTest-2141915423 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:45:31 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-02749a03-d781-4bc6-9118-cce93fda066e tempest-CreateVolumesFromImageTest-2141915423 None] Deleted volume successfully. Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-870b3248-652c-422e-8449-7a8d62b4220d tempest-ProjectReaderTests-921411335 None] Acquiring lock "cinder-quobyte-61f56866-e0b2-4577-a297-6fb1c781283c" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-02749a03-d781-4bc6-9118-cce93fda066e tempest-CreateVolumesFromImageTest-2141915423 None] Lock "cinder-9028bd11-a4f8-4ead-bcd2-9b36bca9903e-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-870b3248-652c-422e-8449-7a8d62b4220d tempest-ProjectReaderTests-921411335 None] Lock "cinder-quobyte-61f56866-e0b2-4577-a297-6fb1c781283c" acquired by "delete_volume" :: waited 0.035s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98890a7-fab0-4380-adc5-e2d2d47746c9]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-870b3248-652c-422e-8449-7a8d62b4220d tempest-ProjectReaderTests-921411335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-61f56866-e0b2-4577-a297-6fb1c781283c {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:31 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a2df8944-6455-48a5-b08a-3907fbc2648f Nov 02 12:45:31 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:32 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-61f56866-e0b2-4577-a297-6fb1c781283c Nov 02 12:45:32 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:32 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e7585450-ea70-421e-b05a-d412e9dd6fb4 tempest-CinderUnicodeTest-1539770609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385.fb4857c6-02df-4c80-a32f-4353ff1c0149" returned: 0 in 0.353s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e7585450-ea70-421e-b05a-d412e9dd6fb4 tempest-CinderUnicodeTest-1539770609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385.fb4857c6-02df-4c80-a32f-4353ff1c0149 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:32 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385.fb4857c6-02df-4c80-a32f-4353ff1c0149 Nov 02 12:45:32 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:32 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-477d7731-bc3f-4117-ab3c-318f5eeaf95d tempest-CreateVolumesFromImageTest-2141915423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a2df8944-6455-48a5-b08a-3907fbc2648f" returned: 0 in 0.418s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-477d7731-bc3f-4117-ab3c-318f5eeaf95d tempest-CreateVolumesFromImageTest-2141915423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a2df8944-6455-48a5-b08a-3907fbc2648f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:32 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a2df8944-6455-48a5-b08a-3907fbc2648f Nov 02 12:45:32 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:32 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:32 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e7585450-ea70-421e-b05a-d412e9dd6fb4 tempest-CinderUnicodeTest-1539770609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385.fb4857c6-02df-4c80-a32f-4353ff1c0149" returned: 0 in 0.254s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-870b3248-652c-422e-8449-7a8d62b4220d tempest-ProjectReaderTests-921411335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-61f56866-e0b2-4577-a297-6fb1c781283c" returned: 0 in 0.417s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-870b3248-652c-422e-8449-7a8d62b4220d tempest-ProjectReaderTests-921411335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-61f56866-e0b2-4577-a297-6fb1c781283c {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:32 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-61f56866-e0b2-4577-a297-6fb1c781283c Nov 02 12:45:32 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e7585450-ea70-421e-b05a-d412e9dd6fb4 tempest-CinderUnicodeTest-1539770609 None] Lock "cinder-quobyte-fb4857c6-02df-4c80-a32f-4353ff1c0149" released by "_delete_snapshot" :: held 1.652s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e7585450-ea70-421e-b05a-d412e9dd6fb4 tempest-CinderUnicodeTest-1539770609 None] Lock "cinder-quobyte-8d3061ca-f132-4dec-a1f1-83dfbc409385" released by "delete_snapshot" :: held 1.674s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-e7585450-ea70-421e-b05a-d412e9dd6fb4 tempest-CinderUnicodeTest-1539770609 None] Created reservations ['f8708f65-af27-4e00-ab1c-88d0b77a1f50', '2c747a42-d994-4647-9d27-9621d97eb25a', '1272c782-ce83-4f85-8293-b9447507f2de', 'f9f5ebca-d925-4e22-af2a-c7dc7d2e9aed'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:32 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-477d7731-bc3f-4117-ab3c-318f5eeaf95d tempest-CreateVolumesFromImageTest-2141915423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-a2df8944-6455-48a5-b08a-3907fbc2648f" returned: 0 in 0.299s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:32 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-e7585450-ea70-421e-b05a-d412e9dd6fb4 tempest-CinderUnicodeTest-1539770609 None] Delete snapshot completed successfully. Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-477d7731-bc3f-4117-ab3c-318f5eeaf95d tempest-CreateVolumesFromImageTest-2141915423 None] Lock "cinder-quobyte-a2df8944-6455-48a5-b08a-3907fbc2648f" released by "delete_volume" :: held 0.765s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e7585450-ea70-421e-b05a-d412e9dd6fb4 tempest-CinderUnicodeTest-1539770609 None] Lock "cinder-fb4857c6-02df-4c80-a32f-4353ff1c0149-delete_snapshot" released by "delete_snapshot" :: held 1.846s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-477d7731-bc3f-4117-ab3c-318f5eeaf95d tempest-CreateVolumesFromImageTest-2141915423 None] Created reservations ['342804de-a27d-4b85-bb94-b4faa3a6f01f', '5b0a0b91-ef9c-42c6-9659-2574cbbeaafb', '8ac231e8-0aec-4f65-a97f-622e7d1dc71a', 'c8f53ec5-640a-459a-9c0e-be8eb191075b'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:32 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-870b3248-652c-422e-8449-7a8d62b4220d tempest-ProjectReaderTests-921411335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-61f56866-e0b2-4577-a297-6fb1c781283c" returned: 0 in 0.302s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-870b3248-652c-422e-8449-7a8d62b4220d tempest-ProjectReaderTests-921411335 None] Lock "cinder-quobyte-61f56866-e0b2-4577-a297-6fb1c781283c" released by "delete_volume" :: held 0.773s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-477d7731-bc3f-4117-ab3c-318f5eeaf95d tempest-CreateVolumesFromImageTest-2141915423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-477d7731-bc3f-4117-ab3c-318f5eeaf95d tempest-CreateVolumesFromImageTest-2141915423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-477d7731-bc3f-4117-ab3c-318f5eeaf95d tempest-CreateVolumesFromImageTest-2141915423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-477d7731-bc3f-4117-ab3c-318f5eeaf95d tempest-CreateVolumesFromImageTest-2141915423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-477d7731-bc3f-4117-ab3c-318f5eeaf95d tempest-CreateVolumesFromImageTest-2141915423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-477d7731-bc3f-4117-ab3c-318f5eeaf95d tempest-CreateVolumesFromImageTest-2141915423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:32 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:45:32 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-870b3248-652c-422e-8449-7a8d62b4220d tempest-ProjectReaderTests-921411335 None] Created reservations ['33e995f0-8e03-4f0b-9637-71f1aff994f4', '5f6f9142-9eac-44ae-ad02-f6438e3225e1', '5dc472cc-00b6-4a61-b3f6-cf9ec6c3eff7', '354d2feb-7573-4b24-aeb4-815e7ecaa780'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0de078b7-699c-42ba-bd8a-d343417fb996 tempest-ProjectReaderTests-153927055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0de078b7-699c-42ba-bd8a-d343417fb996 tempest-ProjectReaderTests-153927055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-0de078b7-699c-42ba-bd8a-d343417fb996 tempest-ProjectReaderTests-153927055 None] Creating offline snapshot 6c50d292-9dee-4c14-a5a4-5fea1c4ba3a1 of volume cbdd6aca-2ef1-4109-9953-dfbd8a574b31 {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8b6647e6-2067-4e2a-8951-b93c23123b81 tempest-CreateVolumesFromImageTest-2141915423 None] Acquiring lock "cinder-590077bc-279c-44f1-aab3-cf3631380227-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8b6647e6-2067-4e2a-8951-b93c23123b81 tempest-CreateVolumesFromImageTest-2141915423 None] Lock "cinder-590077bc-279c-44f1-aab3-cf3631380227-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3a55ec-2af0-46e2-b135-db8b763d2e46]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0de078b7-699c-42ba-bd8a-d343417fb996 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-870b3248-652c-422e-8449-7a8d62b4220d tempest-ProjectReaderTests-921411335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-870b3248-652c-422e-8449-7a8d62b4220d tempest-ProjectReaderTests-921411335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-870b3248-652c-422e-8449-7a8d62b4220d tempest-ProjectReaderTests-921411335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-870b3248-652c-422e-8449-7a8d62b4220d tempest-ProjectReaderTests-921411335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-870b3248-652c-422e-8449-7a8d62b4220d tempest-ProjectReaderTests-921411335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-870b3248-652c-422e-8449-7a8d62b4220d tempest-ProjectReaderTests-921411335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:32 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:45:32 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:32 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8b6647e6-2067-4e2a-8951-b93c23123b81 tempest-CreateVolumesFromImageTest-2141915423 None] Acquiring lock "cinder-quobyte-590077bc-279c-44f1-aab3-cf3631380227" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9999b167-29e1-4bab-9ef0-c374f0dd345c tempest-CinderUnicodeTest-1539770609 None] Acquiring lock "cinder-8d3061ca-f132-4dec-a1f1-83dfbc409385-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8b6647e6-2067-4e2a-8951-b93c23123b81 tempest-CreateVolumesFromImageTest-2141915423 None] Lock "cinder-quobyte-590077bc-279c-44f1-aab3-cf3631380227" acquired by "delete_volume" :: waited 0.048s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:33 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31 Nov 02 12:45:33 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[4561b12e-eacd-4898-bbc1-28cbfab7da9c]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8b6647e6-2067-4e2a-8951-b93c23123b81 tempest-CreateVolumesFromImageTest-2141915423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-590077bc-279c-44f1-aab3-cf3631380227 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9999b167-29e1-4bab-9ef0-c374f0dd345c tempest-CinderUnicodeTest-1539770609 None] Lock "cinder-8d3061ca-f132-4dec-a1f1-83dfbc409385-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:33 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-477d7731-bc3f-4117-ab3c-318f5eeaf95d tempest-CreateVolumesFromImageTest-2141915423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.441s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-477d7731-bc3f-4117-ab3c-318f5eeaf95d tempest-CreateVolumesFromImageTest-2141915423 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:45:33 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-477d7731-bc3f-4117-ab3c-318f5eeaf95d tempest-CreateVolumesFromImageTest-2141915423 None] Deleted volume successfully. Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9999b167-29e1-4bab-9ef0-c374f0dd345c tempest-CinderUnicodeTest-1539770609 None] Acquiring lock "cinder-quobyte-8d3061ca-f132-4dec-a1f1-83dfbc409385" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:33 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-590077bc-279c-44f1-aab3-cf3631380227 Nov 02 12:45:33 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:33 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-870b3248-652c-422e-8449-7a8d62b4220d tempest-ProjectReaderTests-921411335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.347s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-870b3248-652c-422e-8449-7a8d62b4220d tempest-ProjectReaderTests-921411335 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-477d7731-bc3f-4117-ab3c-318f5eeaf95d tempest-CreateVolumesFromImageTest-2141915423 None] Lock "cinder-a2df8944-6455-48a5-b08a-3907fbc2648f-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:33 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-870b3248-652c-422e-8449-7a8d62b4220d tempest-ProjectReaderTests-921411335 None] Deleted volume successfully. Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9999b167-29e1-4bab-9ef0-c374f0dd345c tempest-CinderUnicodeTest-1539770609 None] Lock "cinder-quobyte-8d3061ca-f132-4dec-a1f1-83dfbc409385" acquired by "delete_volume" :: waited 0.046s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-870b3248-652c-422e-8449-7a8d62b4220d tempest-ProjectReaderTests-921411335 None] Lock "cinder-61f56866-e0b2-4577-a297-6fb1c781283c-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[0884a31c-c629-4bbf-a8a2-7ab1733649db]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9999b167-29e1-4bab-9ef0-c374f0dd345c tempest-CinderUnicodeTest-1539770609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:33 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0de078b7-699c-42ba-bd8a-d343417fb996 tempest-ProjectReaderTests-153927055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31" returned: 0 in 0.554s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0de078b7-699c-42ba-bd8a-d343417fb996 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31.6c50d292-9dee-4c14-a5a4-5fea1c4ba3a1 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:33 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31.6c50d292-9dee-4c14-a5a4-5fea1c4ba3a1 1G Nov 02 12:45:33 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:33 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385 Nov 02 12:45:33 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:33 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8b6647e6-2067-4e2a-8951-b93c23123b81 tempest-CreateVolumesFromImageTest-2141915423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-590077bc-279c-44f1-aab3-cf3631380227" returned: 0 in 0.509s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8b6647e6-2067-4e2a-8951-b93c23123b81 tempest-CreateVolumesFromImageTest-2141915423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-590077bc-279c-44f1-aab3-cf3631380227 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:33 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-590077bc-279c-44f1-aab3-cf3631380227 Nov 02 12:45:33 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-5440297e-dd1d-4df2-afad-f8ec8693b8cc tempest-ProjectReaderTests-921411335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5440297e-dd1d-4df2-afad-f8ec8693b8cc tempest-ProjectReaderTests-921411335 None] Flow 'volume_create_manager' (48f5d022-7b1a-4ebe-8802-7efe6fdf4dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5440297e-dd1d-4df2-afad-f8ec8693b8cc tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc899026-394d-4b2f-aad9-307308c6368f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:33 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5440297e-dd1d-4df2-afad-f8ec8693b8cc tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc899026-394d-4b2f-aad9-307308c6368f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1922622399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b755413-2691-47f1-92d2-cd35479faa08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0558d822624340139a509d568f744b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:34Z,use_quota=True,user_id='2fe97f4e0d5e40b9a433d3972ba06d21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5440297e-dd1d-4df2-afad-f8ec8693b8cc tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9b9b79d-0ead-4431-8164-2bb55eb44042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5440297e-dd1d-4df2-afad-f8ec8693b8cc tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9b9b79d-0ead-4431-8164-2bb55eb44042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5440297e-dd1d-4df2-afad-f8ec8693b8cc tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bac56338-f92e-457b-b63e-7dcfb656d5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5440297e-dd1d-4df2-afad-f8ec8693b8cc tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bac56338-f92e-457b-b63e-7dcfb656d5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b755413-2691-47f1-92d2-cd35479faa08', 'volume_name': 'volume-1b755413-2691-47f1-92d2-cd35479faa08', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5440297e-dd1d-4df2-afad-f8ec8693b8cc tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a8fd974-40db-4ab8-ac3f-e2f9bb3b62c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5440297e-dd1d-4df2-afad-f8ec8693b8cc tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a8fd974-40db-4ab8-ac3f-e2f9bb3b62c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5440297e-dd1d-4df2-afad-f8ec8693b8cc tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc677fcd-e0d1-419d-b73f-b15fe8a97c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:33 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-5440297e-dd1d-4df2-afad-f8ec8693b8cc tempest-ProjectReaderTests-921411335 None] Volume 1b755413-2691-47f1-92d2-cd35479faa08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b755413-2691-47f1-92d2-cd35479faa08', 'volume_size': 1} Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5440297e-dd1d-4df2-afad-f8ec8693b8cc tempest-ProjectReaderTests-921411335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9999b167-29e1-4bab-9ef0-c374f0dd345c tempest-CinderUnicodeTest-1539770609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385" returned: 0 in 0.549s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9999b167-29e1-4bab-9ef0-c374f0dd345c tempest-CinderUnicodeTest-1539770609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:33 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385 Nov 02 12:45:33 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:33 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0de078b7-699c-42ba-bd8a-d343417fb996 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31.6c50d292-9dee-4c14-a5a4-5fea1c4ba3a1 1G" returned: 0 in 0.500s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:33 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0de078b7-699c-42ba-bd8a-d343417fb996 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31.6c50d292-9dee-4c14-a5a4-5fea1c4ba3a1 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8b6647e6-2067-4e2a-8951-b93c23123b81 tempest-CreateVolumesFromImageTest-2141915423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-590077bc-279c-44f1-aab3-cf3631380227" returned: 0 in 0.341s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8b6647e6-2067-4e2a-8951-b93c23123b81 tempest-CreateVolumesFromImageTest-2141915423 None] Lock "cinder-quobyte-590077bc-279c-44f1-aab3-cf3631380227" released by "delete_volume" :: held 0.932s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:33 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31.6c50d292-9dee-4c14-a5a4-5fea1c4ba3a1 Nov 02 12:45:33 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:33 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-8b6647e6-2067-4e2a-8951-b93c23123b81 tempest-CreateVolumesFromImageTest-2141915423 None] Created reservations ['6733c20b-0e61-4fb5-ae75-a8e2ef663117', 'bba50449-5305-469e-a61b-fe763f4e5391', '6c11a29a-25b8-4766-a416-68550bf04557', '0decff30-2c65-41a5-8e25-950b2613aad7'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8b6647e6-2067-4e2a-8951-b93c23123b81 tempest-CreateVolumesFromImageTest-2141915423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8b6647e6-2067-4e2a-8951-b93c23123b81 tempest-CreateVolumesFromImageTest-2141915423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8b6647e6-2067-4e2a-8951-b93c23123b81 tempest-CreateVolumesFromImageTest-2141915423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8b6647e6-2067-4e2a-8951-b93c23123b81 tempest-CreateVolumesFromImageTest-2141915423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8b6647e6-2067-4e2a-8951-b93c23123b81 tempest-CreateVolumesFromImageTest-2141915423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8b6647e6-2067-4e2a-8951-b93c23123b81 tempest-CreateVolumesFromImageTest-2141915423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:34 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:45:34 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:34 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9999b167-29e1-4bab-9ef0-c374f0dd345c tempest-CinderUnicodeTest-1539770609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d3061ca-f132-4dec-a1f1-83dfbc409385" returned: 0 in 0.315s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:34 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9999b167-29e1-4bab-9ef0-c374f0dd345c tempest-CinderUnicodeTest-1539770609 None] Lock "cinder-quobyte-8d3061ca-f132-4dec-a1f1-83dfbc409385" released by "delete_volume" :: held 0.939s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:34 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0de078b7-699c-42ba-bd8a-d343417fb996 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31.6c50d292-9dee-4c14-a5a4-5fea1c4ba3a1" returned: 0 in 0.311s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:34 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-0de078b7-699c-42ba-bd8a-d343417fb996 tempest-ProjectReaderTests-153927055 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31.6c50d292-9dee-4c14-a5a4-5fea1c4ba3a1 is being set with open permissions: ugo+rw Nov 02 12:45:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0de078b7-699c-42ba-bd8a-d343417fb996 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31.6c50d292-9dee-4c14-a5a4-5fea1c4ba3a1 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:34 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31.6c50d292-9dee-4c14-a5a4-5fea1c4ba3a1 Nov 02 12:45:34 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:34 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-9999b167-29e1-4bab-9ef0-c374f0dd345c tempest-CinderUnicodeTest-1539770609 None] Created reservations ['a4e8ea93-a801-40bc-89f6-16572883c324', 'e2544af8-e05c-4e66-9a28-f28f69ac20e9', 'd5d66705-1c8c-4350-93f4-26b16bb5b07d', 'fdf48d12-0da6-4630-a6e1-3d1feedfde51'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-9999b167-29e1-4bab-9ef0-c374f0dd345c tempest-CinderUnicodeTest-1539770609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-9999b167-29e1-4bab-9ef0-c374f0dd345c tempest-CinderUnicodeTest-1539770609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-9999b167-29e1-4bab-9ef0-c374f0dd345c tempest-CinderUnicodeTest-1539770609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-9999b167-29e1-4bab-9ef0-c374f0dd345c tempest-CinderUnicodeTest-1539770609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-9999b167-29e1-4bab-9ef0-c374f0dd345c tempest-CinderUnicodeTest-1539770609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9999b167-29e1-4bab-9ef0-c374f0dd345c tempest-CinderUnicodeTest-1539770609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:34 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8b6647e6-2067-4e2a-8951-b93c23123b81 tempest-CreateVolumesFromImageTest-2141915423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.283s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:34 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-8b6647e6-2067-4e2a-8951-b93c23123b81 tempest-CreateVolumesFromImageTest-2141915423 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:45:34 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:45:34 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-8b6647e6-2067-4e2a-8951-b93c23123b81 tempest-CreateVolumesFromImageTest-2141915423 None] Deleted volume successfully. Nov 02 12:45:34 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:34 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8b6647e6-2067-4e2a-8951-b93c23123b81 tempest-CreateVolumesFromImageTest-2141915423 None] Lock "cinder-590077bc-279c-44f1-aab3-cf3631380227-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:34 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0de078b7-699c-42ba-bd8a-d343417fb996 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31.6c50d292-9dee-4c14-a5a4-5fea1c4ba3a1" returned: 0 in 0.249s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0de078b7-699c-42ba-bd8a-d343417fb996 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:34 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31.info Nov 02 12:45:34 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:34 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9999b167-29e1-4bab-9ef0-c374f0dd345c tempest-CinderUnicodeTest-1539770609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.256s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:34 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-9999b167-29e1-4bab-9ef0-c374f0dd345c tempest-CinderUnicodeTest-1539770609 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:45:34 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-9999b167-29e1-4bab-9ef0-c374f0dd345c tempest-CinderUnicodeTest-1539770609 None] Deleted volume successfully. Nov 02 12:45:34 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9999b167-29e1-4bab-9ef0-c374f0dd345c tempest-CinderUnicodeTest-1539770609 None] Lock "cinder-8d3061ca-f132-4dec-a1f1-83dfbc409385-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:34 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0de078b7-699c-42ba-bd8a-d343417fb996 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31.info" returned: 0 in 0.248s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:34 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-0de078b7-699c-42ba-bd8a-d343417fb996 tempest-ProjectReaderTests-153927055 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31.info is being set with open permissions: ugo+rw Nov 02 12:45:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0de078b7-699c-42ba-bd8a-d343417fb996 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:34 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31.info Nov 02 12:45:34 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:34 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0de078b7-699c-42ba-bd8a-d343417fb996 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31.info" returned: 0 in 0.224s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0de078b7-699c-42ba-bd8a-d343417fb996 tempest-ProjectReaderTests-153927055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.219s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5440297e-dd1d-4df2-afad-f8ec8693b8cc tempest-ProjectReaderTests-921411335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.134s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:35 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5440297e-dd1d-4df2-afad-f8ec8693b8cc tempest-ProjectReaderTests-921411335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1922622399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b755413-2691-47f1-92d2-cd35479faa08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0558d822624340139a509d568f744b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:34Z,use_quota=True,user_id='2fe97f4e0d5e40b9a433d3972ba06d21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:45:35 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-5440297e-dd1d-4df2-afad-f8ec8693b8cc tempest-ProjectReaderTests-921411335 None] Creating volume 1b755413-2691-47f1-92d2-cd35479faa08 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:45:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5440297e-dd1d-4df2-afad-f8ec8693b8cc tempest-ProjectReaderTests-921411335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5440297e-dd1d-4df2-afad-f8ec8693b8cc tempest-ProjectReaderTests-921411335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:35 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5440297e-dd1d-4df2-afad-f8ec8693b8cc tempest-ProjectReaderTests-921411335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:35 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5440297e-dd1d-4df2-afad-f8ec8693b8cc tempest-ProjectReaderTests-921411335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5440297e-dd1d-4df2-afad-f8ec8693b8cc tempest-ProjectReaderTests-921411335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:35 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5440297e-dd1d-4df2-afad-f8ec8693b8cc tempest-ProjectReaderTests-921411335 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:45:35 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-5440297e-dd1d-4df2-afad-f8ec8693b8cc tempest-ProjectReaderTests-921411335 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:45:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5440297e-dd1d-4df2-afad-f8ec8693b8cc tempest-ProjectReaderTests-921411335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1b755413-2691-47f1-92d2-cd35479faa08 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:35 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1b755413-2691-47f1-92d2-cd35479faa08 1073741824 Nov 02 12:45:35 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:35 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-0de078b7-699c-42ba-bd8a-d343417fb996 tempest-ProjectReaderTests-153927055 None] Create snapshot completed successfully Nov 02 12:45:35 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c9cca372-ba26-45e4-8899-792e6266a24b tempest-CinderUnicodeTest-1539770609 None] Acquiring lock "cinder-28db15ee-4f2f-4682-9781-37971f19579c-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:35 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c9cca372-ba26-45e4-8899-792e6266a24b tempest-CinderUnicodeTest-1539770609 None] Lock "cinder-28db15ee-4f2f-4682-9781-37971f19579c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:35 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c9cca372-ba26-45e4-8899-792e6266a24b tempest-CinderUnicodeTest-1539770609 None] Acquiring lock "cinder-quobyte-28db15ee-4f2f-4682-9781-37971f19579c" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:35 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c9cca372-ba26-45e4-8899-792e6266a24b tempest-CinderUnicodeTest-1539770609 None] Lock "cinder-quobyte-28db15ee-4f2f-4682-9781-37971f19579c" acquired by "delete_volume" :: waited 0.018s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:35 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[818f0c7b-536d-4655-898f-ee169e81d46e]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c9cca372-ba26-45e4-8899-792e6266a24b tempest-CinderUnicodeTest-1539770609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-28db15ee-4f2f-4682-9781-37971f19579c {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:35 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-28db15ee-4f2f-4682-9781-37971f19579c Nov 02 12:45:35 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:35 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5440297e-dd1d-4df2-afad-f8ec8693b8cc tempest-ProjectReaderTests-921411335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1b755413-2691-47f1-92d2-cd35479faa08 1073741824" returned: 0 in 0.529s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5440297e-dd1d-4df2-afad-f8ec8693b8cc tempest-ProjectReaderTests-921411335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1b755413-2691-47f1-92d2-cd35479faa08 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:35 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1b755413-2691-47f1-92d2-cd35479faa08 Nov 02 12:45:35 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:35 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c9cca372-ba26-45e4-8899-792e6266a24b tempest-CinderUnicodeTest-1539770609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-28db15ee-4f2f-4682-9781-37971f19579c" returned: 0 in 0.452s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c9cca372-ba26-45e4-8899-792e6266a24b tempest-CinderUnicodeTest-1539770609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-28db15ee-4f2f-4682-9781-37971f19579c {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:35 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-28db15ee-4f2f-4682-9781-37971f19579c Nov 02 12:45:35 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:35 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5440297e-dd1d-4df2-afad-f8ec8693b8cc tempest-ProjectReaderTests-921411335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1b755413-2691-47f1-92d2-cd35479faa08" returned: 0 in 0.362s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:35 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5440297e-dd1d-4df2-afad-f8ec8693b8cc tempest-ProjectReaderTests-921411335 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:45:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5440297e-dd1d-4df2-afad-f8ec8693b8cc tempest-ProjectReaderTests-921411335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:35 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5440297e-dd1d-4df2-afad-f8ec8693b8cc tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc677fcd-e0d1-419d-b73f-b15fe8a97c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b755413-2691-47f1-92d2-cd35479faa08', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:35 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5440297e-dd1d-4df2-afad-f8ec8693b8cc tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc204795-b54a-4bf3-9bb9-a1525bcb3fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:35 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-5440297e-dd1d-4df2-afad-f8ec8693b8cc tempest-ProjectReaderTests-921411335 None] Volume volume-1b755413-2691-47f1-92d2-cd35479faa08 (1b755413-2691-47f1-92d2-cd35479faa08): created successfully Nov 02 12:45:35 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5440297e-dd1d-4df2-afad-f8ec8693b8cc tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc204795-b54a-4bf3-9bb9-a1525bcb3fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5440297e-dd1d-4df2-afad-f8ec8693b8cc tempest-ProjectReaderTests-921411335 None] Flow 'volume_create_manager' (48f5d022-7b1a-4ebe-8802-7efe6fdf4dde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:36 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-5440297e-dd1d-4df2-afad-f8ec8693b8cc tempest-ProjectReaderTests-921411335 None] Created volume successfully. Nov 02 12:45:36 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:36 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a74624d2-6499-409e-99e6-49bf3fdd9d58 tempest-ProjectReaderTests-153927055 None] Acquiring lock "cinder-6c50d292-9dee-4c14-a5a4-5fea1c4ba3a1-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c9cca372-ba26-45e4-8899-792e6266a24b tempest-CinderUnicodeTest-1539770609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-28db15ee-4f2f-4682-9781-37971f19579c" returned: 0 in 0.328s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:36 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c9cca372-ba26-45e4-8899-792e6266a24b tempest-CinderUnicodeTest-1539770609 None] Lock "cinder-quobyte-28db15ee-4f2f-4682-9781-37971f19579c" released by "delete_volume" :: held 0.834s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:36 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a74624d2-6499-409e-99e6-49bf3fdd9d58 tempest-ProjectReaderTests-153927055 None] Lock "cinder-6c50d292-9dee-4c14-a5a4-5fea1c4ba3a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:36 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a74624d2-6499-409e-99e6-49bf3fdd9d58 tempest-ProjectReaderTests-153927055 None] Acquiring lock "cinder-quobyte-cbdd6aca-2ef1-4109-9953-dfbd8a574b31" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:36 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a74624d2-6499-409e-99e6-49bf3fdd9d58 tempest-ProjectReaderTests-153927055 None] Lock "cinder-quobyte-cbdd6aca-2ef1-4109-9953-dfbd8a574b31" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:36 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a74624d2-6499-409e-99e6-49bf3fdd9d58 tempest-ProjectReaderTests-153927055 None] Acquiring lock "cinder-quobyte-6c50d292-9dee-4c14-a5a4-5fea1c4ba3a1" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:36 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a74624d2-6499-409e-99e6-49bf3fdd9d58 tempest-ProjectReaderTests-153927055 None] Lock "cinder-quobyte-6c50d292-9dee-4c14-a5a4-5fea1c4ba3a1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-a74624d2-6499-409e-99e6-49bf3fdd9d58 tempest-ProjectReaderTests-153927055 None] Deleting offline snapshot 6c50d292-9dee-4c14-a5a4-5fea1c4ba3a1 of volume cbdd6aca-2ef1-4109-9953-dfbd8a574b31 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:45:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-a74624d2-6499-409e-99e6-49bf3fdd9d58 tempest-ProjectReaderTests-153927055 None] snapshot_file for this snap is: volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31.6c50d292-9dee-4c14-a5a4-5fea1c4ba3a1 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:45:36 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bad6c6d-c7ec-4573-ad82-95ea36a10561]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a74624d2-6499-409e-99e6-49bf3fdd9d58 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31.6c50d292-9dee-4c14-a5a4-5fea1c4ba3a1 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:36 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-c9cca372-ba26-45e4-8899-792e6266a24b tempest-CinderUnicodeTest-1539770609 None] Created reservations ['25fb7e00-ecd0-4335-8004-42ab3fbd49b3', '4de4df1a-3f4a-4ee3-91dd-ea0f6af17022', '62786470-0011-4689-a273-baa87e74e380', '87626842-5a7a-49a8-97f2-5fda25370094'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c9cca372-ba26-45e4-8899-792e6266a24b tempest-CinderUnicodeTest-1539770609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c9cca372-ba26-45e4-8899-792e6266a24b tempest-CinderUnicodeTest-1539770609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-c9cca372-ba26-45e4-8899-792e6266a24b tempest-CinderUnicodeTest-1539770609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-c9cca372-ba26-45e4-8899-792e6266a24b tempest-CinderUnicodeTest-1539770609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c9cca372-ba26-45e4-8899-792e6266a24b tempest-CinderUnicodeTest-1539770609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c9cca372-ba26-45e4-8899-792e6266a24b tempest-CinderUnicodeTest-1539770609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:36 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31.6c50d292-9dee-4c14-a5a4-5fea1c4ba3a1 Nov 02 12:45:36 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:36 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:45:36 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:36 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c9cca372-ba26-45e4-8899-792e6266a24b tempest-CinderUnicodeTest-1539770609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.317s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:36 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-c9cca372-ba26-45e4-8899-792e6266a24b tempest-CinderUnicodeTest-1539770609 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:45:36 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-c9cca372-ba26-45e4-8899-792e6266a24b tempest-CinderUnicodeTest-1539770609 None] Deleted volume successfully. Nov 02 12:45:36 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c9cca372-ba26-45e4-8899-792e6266a24b tempest-CinderUnicodeTest-1539770609 None] Lock "cinder-28db15ee-4f2f-4682-9781-37971f19579c-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:36 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a74624d2-6499-409e-99e6-49bf3fdd9d58 tempest-ProjectReaderTests-153927055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31.6c50d292-9dee-4c14-a5a4-5fea1c4ba3a1" returned: 0 in 0.491s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-a74624d2-6499-409e-99e6-49bf3fdd9d58 tempest-ProjectReaderTests-153927055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:45:36 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86379db-41e6-4223-81ab-463de6fc05c2]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a74624d2-6499-409e-99e6-49bf3fdd9d58 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:36 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31 Nov 02 12:45:36 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:37 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-555340c6-fb10-4a1b-8510-dd74594ec380 tempest-ProjectReaderTests-921411335 None] Acquiring lock "cinder-1b755413-2691-47f1-92d2-cd35479faa08-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:37 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-555340c6-fb10-4a1b-8510-dd74594ec380 tempest-ProjectReaderTests-921411335 None] Lock "cinder-1b755413-2691-47f1-92d2-cd35479faa08-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:37 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-555340c6-fb10-4a1b-8510-dd74594ec380 tempest-ProjectReaderTests-921411335 None] Acquiring lock "cinder-quobyte-1b755413-2691-47f1-92d2-cd35479faa08" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:37 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-555340c6-fb10-4a1b-8510-dd74594ec380 tempest-ProjectReaderTests-921411335 None] Lock "cinder-quobyte-1b755413-2691-47f1-92d2-cd35479faa08" acquired by "delete_volume" :: waited 0.021s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:37 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d6b7b0-0757-42f7-8b9a-a09c951e4c3b]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-555340c6-fb10-4a1b-8510-dd74594ec380 tempest-ProjectReaderTests-921411335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1b755413-2691-47f1-92d2-cd35479faa08 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:37 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a74624d2-6499-409e-99e6-49bf3fdd9d58 tempest-ProjectReaderTests-153927055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31" returned: 0 in 0.479s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a74624d2-6499-409e-99e6-49bf3fdd9d58 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31.6c50d292-9dee-4c14-a5a4-5fea1c4ba3a1 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:37 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31.6c50d292-9dee-4c14-a5a4-5fea1c4ba3a1 Nov 02 12:45:37 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:37 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1b755413-2691-47f1-92d2-cd35479faa08 Nov 02 12:45:37 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:37 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:37 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-555340c6-fb10-4a1b-8510-dd74594ec380 tempest-ProjectReaderTests-921411335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1b755413-2691-47f1-92d2-cd35479faa08" returned: 0 in 0.443s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a74624d2-6499-409e-99e6-49bf3fdd9d58 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31.6c50d292-9dee-4c14-a5a4-5fea1c4ba3a1" returned: 0 in 0.421s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-555340c6-fb10-4a1b-8510-dd74594ec380 tempest-ProjectReaderTests-921411335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1b755413-2691-47f1-92d2-cd35479faa08 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a74624d2-6499-409e-99e6-49bf3fdd9d58 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31.6c50d292-9dee-4c14-a5a4-5fea1c4ba3a1 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:37 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1b755413-2691-47f1-92d2-cd35479faa08 Nov 02 12:45:37 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:37 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31.6c50d292-9dee-4c14-a5a4-5fea1c4ba3a1 Nov 02 12:45:37 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:38 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-555340c6-fb10-4a1b-8510-dd74594ec380 tempest-ProjectReaderTests-921411335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1b755413-2691-47f1-92d2-cd35479faa08" returned: 0 in 0.287s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:38 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a74624d2-6499-409e-99e6-49bf3fdd9d58 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31.6c50d292-9dee-4c14-a5a4-5fea1c4ba3a1" returned: 0 in 0.301s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:38 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-555340c6-fb10-4a1b-8510-dd74594ec380 tempest-ProjectReaderTests-921411335 None] Lock "cinder-quobyte-1b755413-2691-47f1-92d2-cd35479faa08" released by "delete_volume" :: held 0.832s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:38 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a74624d2-6499-409e-99e6-49bf3fdd9d58 tempest-ProjectReaderTests-153927055 None] Lock "cinder-quobyte-6c50d292-9dee-4c14-a5a4-5fea1c4ba3a1" released by "_delete_snapshot" :: held 1.842s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:38 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a74624d2-6499-409e-99e6-49bf3fdd9d58 tempest-ProjectReaderTests-153927055 None] Lock "cinder-quobyte-cbdd6aca-2ef1-4109-9953-dfbd8a574b31" released by "delete_snapshot" :: held 1.875s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:38 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-555340c6-fb10-4a1b-8510-dd74594ec380 tempest-ProjectReaderTests-921411335 None] Created reservations ['79dfc3f4-81ab-4694-adb9-f20fb0e0c9dc', '3029a762-9caa-4b17-943b-0cd7e047e707', 'a447c059-4f5b-4543-ac19-f571babcd402', '8d75a0cf-a5fb-4edf-92bf-a530c0af917c'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:38 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-a74624d2-6499-409e-99e6-49bf3fdd9d58 tempest-ProjectReaderTests-153927055 None] Created reservations ['8d49b707-5886-4cb0-92c1-c1ffa4e0360b', '93920806-b94c-4e57-9266-2c60f53c1f37', '8d139e06-c8c4-4f29-9c90-a5b001c3f728', '66046b39-1844-4fe7-a8ed-9f3d47d74ec8'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-555340c6-fb10-4a1b-8510-dd74594ec380 tempest-ProjectReaderTests-921411335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-555340c6-fb10-4a1b-8510-dd74594ec380 tempest-ProjectReaderTests-921411335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:38 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-555340c6-fb10-4a1b-8510-dd74594ec380 tempest-ProjectReaderTests-921411335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:38 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-555340c6-fb10-4a1b-8510-dd74594ec380 tempest-ProjectReaderTests-921411335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-555340c6-fb10-4a1b-8510-dd74594ec380 tempest-ProjectReaderTests-921411335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-555340c6-fb10-4a1b-8510-dd74594ec380 tempest-ProjectReaderTests-921411335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:38 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:45:38 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:38 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-a74624d2-6499-409e-99e6-49bf3fdd9d58 tempest-ProjectReaderTests-153927055 None] Delete snapshot completed successfully. Nov 02 12:45:38 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-a74624d2-6499-409e-99e6-49bf3fdd9d58 tempest-ProjectReaderTests-153927055 None] Lock "cinder-6c50d292-9dee-4c14-a5a4-5fea1c4ba3a1-delete_snapshot" released by "delete_snapshot" :: held 2.129s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:38 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-555340c6-fb10-4a1b-8510-dd74594ec380 tempest-ProjectReaderTests-921411335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.337s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:38 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-555340c6-fb10-4a1b-8510-dd74594ec380 tempest-ProjectReaderTests-921411335 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:45:38 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-555340c6-fb10-4a1b-8510-dd74594ec380 tempest-ProjectReaderTests-921411335 None] Deleted volume successfully. Nov 02 12:45:38 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-555340c6-fb10-4a1b-8510-dd74594ec380 tempest-ProjectReaderTests-921411335 None] Lock "cinder-1b755413-2691-47f1-92d2-cd35479faa08-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:38 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-308e7fdb-3558-4dfe-9670-4998561746e5 tempest-ProjectReaderTests-153927055 None] Acquiring lock "cinder-cbdd6aca-2ef1-4109-9953-dfbd8a574b31-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:38 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-308e7fdb-3558-4dfe-9670-4998561746e5 tempest-ProjectReaderTests-153927055 None] Lock "cinder-cbdd6aca-2ef1-4109-9953-dfbd8a574b31-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:38 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-308e7fdb-3558-4dfe-9670-4998561746e5 tempest-ProjectReaderTests-153927055 None] Acquiring lock "cinder-quobyte-cbdd6aca-2ef1-4109-9953-dfbd8a574b31" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:38 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-308e7fdb-3558-4dfe-9670-4998561746e5 tempest-ProjectReaderTests-153927055 None] Lock "cinder-quobyte-cbdd6aca-2ef1-4109-9953-dfbd8a574b31" acquired by "delete_volume" :: waited 0.023s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:38 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0564991-d763-420b-982e-7d716fb5db0e]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-308e7fdb-3558-4dfe-9670-4998561746e5 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:39 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31 Nov 02 12:45:39 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-e72bce3b-9e7a-4ef2-8696-750551ffc007 tempest-CreateVolumesFromSnapshotTest-278666822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e72bce3b-9e7a-4ef2-8696-750551ffc007 tempest-CreateVolumesFromSnapshotTest-278666822 None] Flow 'volume_create_manager' (bdf721b3-d81a-482d-93e4-1b620afaa03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e72bce3b-9e7a-4ef2-8696-750551ffc007 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e6efe4-3ccb-43f6-8cf4-b71918e65b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e72bce3b-9e7a-4ef2-8696-750551ffc007 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63e6efe4-3ccb-43f6-8cf4-b71918e65b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-316857375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e02d4e74-e545-4e8c-8112-4873b93e7a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce877e21e4b14f8e954bcd6d98b8d237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:39Z,use_quota=True,user_id='dacbce82b49e4514894656b674c09c0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e72bce3b-9e7a-4ef2-8696-750551ffc007 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ae47472-f627-4c81-b4fe-3c92052dcffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e72bce3b-9e7a-4ef2-8696-750551ffc007 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ae47472-f627-4c81-b4fe-3c92052dcffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e72bce3b-9e7a-4ef2-8696-750551ffc007 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bfc9a89-a5b7-45bb-9ad9-3d5eca58126b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e72bce3b-9e7a-4ef2-8696-750551ffc007 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bfc9a89-a5b7-45bb-9ad9-3d5eca58126b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e02d4e74-e545-4e8c-8112-4873b93e7a87', 'volume_name': 'volume-e02d4e74-e545-4e8c-8112-4873b93e7a87', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e72bce3b-9e7a-4ef2-8696-750551ffc007 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45dfa24f-e399-4f68-a8f1-c9337e82c84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e72bce3b-9e7a-4ef2-8696-750551ffc007 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45dfa24f-e399-4f68-a8f1-c9337e82c84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e72bce3b-9e7a-4ef2-8696-750551ffc007 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c10cea-1e57-4a5a-8ea6-6cfab912d3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:39 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-e72bce3b-9e7a-4ef2-8696-750551ffc007 tempest-CreateVolumesFromSnapshotTest-278666822 None] Volume e02d4e74-e545-4e8c-8112-4873b93e7a87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e02d4e74-e545-4e8c-8112-4873b93e7a87', 'volume_size': 1} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e72bce3b-9e7a-4ef2-8696-750551ffc007 tempest-CreateVolumesFromSnapshotTest-278666822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e72bce3b-9e7a-4ef2-8696-750551ffc007 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e72bce3b-9e7a-4ef2-8696-750551ffc007 tempest-CreateVolumesFromSnapshotTest-278666822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-316857375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e02d4e74-e545-4e8c-8112-4873b93e7a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce877e21e4b14f8e954bcd6d98b8d237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:39Z,use_quota=True,user_id='dacbce82b49e4514894656b674c09c0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-e72bce3b-9e7a-4ef2-8696-750551ffc007 tempest-CreateVolumesFromSnapshotTest-278666822 None] Creating volume e02d4e74-e545-4e8c-8112-4873b93e7a87 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e72bce3b-9e7a-4ef2-8696-750551ffc007 tempest-CreateVolumesFromSnapshotTest-278666822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e72bce3b-9e7a-4ef2-8696-750551ffc007 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e72bce3b-9e7a-4ef2-8696-750551ffc007 tempest-CreateVolumesFromSnapshotTest-278666822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e72bce3b-9e7a-4ef2-8696-750551ffc007 tempest-CreateVolumesFromSnapshotTest-278666822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e72bce3b-9e7a-4ef2-8696-750551ffc007 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e72bce3b-9e7a-4ef2-8696-750551ffc007 tempest-CreateVolumesFromSnapshotTest-278666822 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:45:39 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-e72bce3b-9e7a-4ef2-8696-750551ffc007 tempest-CreateVolumesFromSnapshotTest-278666822 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e72bce3b-9e7a-4ef2-8696-750551ffc007 tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-db3f7304-a5b3-42ca-b423-040b73df3a46 tempest-ProjectReaderTests-921411335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:45:39 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87 1073741824 Nov 02 12:45:39 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-db3f7304-a5b3-42ca-b423-040b73df3a46 tempest-ProjectReaderTests-921411335 None] Flow 'volume_create_manager' (377afe93-05c2-4fff-b4f2-c49db6142f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-db3f7304-a5b3-42ca-b423-040b73df3a46 tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad21a734-5a07-40d3-87fd-6ef677672bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-db3f7304-a5b3-42ca-b423-040b73df3a46 tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad21a734-5a07-40d3-87fd-6ef677672bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2061080110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eba7ad8a-a595-4876-b3f1-e9886202c679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0558d822624340139a509d568f744b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:39Z,use_quota=True,user_id='2fe97f4e0d5e40b9a433d3972ba06d21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-db3f7304-a5b3-42ca-b423-040b73df3a46 tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a102e8e1-c287-4787-9699-e7c88cb64a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-db3f7304-a5b3-42ca-b423-040b73df3a46 tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a102e8e1-c287-4787-9699-e7c88cb64a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-db3f7304-a5b3-42ca-b423-040b73df3a46 tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b233e99-9c99-47a2-b1f3-99b1ac1383c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-db3f7304-a5b3-42ca-b423-040b73df3a46 tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b233e99-9c99-47a2-b1f3-99b1ac1383c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eba7ad8a-a595-4876-b3f1-e9886202c679', 'volume_name': 'volume-eba7ad8a-a595-4876-b3f1-e9886202c679', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:39 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-db3f7304-a5b3-42ca-b423-040b73df3a46 tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab48f3af-6f44-4342-adce-9f75145387e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-db3f7304-a5b3-42ca-b423-040b73df3a46 tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab48f3af-6f44-4342-adce-9f75145387e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-db3f7304-a5b3-42ca-b423-040b73df3a46 tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (867a39b2-bf42-4541-ae5f-60bb637758df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:39 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-db3f7304-a5b3-42ca-b423-040b73df3a46 tempest-ProjectReaderTests-921411335 None] Volume eba7ad8a-a595-4876-b3f1-e9886202c679: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eba7ad8a-a595-4876-b3f1-e9886202c679', 'volume_size': 1} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-db3f7304-a5b3-42ca-b423-040b73df3a46 tempest-ProjectReaderTests-921411335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-308e7fdb-3558-4dfe-9670-4998561746e5 tempest-ProjectReaderTests-153927055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31" returned: 0 in 0.441s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-308e7fdb-3558-4dfe-9670-4998561746e5 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:39 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31 Nov 02 12:45:39 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:39 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-308e7fdb-3558-4dfe-9670-4998561746e5 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-cbdd6aca-2ef1-4109-9953-dfbd8a574b31" returned: 0 in 0.299s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-308e7fdb-3558-4dfe-9670-4998561746e5 tempest-ProjectReaderTests-153927055 None] Lock "cinder-quobyte-cbdd6aca-2ef1-4109-9953-dfbd8a574b31" released by "delete_volume" :: held 0.817s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:39 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e72bce3b-9e7a-4ef2-8696-750551ffc007 tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87 1073741824" returned: 0 in 0.515s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-308e7fdb-3558-4dfe-9670-4998561746e5 tempest-ProjectReaderTests-153927055 None] Created reservations ['39f37229-f1ab-449f-b937-bdeb5401494b', '0191ac4b-3b1d-4a15-a45c-75356e8cc59a', '692ce3d3-d594-403c-9c73-e6548c40ff90', 'dffd0c15-7cdf-40c0-99fa-76c5e2bc60df'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e72bce3b-9e7a-4ef2-8696-750551ffc007 tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:39 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87 Nov 02 12:45:39 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-308e7fdb-3558-4dfe-9670-4998561746e5 tempest-ProjectReaderTests-153927055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-308e7fdb-3558-4dfe-9670-4998561746e5 tempest-ProjectReaderTests-153927055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-308e7fdb-3558-4dfe-9670-4998561746e5 tempest-ProjectReaderTests-153927055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-308e7fdb-3558-4dfe-9670-4998561746e5 tempest-ProjectReaderTests-153927055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-308e7fdb-3558-4dfe-9670-4998561746e5 tempest-ProjectReaderTests-153927055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-308e7fdb-3558-4dfe-9670-4998561746e5 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:39 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:45:39 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:40 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e72bce3b-9e7a-4ef2-8696-750551ffc007 tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87" returned: 0 in 0.399s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e72bce3b-9e7a-4ef2-8696-750551ffc007 tempest-CreateVolumesFromSnapshotTest-278666822 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e72bce3b-9e7a-4ef2-8696-750551ffc007 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-db3f7304-a5b3-42ca-b423-040b73df3a46 tempest-ProjectReaderTests-921411335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.793s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-db3f7304-a5b3-42ca-b423-040b73df3a46 tempest-ProjectReaderTests-921411335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2061080110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eba7ad8a-a595-4876-b3f1-e9886202c679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0558d822624340139a509d568f744b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:39Z,use_quota=True,user_id='2fe97f4e0d5e40b9a433d3972ba06d21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-db3f7304-a5b3-42ca-b423-040b73df3a46 tempest-ProjectReaderTests-921411335 None] Creating volume eba7ad8a-a595-4876-b3f1-e9886202c679 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-db3f7304-a5b3-42ca-b423-040b73df3a46 tempest-ProjectReaderTests-921411335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-db3f7304-a5b3-42ca-b423-040b73df3a46 tempest-ProjectReaderTests-921411335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-db3f7304-a5b3-42ca-b423-040b73df3a46 tempest-ProjectReaderTests-921411335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:40 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-db3f7304-a5b3-42ca-b423-040b73df3a46 tempest-ProjectReaderTests-921411335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-db3f7304-a5b3-42ca-b423-040b73df3a46 tempest-ProjectReaderTests-921411335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-db3f7304-a5b3-42ca-b423-040b73df3a46 tempest-ProjectReaderTests-921411335 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:45:40 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-db3f7304-a5b3-42ca-b423-040b73df3a46 tempest-ProjectReaderTests-921411335 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-db3f7304-a5b3-42ca-b423-040b73df3a46 tempest-ProjectReaderTests-921411335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eba7ad8a-a595-4876-b3f1-e9886202c679 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-308e7fdb-3558-4dfe-9670-4998561746e5 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.334s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-308e7fdb-3558-4dfe-9670-4998561746e5 tempest-ProjectReaderTests-153927055 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:45:40 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eba7ad8a-a595-4876-b3f1-e9886202c679 1073741824 Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e72bce3b-9e7a-4ef2-8696-750551ffc007 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c10cea-1e57-4a5a-8ea6-6cfab912d3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e02d4e74-e545-4e8c-8112-4873b93e7a87', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:40 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e72bce3b-9e7a-4ef2-8696-750551ffc007 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c628481d-1533-49b0-8942-a56ef4b3423c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:40 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-308e7fdb-3558-4dfe-9670-4998561746e5 tempest-ProjectReaderTests-153927055 None] Deleted volume successfully. Nov 02 12:45:40 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-e72bce3b-9e7a-4ef2-8696-750551ffc007 tempest-CreateVolumesFromSnapshotTest-278666822 None] Volume volume-e02d4e74-e545-4e8c-8112-4873b93e7a87 (e02d4e74-e545-4e8c-8112-4873b93e7a87): created successfully Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e72bce3b-9e7a-4ef2-8696-750551ffc007 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c628481d-1533-49b0-8942-a56ef4b3423c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-e72bce3b-9e7a-4ef2-8696-750551ffc007 tempest-CreateVolumesFromSnapshotTest-278666822 None] Flow 'volume_create_manager' (bdf721b3-d81a-482d-93e4-1b620afaa03d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-308e7fdb-3558-4dfe-9670-4998561746e5 tempest-ProjectReaderTests-153927055 None] Lock "cinder-cbdd6aca-2ef1-4109-9953-dfbd8a574b31-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:40 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-e72bce3b-9e7a-4ef2-8696-750551ffc007 tempest-CreateVolumesFromSnapshotTest-278666822 None] Created volume successfully. Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cfe4f6c-0497-4691-b949-ceb245be9143 tempest-ProjectReaderTests-153927055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0cfe4f6c-0497-4691-b949-ceb245be9143 tempest-ProjectReaderTests-153927055 None] Flow 'volume_create_manager' (556f06c2-ffd0-44dd-aa1c-ac60123bf6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0cfe4f6c-0497-4691-b949-ceb245be9143 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a82aebb-5be1-4178-9486-c2523ad04431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5c1af014-f08c-43cb-9769-c202ddf6fdcd tempest-ProjectAdminTests-975377700 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8458518981934, 'free_capacity_gb': 1773.8458518981934, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86515) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0cfe4f6c-0497-4691-b949-ceb245be9143 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a82aebb-5be1-4178-9486-c2523ad04431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1837343150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39a74901-86bd-4960-ad41-2a24729ad3d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='371854aebb9b4c37b51206a234c0f7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:40Z,use_quota=True,user_id='2859c42cc4c64316a323f9dd6c533e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0cfe4f6c-0497-4691-b949-ceb245be9143 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0d0ab5e-e268-48c7-938b-db7831526557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0cfe4f6c-0497-4691-b949-ceb245be9143 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0d0ab5e-e268-48c7-938b-db7831526557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0cfe4f6c-0497-4691-b949-ceb245be9143 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4a022a8-f196-40ae-b9e9-437aaafa5867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0cfe4f6c-0497-4691-b949-ceb245be9143 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4a022a8-f196-40ae-b9e9-437aaafa5867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39a74901-86bd-4960-ad41-2a24729ad3d2', 'volume_name': 'volume-39a74901-86bd-4960-ad41-2a24729ad3d2', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0cfe4f6c-0497-4691-b949-ceb245be9143 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (820fc401-cc76-4e2c-961a-8c9fa72e661c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0cfe4f6c-0497-4691-b949-ceb245be9143 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (820fc401-cc76-4e2c-961a-8c9fa72e661c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0cfe4f6c-0497-4691-b949-ceb245be9143 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb7fbcf7-7326-4cdf-b064-d2dc689cf707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:40 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-0cfe4f6c-0497-4691-b949-ceb245be9143 tempest-ProjectReaderTests-153927055 None] Volume 39a74901-86bd-4960-ad41-2a24729ad3d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39a74901-86bd-4960-ad41-2a24729ad3d2', 'volume_size': 1} Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0cfe4f6c-0497-4691-b949-ceb245be9143 tempest-ProjectReaderTests-153927055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:40 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-db3f7304-a5b3-42ca-b423-040b73df3a46 tempest-ProjectReaderTests-921411335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eba7ad8a-a595-4876-b3f1-e9886202c679 1073741824" returned: 0 in 0.529s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-db3f7304-a5b3-42ca-b423-040b73df3a46 tempest-ProjectReaderTests-921411335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eba7ad8a-a595-4876-b3f1-e9886202c679 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:40 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eba7ad8a-a595-4876-b3f1-e9886202c679 Nov 02 12:45:40 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:40 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-db3f7304-a5b3-42ca-b423-040b73df3a46 tempest-ProjectReaderTests-921411335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eba7ad8a-a595-4876-b3f1-e9886202c679" returned: 0 in 0.253s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-db3f7304-a5b3-42ca-b423-040b73df3a46 tempest-ProjectReaderTests-921411335 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-db3f7304-a5b3-42ca-b423-040b73df3a46 tempest-ProjectReaderTests-921411335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0cfe4f6c-0497-4691-b949-ceb245be9143 tempest-ProjectReaderTests-153927055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.340s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:41 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0cfe4f6c-0497-4691-b949-ceb245be9143 tempest-ProjectReaderTests-153927055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1837343150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39a74901-86bd-4960-ad41-2a24729ad3d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='371854aebb9b4c37b51206a234c0f7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:40Z,use_quota=True,user_id='2859c42cc4c64316a323f9dd6c533e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:45:41 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-0cfe4f6c-0497-4691-b949-ceb245be9143 tempest-ProjectReaderTests-153927055 None] Creating volume 39a74901-86bd-4960-ad41-2a24729ad3d2 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:45:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0cfe4f6c-0497-4691-b949-ceb245be9143 tempest-ProjectReaderTests-153927055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0cfe4f6c-0497-4691-b949-ceb245be9143 tempest-ProjectReaderTests-153927055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:41 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0cfe4f6c-0497-4691-b949-ceb245be9143 tempest-ProjectReaderTests-153927055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:41 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0cfe4f6c-0497-4691-b949-ceb245be9143 tempest-ProjectReaderTests-153927055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0cfe4f6c-0497-4691-b949-ceb245be9143 tempest-ProjectReaderTests-153927055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:41 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0cfe4f6c-0497-4691-b949-ceb245be9143 tempest-ProjectReaderTests-153927055 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:45:41 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-0cfe4f6c-0497-4691-b949-ceb245be9143 tempest-ProjectReaderTests-153927055 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:45:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0cfe4f6c-0497-4691-b949-ceb245be9143 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-db3f7304-a5b3-42ca-b423-040b73df3a46 tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (867a39b2-bf42-4541-ae5f-60bb637758df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eba7ad8a-a595-4876-b3f1-e9886202c679', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:41 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2 1073741824 Nov 02 12:45:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-db3f7304-a5b3-42ca-b423-040b73df3a46 tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5161f457-4d44-44d6-be3e-2283b686fd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:41 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:41 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-db3f7304-a5b3-42ca-b423-040b73df3a46 tempest-ProjectReaderTests-921411335 None] Volume volume-eba7ad8a-a595-4876-b3f1-e9886202c679 (eba7ad8a-a595-4876-b3f1-e9886202c679): created successfully Nov 02 12:45:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-db3f7304-a5b3-42ca-b423-040b73df3a46 tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5161f457-4d44-44d6-be3e-2283b686fd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-db3f7304-a5b3-42ca-b423-040b73df3a46 tempest-ProjectReaderTests-921411335 None] Flow 'volume_create_manager' (377afe93-05c2-4fff-b4f2-c49db6142f10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:41 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-db3f7304-a5b3-42ca-b423-040b73df3a46 tempest-ProjectReaderTests-921411335 None] Created volume successfully. Nov 02 12:45:41 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c30bd0dc-4ae1-43b4-b5c4-90801cba5c9e tempest-ProjectReaderTests-921411335 None] Acquiring lock "cinder-eba7ad8a-a595-4876-b3f1-e9886202c679-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1aee2211-29d6-4772-9e65-e47a6e2472b2 tempest-CreateVolumesFromSnapshotTest-278666822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:41 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c30bd0dc-4ae1-43b4-b5c4-90801cba5c9e tempest-ProjectReaderTests-921411335 None] Lock "cinder-eba7ad8a-a595-4876-b3f1-e9886202c679-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:41 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c30bd0dc-4ae1-43b4-b5c4-90801cba5c9e tempest-ProjectReaderTests-921411335 None] Acquiring lock "cinder-quobyte-eba7ad8a-a595-4876-b3f1-e9886202c679" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:41 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c30bd0dc-4ae1-43b4-b5c4-90801cba5c9e tempest-ProjectReaderTests-921411335 None] Lock "cinder-quobyte-eba7ad8a-a595-4876-b3f1-e9886202c679" acquired by "delete_volume" :: waited 0.021s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:41 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[a067f1a7-1ff2-4d89-9c68-8a2bbf12f844]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c30bd0dc-4ae1-43b4-b5c4-90801cba5c9e tempest-ProjectReaderTests-921411335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eba7ad8a-a595-4876-b3f1-e9886202c679 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:41 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0cfe4f6c-0497-4691-b949-ceb245be9143 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2 1073741824" returned: 0 in 0.547s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0cfe4f6c-0497-4691-b949-ceb245be9143 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:41 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eba7ad8a-a595-4876-b3f1-e9886202c679 Nov 02 12:45:41 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:41 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2 Nov 02 12:45:41 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:41 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0cfe4f6c-0497-4691-b949-ceb245be9143 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2" returned: 0 in 0.264s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:41 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0cfe4f6c-0497-4691-b949-ceb245be9143 tempest-ProjectReaderTests-153927055 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:45:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0cfe4f6c-0497-4691-b949-ceb245be9143 tempest-ProjectReaderTests-153927055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1aee2211-29d6-4772-9e65-e47a6e2472b2 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.499s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:41 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-1aee2211-29d6-4772-9e65-e47a6e2472b2 tempest-CreateVolumesFromSnapshotTest-278666822 None] Creating offline snapshot 7cc6434c-dffb-45d7-8c7f-07f3102bea57 of volume e02d4e74-e545-4e8c-8112-4873b93e7a87 {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:45:41 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0cfe4f6c-0497-4691-b949-ceb245be9143 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb7fbcf7-7326-4cdf-b064-d2dc689cf707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39a74901-86bd-4960-ad41-2a24729ad3d2', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0cfe4f6c-0497-4691-b949-ceb245be9143 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d10ec27-db9b-4647-aadc-04ef5c066062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c30bd0dc-4ae1-43b4-b5c4-90801cba5c9e tempest-ProjectReaderTests-921411335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eba7ad8a-a595-4876-b3f1-e9886202c679" returned: 0 in 0.419s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c30bd0dc-4ae1-43b4-b5c4-90801cba5c9e tempest-ProjectReaderTests-921411335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eba7ad8a-a595-4876-b3f1-e9886202c679 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:41 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b94b13-cf74-4cc4-941b-1b14a977db2e]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1aee2211-29d6-4772-9e65-e47a6e2472b2 tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:41 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eba7ad8a-a595-4876-b3f1-e9886202c679 Nov 02 12:45:41 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:41 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-0cfe4f6c-0497-4691-b949-ceb245be9143 tempest-ProjectReaderTests-153927055 None] Volume volume-39a74901-86bd-4960-ad41-2a24729ad3d2 (39a74901-86bd-4960-ad41-2a24729ad3d2): created successfully Nov 02 12:45:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0cfe4f6c-0497-4691-b949-ceb245be9143 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d10ec27-db9b-4647-aadc-04ef5c066062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:41 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0cfe4f6c-0497-4691-b949-ceb245be9143 tempest-ProjectReaderTests-153927055 None] Flow 'volume_create_manager' (556f06c2-ffd0-44dd-aa1c-ac60123bf6bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:41 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-0cfe4f6c-0497-4691-b949-ceb245be9143 tempest-ProjectReaderTests-153927055 None] Created volume successfully. Nov 02 12:45:42 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87 Nov 02 12:45:42 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:42 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c30bd0dc-4ae1-43b4-b5c4-90801cba5c9e tempest-ProjectReaderTests-921411335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-eba7ad8a-a595-4876-b3f1-e9886202c679" returned: 0 in 0.297s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:42 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c30bd0dc-4ae1-43b4-b5c4-90801cba5c9e tempest-ProjectReaderTests-921411335 None] Lock "cinder-quobyte-eba7ad8a-a595-4876-b3f1-e9886202c679" released by "delete_volume" :: held 0.776s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:42 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-c30bd0dc-4ae1-43b4-b5c4-90801cba5c9e tempest-ProjectReaderTests-921411335 None] Created reservations ['f8ef10be-3e7a-49c9-9051-cb57169a9b15', '649cd440-0594-4015-9e5d-25ec191dbfa8', '8a9dcb3c-32c7-4039-8c61-17156f598847', '4390c8c6-72d4-4e77-9f88-537d03f4471a'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:42 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1aee2211-29d6-4772-9e65-e47a6e2472b2 tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87" returned: 0 in 0.424s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1aee2211-29d6-4772-9e65-e47a6e2472b2 tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87.7cc6434c-dffb-45d7-8c7f-07f3102bea57 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:42 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87.7cc6434c-dffb-45d7-8c7f-07f3102bea57 1G Nov 02 12:45:42 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c30bd0dc-4ae1-43b4-b5c4-90801cba5c9e tempest-ProjectReaderTests-921411335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c30bd0dc-4ae1-43b4-b5c4-90801cba5c9e tempest-ProjectReaderTests-921411335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:42 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-c30bd0dc-4ae1-43b4-b5c4-90801cba5c9e tempest-ProjectReaderTests-921411335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:42 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-c30bd0dc-4ae1-43b4-b5c4-90801cba5c9e tempest-ProjectReaderTests-921411335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c30bd0dc-4ae1-43b4-b5c4-90801cba5c9e tempest-ProjectReaderTests-921411335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c30bd0dc-4ae1-43b4-b5c4-90801cba5c9e tempest-ProjectReaderTests-921411335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:42 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:45:42 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:42 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c30bd0dc-4ae1-43b4-b5c4-90801cba5c9e tempest-ProjectReaderTests-921411335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.310s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:42 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-c30bd0dc-4ae1-43b4-b5c4-90801cba5c9e tempest-ProjectReaderTests-921411335 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:45:42 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-c30bd0dc-4ae1-43b4-b5c4-90801cba5c9e tempest-ProjectReaderTests-921411335 None] Deleted volume successfully. Nov 02 12:45:42 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c30bd0dc-4ae1-43b4-b5c4-90801cba5c9e tempest-ProjectReaderTests-921411335 None] Lock "cinder-eba7ad8a-a595-4876-b3f1-e9886202c679-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a622f06c-1451-4c54-8a61-77c47f8758b7 tempest-ProjectReaderTests-153927055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:42 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1aee2211-29d6-4772-9e65-e47a6e2472b2 tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87.7cc6434c-dffb-45d7-8c7f-07f3102bea57 1G" returned: 0 in 0.609s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1aee2211-29d6-4772-9e65-e47a6e2472b2 tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e02d4e74-e545-4e8c-8112-4873b93e7a87 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87.7cc6434c-dffb-45d7-8c7f-07f3102bea57 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:42 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e02d4e74-e545-4e8c-8112-4873b93e7a87 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87.7cc6434c-dffb-45d7-8c7f-07f3102bea57 Nov 02 12:45:42 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:43 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=208,cinder:UPDATE=259,cinder:DELETE=29,cinder:INSERT=72 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:45:43 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aa14509-f203-46dc-affd-c498923dbaad tempest-ProjectReaderTests-921411335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:45:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5aa14509-f203-46dc-affd-c498923dbaad tempest-ProjectReaderTests-921411335 None] Flow 'volume_create_manager' (f5129cce-e03b-4df8-9ee1-2c18b8296d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5aa14509-f203-46dc-affd-c498923dbaad tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c4c5a1-e920-43fb-9430-21e083647507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5aa14509-f203-46dc-affd-c498923dbaad tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c4c5a1-e920-43fb-9430-21e083647507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-662859178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6044d9b9-9d5b-4ace-ac18-2632b3e70c77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0558d822624340139a509d568f744b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:43Z,use_quota=True,user_id='2fe97f4e0d5e40b9a433d3972ba06d21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5aa14509-f203-46dc-affd-c498923dbaad tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6a3771b-e5b6-44d1-ba35-b3a6b6e6e333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5aa14509-f203-46dc-affd-c498923dbaad tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6a3771b-e5b6-44d1-ba35-b3a6b6e6e333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5aa14509-f203-46dc-affd-c498923dbaad tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85bb5e9d-91fb-4666-9b42-53edf7406c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5aa14509-f203-46dc-affd-c498923dbaad tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85bb5e9d-91fb-4666-9b42-53edf7406c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6044d9b9-9d5b-4ace-ac18-2632b3e70c77', 'volume_name': 'volume-6044d9b9-9d5b-4ace-ac18-2632b3e70c77', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5aa14509-f203-46dc-affd-c498923dbaad tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a424d0f-3013-47c8-b8aa-ad69ee071553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5aa14509-f203-46dc-affd-c498923dbaad tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a424d0f-3013-47c8-b8aa-ad69ee071553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5aa14509-f203-46dc-affd-c498923dbaad tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f9737ac-6727-4fdb-9bb9-f5784f0560d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:43 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-5aa14509-f203-46dc-affd-c498923dbaad tempest-ProjectReaderTests-921411335 None] Volume 6044d9b9-9d5b-4ace-ac18-2632b3e70c77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6044d9b9-9d5b-4ace-ac18-2632b3e70c77', 'volume_size': 1} Nov 02 12:45:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5aa14509-f203-46dc-affd-c498923dbaad tempest-ProjectReaderTests-921411335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:43 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1aee2211-29d6-4772-9e65-e47a6e2472b2 tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e02d4e74-e545-4e8c-8112-4873b93e7a87 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87.7cc6434c-dffb-45d7-8c7f-07f3102bea57" returned: 0 in 0.320s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:43 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-1aee2211-29d6-4772-9e65-e47a6e2472b2 tempest-CreateVolumesFromSnapshotTest-278666822 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87.7cc6434c-dffb-45d7-8c7f-07f3102bea57 is being set with open permissions: ugo+rw Nov 02 12:45:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1aee2211-29d6-4772-9e65-e47a6e2472b2 tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87.7cc6434c-dffb-45d7-8c7f-07f3102bea57 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:43 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87.7cc6434c-dffb-45d7-8c7f-07f3102bea57 Nov 02 12:45:43 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:43 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1aee2211-29d6-4772-9e65-e47a6e2472b2 tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87.7cc6434c-dffb-45d7-8c7f-07f3102bea57" returned: 0 in 0.244s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:43 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:UPDATE=267,cinder:SELECT=177,cinder:INSERT=69,cinder:DELETE=18 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:45:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1aee2211-29d6-4772-9e65-e47a6e2472b2 tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:43 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87.info Nov 02 12:45:43 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:43 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1aee2211-29d6-4772-9e65-e47a6e2472b2 tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87.info" returned: 0 in 0.253s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:43 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-1aee2211-29d6-4772-9e65-e47a6e2472b2 tempest-CreateVolumesFromSnapshotTest-278666822 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87.info is being set with open permissions: ugo+rw Nov 02 12:45:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1aee2211-29d6-4772-9e65-e47a6e2472b2 tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:43 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87.info Nov 02 12:45:43 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:43 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:45:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:43 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:45:43 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:44 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1aee2211-29d6-4772-9e65-e47a6e2472b2 tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87.info" returned: 0 in 0.264s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1aee2211-29d6-4772-9e65-e47a6e2472b2 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.238s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a622f06c-1451-4c54-8a61-77c47f8758b7 tempest-ProjectReaderTests-153927055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.158s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:44 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-a622f06c-1451-4c54-8a61-77c47f8758b7 tempest-ProjectReaderTests-153927055 None] Creating offline snapshot b0f0ad4b-8e63-4548-8048-a73ac3f1a5fd of volume 39a74901-86bd-4960-ad41-2a24729ad3d2 {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:45:44 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-1aee2211-29d6-4772-9e65-e47a6e2472b2 tempest-CreateVolumesFromSnapshotTest-278666822 None] Create snapshot completed successfully Nov 02 12:45:44 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[e723b613-aa92-4d6d-9087-c0748cc0ed4a]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a622f06c-1451-4c54-8a61-77c47f8758b7 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:44 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.302s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:44 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:45:44 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager._thread_info {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:45:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread count: 28 {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:45:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread info: [<_MainThread(MainThread, started 129944084402304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:45:44 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2 Nov 02 12:45:44 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:44 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a622f06c-1451-4c54-8a61-77c47f8758b7 tempest-ProjectReaderTests-153927055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2" returned: 0 in 0.402s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a622f06c-1451-4c54-8a61-77c47f8758b7 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2.b0f0ad4b-8e63-4548-8048-a73ac3f1a5fd 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:44 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2.b0f0ad4b-8e63-4548-8048-a73ac3f1a5fd 1G Nov 02 12:45:44 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:45 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-72dda994-c6eb-499f-b916-1abb6ff4df10 tempest-CreateVolumesFromSnapshotTest-278666822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:45:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-72dda994-c6eb-499f-b916-1abb6ff4df10 tempest-CreateVolumesFromSnapshotTest-278666822 None] Flow 'volume_create_manager' (4307950a-3025-451a-b715-4395e0824a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:45 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-72dda994-c6eb-499f-b916-1abb6ff4df10 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a597e302-aec9-4270-9f74-6cbb48fd1e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a622f06c-1451-4c54-8a61-77c47f8758b7 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2.b0f0ad4b-8e63-4548-8048-a73ac3f1a5fd 1G" returned: 0 in 0.496s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a622f06c-1451-4c54-8a61-77c47f8758b7 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39a74901-86bd-4960-ad41-2a24729ad3d2 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2.b0f0ad4b-8e63-4548-8048-a73ac3f1a5fd {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-72dda994-c6eb-499f-b916-1abb6ff4df10 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a597e302-aec9-4270-9f74-6cbb48fd1e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-557131015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ae97964-918e-4ba8-a46c-48e4b5e457bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce877e21e4b14f8e954bcd6d98b8d237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:45Z,use_quota=True,user_id='dacbce82b49e4514894656b674c09c0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:45 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39a74901-86bd-4960-ad41-2a24729ad3d2 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2.b0f0ad4b-8e63-4548-8048-a73ac3f1a5fd Nov 02 12:45:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-72dda994-c6eb-499f-b916-1abb6ff4df10 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e4454e-1131-4ddb-98b0-67cf74c702c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:45 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-72dda994-c6eb-499f-b916-1abb6ff4df10 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e4454e-1131-4ddb-98b0-67cf74c702c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-72dda994-c6eb-499f-b916-1abb6ff4df10 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9630c742-d50c-4ba2-8473-9ed8bafc095d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-72dda994-c6eb-499f-b916-1abb6ff4df10 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9630c742-d50c-4ba2-8473-9ed8bafc095d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ae97964-918e-4ba8-a46c-48e4b5e457bd', 'volume_name': 'volume-5ae97964-918e-4ba8-a46c-48e4b5e457bd', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-72dda994-c6eb-499f-b916-1abb6ff4df10 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c5f00f-4f49-405d-8d55-1c4a410009cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-72dda994-c6eb-499f-b916-1abb6ff4df10 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c5f00f-4f49-405d-8d55-1c4a410009cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-72dda994-c6eb-499f-b916-1abb6ff4df10 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44a4461d-2bd7-4a9f-ad0d-3f5a0df0e54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:45 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-72dda994-c6eb-499f-b916-1abb6ff4df10 tempest-CreateVolumesFromSnapshotTest-278666822 None] Volume 5ae97964-918e-4ba8-a46c-48e4b5e457bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ae97964-918e-4ba8-a46c-48e4b5e457bd', 'volume_size': 1} Nov 02 12:45:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-72dda994-c6eb-499f-b916-1abb6ff4df10 tempest-CreateVolumesFromSnapshotTest-278666822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:45 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a622f06c-1451-4c54-8a61-77c47f8758b7 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39a74901-86bd-4960-ad41-2a24729ad3d2 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2.b0f0ad4b-8e63-4548-8048-a73ac3f1a5fd" returned: 0 in 0.570s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:45 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-a622f06c-1451-4c54-8a61-77c47f8758b7 tempest-ProjectReaderTests-153927055 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2.b0f0ad4b-8e63-4548-8048-a73ac3f1a5fd is being set with open permissions: ugo+rw Nov 02 12:45:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a622f06c-1451-4c54-8a61-77c47f8758b7 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2.b0f0ad4b-8e63-4548-8048-a73ac3f1a5fd {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:45 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-3be0dc9a-e2f2-4404-9ead-f45358df3c3c tempest-CreateVolumesFromSnapshotTest-278666822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:45:45 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2.b0f0ad4b-8e63-4548-8048-a73ac3f1a5fd Nov 02 12:45:45 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3be0dc9a-e2f2-4404-9ead-f45358df3c3c tempest-CreateVolumesFromSnapshotTest-278666822 None] Flow 'volume_create_manager' (6ec99658-3036-4117-8a02-16fd7a410079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3be0dc9a-e2f2-4404-9ead-f45358df3c3c tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1707cfac-a554-4ce9-a78c-bd7ca0637cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3be0dc9a-e2f2-4404-9ead-f45358df3c3c tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1707cfac-a554-4ce9-a78c-bd7ca0637cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-102602114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bca542b7-2341-4918-bbf1-2d664fa3dc64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce877e21e4b14f8e954bcd6d98b8d237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:46Z,use_quota=True,user_id='dacbce82b49e4514894656b674c09c0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3be0dc9a-e2f2-4404-9ead-f45358df3c3c tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11baffc8-ed1b-451e-ac64-3255c713a10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3be0dc9a-e2f2-4404-9ead-f45358df3c3c tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11baffc8-ed1b-451e-ac64-3255c713a10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3be0dc9a-e2f2-4404-9ead-f45358df3c3c tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d7673b2-f160-4a1a-af65-053b292a81d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3be0dc9a-e2f2-4404-9ead-f45358df3c3c tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d7673b2-f160-4a1a-af65-053b292a81d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bca542b7-2341-4918-bbf1-2d664fa3dc64', 'volume_name': 'volume-bca542b7-2341-4918-bbf1-2d664fa3dc64', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3be0dc9a-e2f2-4404-9ead-f45358df3c3c tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd3bce39-f6c2-4d4f-9dea-6913bbdcb05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3be0dc9a-e2f2-4404-9ead-f45358df3c3c tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd3bce39-f6c2-4d4f-9dea-6913bbdcb05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3be0dc9a-e2f2-4404-9ead-f45358df3c3c tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0c38a9b-40cd-4153-b90b-14d9605d390a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:45 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-3be0dc9a-e2f2-4404-9ead-f45358df3c3c tempest-CreateVolumesFromSnapshotTest-278666822 None] Volume bca542b7-2341-4918-bbf1-2d664fa3dc64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bca542b7-2341-4918-bbf1-2d664fa3dc64', 'volume_size': 1} Nov 02 12:45:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3be0dc9a-e2f2-4404-9ead-f45358df3c3c tempest-CreateVolumesFromSnapshotTest-278666822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:45 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a622f06c-1451-4c54-8a61-77c47f8758b7 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2.b0f0ad4b-8e63-4548-8048-a73ac3f1a5fd" returned: 0 in 0.296s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a622f06c-1451-4c54-8a61-77c47f8758b7 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:45 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eb1b247-a88b-4e08-a4bf-041e8b6f896c tempest-CreateVolumesFromSnapshotTest-278666822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:45:46 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2.info Nov 02 12:45:46 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5eb1b247-a88b-4e08-a4bf-041e8b6f896c tempest-CreateVolumesFromSnapshotTest-278666822 None] Flow 'volume_create_manager' (f4fe8bd8-71cf-44e2-9792-992279545c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5eb1b247-a88b-4e08-a4bf-041e8b6f896c tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384f6a91-964d-49a5-bb75-803e4cca85f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5eb1b247-a88b-4e08-a4bf-041e8b6f896c tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384f6a91-964d-49a5-bb75-803e4cca85f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-182161862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d3ec996-e568-45ff-acb5-fa35cadbaec2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce877e21e4b14f8e954bcd6d98b8d237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:46Z,use_quota=True,user_id='dacbce82b49e4514894656b674c09c0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5eb1b247-a88b-4e08-a4bf-041e8b6f896c tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51f196cd-18b7-4b98-9133-be8c1f40377c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5eb1b247-a88b-4e08-a4bf-041e8b6f896c tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51f196cd-18b7-4b98-9133-be8c1f40377c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5eb1b247-a88b-4e08-a4bf-041e8b6f896c tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eda52d9d-9a6f-4041-bc27-4df04a22f1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5eb1b247-a88b-4e08-a4bf-041e8b6f896c tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eda52d9d-9a6f-4041-bc27-4df04a22f1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d3ec996-e568-45ff-acb5-fa35cadbaec2', 'volume_name': 'volume-3d3ec996-e568-45ff-acb5-fa35cadbaec2', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5eb1b247-a88b-4e08-a4bf-041e8b6f896c tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f70a9bb-3b1f-47e8-9526-5e57b48e8644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5eb1b247-a88b-4e08-a4bf-041e8b6f896c tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f70a9bb-3b1f-47e8-9526-5e57b48e8644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5eb1b247-a88b-4e08-a4bf-041e8b6f896c tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2828eb6-4956-46f2-99f2-6abc941f6e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:46 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-5eb1b247-a88b-4e08-a4bf-041e8b6f896c tempest-CreateVolumesFromSnapshotTest-278666822 None] Volume 3d3ec996-e568-45ff-acb5-fa35cadbaec2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d3ec996-e568-45ff-acb5-fa35cadbaec2', 'volume_size': 1} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5eb1b247-a88b-4e08-a4bf-041e8b6f896c tempest-CreateVolumesFromSnapshotTest-278666822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:46 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a622f06c-1451-4c54-8a61-77c47f8758b7 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2.info" returned: 0 in 0.366s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:46 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-a622f06c-1451-4c54-8a61-77c47f8758b7 tempest-ProjectReaderTests-153927055 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2.info is being set with open permissions: ugo+rw Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a622f06c-1451-4c54-8a61-77c47f8758b7 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:46 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2.info Nov 02 12:45:46 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-524558e4-06cd-47f1-925f-6cc22ae0f865 tempest-CreateVolumesFromSnapshotTest-278666822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-524558e4-06cd-47f1-925f-6cc22ae0f865 tempest-CreateVolumesFromSnapshotTest-278666822 None] Flow 'volume_create_manager' (a167c9b1-e8c5-42be-8dc1-c2c7f0bb4839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-524558e4-06cd-47f1-925f-6cc22ae0f865 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87727720-dad5-4d1e-8dd0-00caa02d903f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-524558e4-06cd-47f1-925f-6cc22ae0f865 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87727720-dad5-4d1e-8dd0-00caa02d903f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1455199717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd11ca83-b0fc-409b-a5d0-d9cb056fae03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce877e21e4b14f8e954bcd6d98b8d237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:46Z,use_quota=True,user_id='dacbce82b49e4514894656b674c09c0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-524558e4-06cd-47f1-925f-6cc22ae0f865 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e13583-0777-46b1-8152-2ef162391310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-524558e4-06cd-47f1-925f-6cc22ae0f865 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e13583-0777-46b1-8152-2ef162391310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-524558e4-06cd-47f1-925f-6cc22ae0f865 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1753046-2400-4e1b-8280-d6e5f62ee0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-524558e4-06cd-47f1-925f-6cc22ae0f865 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1753046-2400-4e1b-8280-d6e5f62ee0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd11ca83-b0fc-409b-a5d0-d9cb056fae03', 'volume_name': 'volume-bd11ca83-b0fc-409b-a5d0-d9cb056fae03', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-524558e4-06cd-47f1-925f-6cc22ae0f865 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9844dfa8-7150-4333-b6ae-563211b6b0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-524558e4-06cd-47f1-925f-6cc22ae0f865 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9844dfa8-7150-4333-b6ae-563211b6b0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-524558e4-06cd-47f1-925f-6cc22ae0f865 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e88c1b4e-fb11-486d-88c7-caa8a5bd4bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:46 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-524558e4-06cd-47f1-925f-6cc22ae0f865 tempest-CreateVolumesFromSnapshotTest-278666822 None] Volume bd11ca83-b0fc-409b-a5d0-d9cb056fae03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd11ca83-b0fc-409b-a5d0-d9cb056fae03', 'volume_size': 1} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-524558e4-06cd-47f1-925f-6cc22ae0f865 tempest-CreateVolumesFromSnapshotTest-278666822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:46 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-a622f06c-1451-4c54-8a61-77c47f8758b7 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2.info" returned: 0 in 0.392s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-a622f06c-1451-4c54-8a61-77c47f8758b7 tempest-ProjectReaderTests-153927055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.645s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5aa14509-f203-46dc-affd-c498923dbaad tempest-ProjectReaderTests-921411335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.482s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5aa14509-f203-46dc-affd-c498923dbaad tempest-ProjectReaderTests-921411335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-662859178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6044d9b9-9d5b-4ace-ac18-2632b3e70c77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0558d822624340139a509d568f744b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:43Z,use_quota=True,user_id='2fe97f4e0d5e40b9a433d3972ba06d21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-5aa14509-f203-46dc-affd-c498923dbaad tempest-ProjectReaderTests-921411335 None] Creating volume 6044d9b9-9d5b-4ace-ac18-2632b3e70c77 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5aa14509-f203-46dc-affd-c498923dbaad tempest-ProjectReaderTests-921411335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5aa14509-f203-46dc-affd-c498923dbaad tempest-ProjectReaderTests-921411335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5aa14509-f203-46dc-affd-c498923dbaad tempest-ProjectReaderTests-921411335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5aa14509-f203-46dc-affd-c498923dbaad tempest-ProjectReaderTests-921411335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5aa14509-f203-46dc-affd-c498923dbaad tempest-ProjectReaderTests-921411335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5aa14509-f203-46dc-affd-c498923dbaad tempest-ProjectReaderTests-921411335 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:45:46 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-5aa14509-f203-46dc-affd-c498923dbaad tempest-ProjectReaderTests-921411335 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5aa14509-f203-46dc-affd-c498923dbaad tempest-ProjectReaderTests-921411335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6044d9b9-9d5b-4ace-ac18-2632b3e70c77 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:46 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6044d9b9-9d5b-4ace-ac18-2632b3e70c77 1073741824 Nov 02 12:45:46 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:46 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-a622f06c-1451-4c54-8a61-77c47f8758b7 tempest-ProjectReaderTests-153927055 None] Create snapshot completed successfully Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9867ae3-6b43-4fd0-93bc-5d851f07a778 tempest-CreateVolumesFromSnapshotTest-278666822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9867ae3-6b43-4fd0-93bc-5d851f07a778 tempest-CreateVolumesFromSnapshotTest-278666822 None] Flow 'volume_create_manager' (a606cba9-988e-4be0-b0e8-31ebe24957f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9867ae3-6b43-4fd0-93bc-5d851f07a778 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b140095-1d0b-4540-9bee-d34645507512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9867ae3-6b43-4fd0-93bc-5d851f07a778 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b140095-1d0b-4540-9bee-d34645507512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1618901330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cd834b2-21df-4346-8196-a338ad785b65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce877e21e4b14f8e954bcd6d98b8d237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:47Z,use_quota=True,user_id='dacbce82b49e4514894656b674c09c0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9867ae3-6b43-4fd0-93bc-5d851f07a778 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c420c28d-9b1c-479c-8bdf-909ab6add1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9867ae3-6b43-4fd0-93bc-5d851f07a778 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c420c28d-9b1c-479c-8bdf-909ab6add1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9867ae3-6b43-4fd0-93bc-5d851f07a778 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f7adee6-e30f-4f8b-9f5f-29a0bd580726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9867ae3-6b43-4fd0-93bc-5d851f07a778 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f7adee6-e30f-4f8b-9f5f-29a0bd580726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cd834b2-21df-4346-8196-a338ad785b65', 'volume_name': 'volume-1cd834b2-21df-4346-8196-a338ad785b65', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9867ae3-6b43-4fd0-93bc-5d851f07a778 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87b263d1-4cab-4036-9c27-5583d11b8807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9867ae3-6b43-4fd0-93bc-5d851f07a778 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87b263d1-4cab-4036-9c27-5583d11b8807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9867ae3-6b43-4fd0-93bc-5d851f07a778 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (772ad44a-57c0-4879-b921-3fd23504535d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:46 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-d9867ae3-6b43-4fd0-93bc-5d851f07a778 tempest-CreateVolumesFromSnapshotTest-278666822 None] Volume 1cd834b2-21df-4346-8196-a338ad785b65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cd834b2-21df-4346-8196-a338ad785b65', 'volume_size': 1} Nov 02 12:45:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d9867ae3-6b43-4fd0-93bc-5d851f07a778 tempest-CreateVolumesFromSnapshotTest-278666822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:47 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5aa14509-f203-46dc-affd-c498923dbaad tempest-ProjectReaderTests-921411335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6044d9b9-9d5b-4ace-ac18-2632b3e70c77 1073741824" returned: 0 in 0.463s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:47 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-54207d38-d916-45f6-ab48-f46eaf0d284b tempest-ProjectReaderTests-153927055 None] Acquiring lock "cinder-b0f0ad4b-8e63-4548-8048-a73ac3f1a5fd-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5aa14509-f203-46dc-affd-c498923dbaad tempest-ProjectReaderTests-921411335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6044d9b9-9d5b-4ace-ac18-2632b3e70c77 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:47 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-54207d38-d916-45f6-ab48-f46eaf0d284b tempest-ProjectReaderTests-153927055 None] Lock "cinder-b0f0ad4b-8e63-4548-8048-a73ac3f1a5fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:47 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-54207d38-d916-45f6-ab48-f46eaf0d284b tempest-ProjectReaderTests-153927055 None] Acquiring lock "cinder-quobyte-39a74901-86bd-4960-ad41-2a24729ad3d2" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:47 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6044d9b9-9d5b-4ace-ac18-2632b3e70c77 Nov 02 12:45:47 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:47 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-54207d38-d916-45f6-ab48-f46eaf0d284b tempest-ProjectReaderTests-153927055 None] Lock "cinder-quobyte-39a74901-86bd-4960-ad41-2a24729ad3d2" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:47 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-54207d38-d916-45f6-ab48-f46eaf0d284b tempest-ProjectReaderTests-153927055 None] Acquiring lock "cinder-quobyte-b0f0ad4b-8e63-4548-8048-a73ac3f1a5fd" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:47 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-54207d38-d916-45f6-ab48-f46eaf0d284b tempest-ProjectReaderTests-153927055 None] Lock "cinder-quobyte-b0f0ad4b-8e63-4548-8048-a73ac3f1a5fd" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:47 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-54207d38-d916-45f6-ab48-f46eaf0d284b tempest-ProjectReaderTests-153927055 None] Deleting offline snapshot b0f0ad4b-8e63-4548-8048-a73ac3f1a5fd of volume 39a74901-86bd-4960-ad41-2a24729ad3d2 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:45:47 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-54207d38-d916-45f6-ab48-f46eaf0d284b tempest-ProjectReaderTests-153927055 None] snapshot_file for this snap is: volume-39a74901-86bd-4960-ad41-2a24729ad3d2.b0f0ad4b-8e63-4548-8048-a73ac3f1a5fd {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:45:47 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b251bae-9788-4fe2-881f-1ba4372a6098]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-54207d38-d916-45f6-ab48-f46eaf0d284b tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2.b0f0ad4b-8e63-4548-8048-a73ac3f1a5fd {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:47 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2.b0f0ad4b-8e63-4548-8048-a73ac3f1a5fd Nov 02 12:45:47 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:47 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5aa14509-f203-46dc-affd-c498923dbaad tempest-ProjectReaderTests-921411335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6044d9b9-9d5b-4ace-ac18-2632b3e70c77" returned: 0 in 0.296s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:47 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5aa14509-f203-46dc-affd-c498923dbaad tempest-ProjectReaderTests-921411335 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:45:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5aa14509-f203-46dc-affd-c498923dbaad tempest-ProjectReaderTests-921411335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-72dda994-c6eb-499f-b916-1abb6ff4df10 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.416s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:47 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-72dda994-c6eb-499f-b916-1abb6ff4df10 tempest-CreateVolumesFromSnapshotTest-278666822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-557131015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ae97964-918e-4ba8-a46c-48e4b5e457bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce877e21e4b14f8e954bcd6d98b8d237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:45Z,use_quota=True,user_id='dacbce82b49e4514894656b674c09c0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:45:47 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-72dda994-c6eb-499f-b916-1abb6ff4df10 tempest-CreateVolumesFromSnapshotTest-278666822 None] Creating volume 5ae97964-918e-4ba8-a46c-48e4b5e457bd {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:45:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-72dda994-c6eb-499f-b916-1abb6ff4df10 tempest-CreateVolumesFromSnapshotTest-278666822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-72dda994-c6eb-499f-b916-1abb6ff4df10 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:47 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-72dda994-c6eb-499f-b916-1abb6ff4df10 tempest-CreateVolumesFromSnapshotTest-278666822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:47 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-72dda994-c6eb-499f-b916-1abb6ff4df10 tempest-CreateVolumesFromSnapshotTest-278666822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-72dda994-c6eb-499f-b916-1abb6ff4df10 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:47 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-72dda994-c6eb-499f-b916-1abb6ff4df10 tempest-CreateVolumesFromSnapshotTest-278666822 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:45:47 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-72dda994-c6eb-499f-b916-1abb6ff4df10 tempest-CreateVolumesFromSnapshotTest-278666822 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:45:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-72dda994-c6eb-499f-b916-1abb6ff4df10 tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5ae97964-918e-4ba8-a46c-48e4b5e457bd 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5aa14509-f203-46dc-affd-c498923dbaad tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f9737ac-6727-4fdb-9bb9-f5784f0560d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6044d9b9-9d5b-4ace-ac18-2632b3e70c77', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:47 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5ae97964-918e-4ba8-a46c-48e4b5e457bd 1073741824 Nov 02 12:45:47 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5aa14509-f203-46dc-affd-c498923dbaad tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64aee98d-9e93-4df0-b12e-c17c652c5d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:47 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-5aa14509-f203-46dc-affd-c498923dbaad tempest-ProjectReaderTests-921411335 None] Volume volume-6044d9b9-9d5b-4ace-ac18-2632b3e70c77 (6044d9b9-9d5b-4ace-ac18-2632b3e70c77): created successfully Nov 02 12:45:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5aa14509-f203-46dc-affd-c498923dbaad tempest-ProjectReaderTests-921411335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64aee98d-9e93-4df0-b12e-c17c652c5d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:47 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5aa14509-f203-46dc-affd-c498923dbaad tempest-ProjectReaderTests-921411335 None] Flow 'volume_create_manager' (f5129cce-e03b-4df8-9ee1-2c18b8296d68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:47 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-5aa14509-f203-46dc-affd-c498923dbaad tempest-ProjectReaderTests-921411335 None] Created volume successfully. Nov 02 12:45:47 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-54207d38-d916-45f6-ab48-f46eaf0d284b tempest-ProjectReaderTests-153927055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2.b0f0ad4b-8e63-4548-8048-a73ac3f1a5fd" returned: 0 in 0.405s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:47 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-54207d38-d916-45f6-ab48-f46eaf0d284b tempest-ProjectReaderTests-153927055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39a74901-86bd-4960-ad41-2a24729ad3d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:45:47 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[9861b143-1f6c-427d-88d9-33f8a492071f]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-54207d38-d916-45f6-ab48-f46eaf0d284b tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:47 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2 Nov 02 12:45:47 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:48 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-72dda994-c6eb-499f-b916-1abb6ff4df10 tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5ae97964-918e-4ba8-a46c-48e4b5e457bd 1073741824" returned: 0 in 0.560s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-72dda994-c6eb-499f-b916-1abb6ff4df10 tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5ae97964-918e-4ba8-a46c-48e4b5e457bd {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:48 devstack sudo[107252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5ae97964-918e-4ba8-a46c-48e4b5e457bd Nov 02 12:45:48 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:48 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-54207d38-d916-45f6-ab48-f46eaf0d284b tempest-ProjectReaderTests-153927055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2" returned: 0 in 0.439s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-54207d38-d916-45f6-ab48-f46eaf0d284b tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2.b0f0ad4b-8e63-4548-8048-a73ac3f1a5fd {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:48 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2.b0f0ad4b-8e63-4548-8048-a73ac3f1a5fd Nov 02 12:45:48 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:48 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-72dda994-c6eb-499f-b916-1abb6ff4df10 tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5ae97964-918e-4ba8-a46c-48e4b5e457bd" returned: 0 in 0.321s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-72dda994-c6eb-499f-b916-1abb6ff4df10 tempest-CreateVolumesFromSnapshotTest-278666822 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:45:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-72dda994-c6eb-499f-b916-1abb6ff4df10 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3be0dc9a-e2f2-4404-9ead-f45358df3c3c tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.739s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3be0dc9a-e2f2-4404-9ead-f45358df3c3c tempest-CreateVolumesFromSnapshotTest-278666822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-102602114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bca542b7-2341-4918-bbf1-2d664fa3dc64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce877e21e4b14f8e954bcd6d98b8d237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:46Z,use_quota=True,user_id='dacbce82b49e4514894656b674c09c0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:45:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-3be0dc9a-e2f2-4404-9ead-f45358df3c3c tempest-CreateVolumesFromSnapshotTest-278666822 None] Creating volume bca542b7-2341-4918-bbf1-2d664fa3dc64 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:45:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3be0dc9a-e2f2-4404-9ead-f45358df3c3c tempest-CreateVolumesFromSnapshotTest-278666822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3be0dc9a-e2f2-4404-9ead-f45358df3c3c tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3be0dc9a-e2f2-4404-9ead-f45358df3c3c tempest-CreateVolumesFromSnapshotTest-278666822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3be0dc9a-e2f2-4404-9ead-f45358df3c3c tempest-CreateVolumesFromSnapshotTest-278666822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3be0dc9a-e2f2-4404-9ead-f45358df3c3c tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3be0dc9a-e2f2-4404-9ead-f45358df3c3c tempest-CreateVolumesFromSnapshotTest-278666822 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:45:48 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-3be0dc9a-e2f2-4404-9ead-f45358df3c3c tempest-CreateVolumesFromSnapshotTest-278666822 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:45:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3be0dc9a-e2f2-4404-9ead-f45358df3c3c tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bca542b7-2341-4918-bbf1-2d664fa3dc64 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:48 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bca542b7-2341-4918-bbf1-2d664fa3dc64 1073741824 Nov 02 12:45:48 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-72dda994-c6eb-499f-b916-1abb6ff4df10 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44a4461d-2bd7-4a9f-ad0d-3f5a0df0e54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ae97964-918e-4ba8-a46c-48e4b5e457bd', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-72dda994-c6eb-499f-b916-1abb6ff4df10 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed8362c-f425-4e3a-a1d0-769542594bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:48 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-72dda994-c6eb-499f-b916-1abb6ff4df10 tempest-CreateVolumesFromSnapshotTest-278666822 None] Volume volume-5ae97964-918e-4ba8-a46c-48e4b5e457bd (5ae97964-918e-4ba8-a46c-48e4b5e457bd): created successfully Nov 02 12:45:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-72dda994-c6eb-499f-b916-1abb6ff4df10 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed8362c-f425-4e3a-a1d0-769542594bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:48 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-72dda994-c6eb-499f-b916-1abb6ff4df10 tempest-CreateVolumesFromSnapshotTest-278666822 None] Flow 'volume_create_manager' (4307950a-3025-451a-b715-4395e0824a4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:48 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b6a0aebb-7aa9-4833-8cfb-6347c4269726 tempest-ProjectReaderTests-921411335 None] Acquiring lock "cinder-6044d9b9-9d5b-4ace-ac18-2632b3e70c77-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:48 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-72dda994-c6eb-499f-b916-1abb6ff4df10 tempest-CreateVolumesFromSnapshotTest-278666822 None] Created volume successfully. Nov 02 12:45:48 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b6a0aebb-7aa9-4833-8cfb-6347c4269726 tempest-ProjectReaderTests-921411335 None] Lock "cinder-6044d9b9-9d5b-4ace-ac18-2632b3e70c77-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:48 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b6a0aebb-7aa9-4833-8cfb-6347c4269726 tempest-ProjectReaderTests-921411335 None] Acquiring lock "cinder-quobyte-6044d9b9-9d5b-4ace-ac18-2632b3e70c77" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:48 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b6a0aebb-7aa9-4833-8cfb-6347c4269726 tempest-ProjectReaderTests-921411335 None] Lock "cinder-quobyte-6044d9b9-9d5b-4ace-ac18-2632b3e70c77" acquired by "delete_volume" :: waited 0.027s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:48 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-54207d38-d916-45f6-ab48-f46eaf0d284b tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2.b0f0ad4b-8e63-4548-8048-a73ac3f1a5fd" returned: 0 in 0.526s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-54207d38-d916-45f6-ab48-f46eaf0d284b tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2.b0f0ad4b-8e63-4548-8048-a73ac3f1a5fd {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:48 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2.b0f0ad4b-8e63-4548-8048-a73ac3f1a5fd Nov 02 12:45:48 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:48 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[534f934a-7b86-4a73-8d49-316cca75703b]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6a0aebb-7aa9-4833-8cfb-6347c4269726 tempest-ProjectReaderTests-921411335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6044d9b9-9d5b-4ace-ac18-2632b3e70c77 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:49 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6044d9b9-9d5b-4ace-ac18-2632b3e70c77 Nov 02 12:45:49 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:49 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3be0dc9a-e2f2-4404-9ead-f45358df3c3c tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bca542b7-2341-4918-bbf1-2d664fa3dc64 1073741824" returned: 0 in 0.599s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:49 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-54207d38-d916-45f6-ab48-f46eaf0d284b tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2.b0f0ad4b-8e63-4548-8048-a73ac3f1a5fd" returned: 0 in 0.353s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:49 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-54207d38-d916-45f6-ab48-f46eaf0d284b tempest-ProjectReaderTests-153927055 None] Lock "cinder-quobyte-b0f0ad4b-8e63-4548-8048-a73ac3f1a5fd" released by "_delete_snapshot" :: held 1.885s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3be0dc9a-e2f2-4404-9ead-f45358df3c3c tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bca542b7-2341-4918-bbf1-2d664fa3dc64 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:49 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-54207d38-d916-45f6-ab48-f46eaf0d284b tempest-ProjectReaderTests-153927055 None] Lock "cinder-quobyte-39a74901-86bd-4960-ad41-2a24729ad3d2" released by "delete_snapshot" :: held 1.937s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:49 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bca542b7-2341-4918-bbf1-2d664fa3dc64 Nov 02 12:45:49 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:49 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6a0aebb-7aa9-4833-8cfb-6347c4269726 tempest-ProjectReaderTests-921411335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6044d9b9-9d5b-4ace-ac18-2632b3e70c77" returned: 0 in 0.460s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6a0aebb-7aa9-4833-8cfb-6347c4269726 tempest-ProjectReaderTests-921411335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6044d9b9-9d5b-4ace-ac18-2632b3e70c77 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:49 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6044d9b9-9d5b-4ace-ac18-2632b3e70c77 Nov 02 12:45:49 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:49 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-54207d38-d916-45f6-ab48-f46eaf0d284b tempest-ProjectReaderTests-153927055 None] Created reservations ['3bd877b1-8023-4111-b2a2-475d77432207', '92106b5b-eb76-460e-a86c-cbd40c59d900', '61f8d61c-257e-4d2e-864c-8258356bf172', '1eef15dc-7443-4e63-8632-51d90f0d6cb9'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:49 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-54207d38-d916-45f6-ab48-f46eaf0d284b tempest-ProjectReaderTests-153927055 None] Delete snapshot completed successfully. Nov 02 12:45:49 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-54207d38-d916-45f6-ab48-f46eaf0d284b tempest-ProjectReaderTests-153927055 None] Lock "cinder-b0f0ad4b-8e63-4548-8048-a73ac3f1a5fd-delete_snapshot" released by "delete_snapshot" :: held 2.186s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:49 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3be0dc9a-e2f2-4404-9ead-f45358df3c3c tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bca542b7-2341-4918-bbf1-2d664fa3dc64" returned: 0 in 0.354s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:49 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3be0dc9a-e2f2-4404-9ead-f45358df3c3c tempest-CreateVolumesFromSnapshotTest-278666822 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:45:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3be0dc9a-e2f2-4404-9ead-f45358df3c3c tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5eb1b247-a88b-4e08-a4bf-041e8b6f896c tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.522s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:49 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5eb1b247-a88b-4e08-a4bf-041e8b6f896c tempest-CreateVolumesFromSnapshotTest-278666822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-182161862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d3ec996-e568-45ff-acb5-fa35cadbaec2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce877e21e4b14f8e954bcd6d98b8d237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:46Z,use_quota=True,user_id='dacbce82b49e4514894656b674c09c0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:45:49 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-5eb1b247-a88b-4e08-a4bf-041e8b6f896c tempest-CreateVolumesFromSnapshotTest-278666822 None] Creating volume 3d3ec996-e568-45ff-acb5-fa35cadbaec2 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:45:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5eb1b247-a88b-4e08-a4bf-041e8b6f896c tempest-CreateVolumesFromSnapshotTest-278666822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5eb1b247-a88b-4e08-a4bf-041e8b6f896c tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:49 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5eb1b247-a88b-4e08-a4bf-041e8b6f896c tempest-CreateVolumesFromSnapshotTest-278666822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:49 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5eb1b247-a88b-4e08-a4bf-041e8b6f896c tempest-CreateVolumesFromSnapshotTest-278666822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5eb1b247-a88b-4e08-a4bf-041e8b6f896c tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:49 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5eb1b247-a88b-4e08-a4bf-041e8b6f896c tempest-CreateVolumesFromSnapshotTest-278666822 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:45:49 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-5eb1b247-a88b-4e08-a4bf-041e8b6f896c tempest-CreateVolumesFromSnapshotTest-278666822 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:45:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5eb1b247-a88b-4e08-a4bf-041e8b6f896c tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d3ec996-e568-45ff-acb5-fa35cadbaec2 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:49 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6a0aebb-7aa9-4833-8cfb-6347c4269726 tempest-ProjectReaderTests-921411335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6044d9b9-9d5b-4ace-ac18-2632b3e70c77" returned: 0 in 0.307s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:49 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d3ec996-e568-45ff-acb5-fa35cadbaec2 1073741824 Nov 02 12:45:49 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:49 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b6a0aebb-7aa9-4833-8cfb-6347c4269726 tempest-ProjectReaderTests-921411335 None] Lock "cinder-quobyte-6044d9b9-9d5b-4ace-ac18-2632b3e70c77" released by "delete_volume" :: held 0.864s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3be0dc9a-e2f2-4404-9ead-f45358df3c3c tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0c38a9b-40cd-4153-b90b-14d9605d390a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bca542b7-2341-4918-bbf1-2d664fa3dc64', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3be0dc9a-e2f2-4404-9ead-f45358df3c3c tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a88a500-cc1a-4a2e-998f-057ca007d054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:49 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-3be0dc9a-e2f2-4404-9ead-f45358df3c3c tempest-CreateVolumesFromSnapshotTest-278666822 None] Volume volume-bca542b7-2341-4918-bbf1-2d664fa3dc64 (bca542b7-2341-4918-bbf1-2d664fa3dc64): created successfully Nov 02 12:45:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3be0dc9a-e2f2-4404-9ead-f45358df3c3c tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a88a500-cc1a-4a2e-998f-057ca007d054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:49 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3be0dc9a-e2f2-4404-9ead-f45358df3c3c tempest-CreateVolumesFromSnapshotTest-278666822 None] Flow 'volume_create_manager' (6ec99658-3036-4117-8a02-16fd7a410079) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:49 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-3be0dc9a-e2f2-4404-9ead-f45358df3c3c tempest-CreateVolumesFromSnapshotTest-278666822 None] Created volume successfully. Nov 02 12:45:49 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-b6a0aebb-7aa9-4833-8cfb-6347c4269726 tempest-ProjectReaderTests-921411335 None] Created reservations ['17980cf8-9737-4b82-a0cb-bae0a01cc3ea', '4c41d00c-b413-449c-8296-54a176a3c09f', '49def024-c87d-4b66-a85d-628a41d33b09', 'ae52a2ff-d163-4911-959b-67933b95bc54'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b6a0aebb-7aa9-4833-8cfb-6347c4269726 tempest-ProjectReaderTests-921411335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b6a0aebb-7aa9-4833-8cfb-6347c4269726 tempest-ProjectReaderTests-921411335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:49 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b6a0aebb-7aa9-4833-8cfb-6347c4269726 tempest-ProjectReaderTests-921411335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:49 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b6a0aebb-7aa9-4833-8cfb-6347c4269726 tempest-ProjectReaderTests-921411335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b6a0aebb-7aa9-4833-8cfb-6347c4269726 tempest-ProjectReaderTests-921411335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6a0aebb-7aa9-4833-8cfb-6347c4269726 tempest-ProjectReaderTests-921411335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:49 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:45:49 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:50 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5eb1b247-a88b-4e08-a4bf-041e8b6f896c tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d3ec996-e568-45ff-acb5-fa35cadbaec2 1073741824" returned: 0 in 0.548s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:50 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b6a0aebb-7aa9-4833-8cfb-6347c4269726 tempest-ProjectReaderTests-921411335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.317s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:50 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-b6a0aebb-7aa9-4833-8cfb-6347c4269726 tempest-ProjectReaderTests-921411335 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:45:50 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-b6a0aebb-7aa9-4833-8cfb-6347c4269726 tempest-ProjectReaderTests-921411335 None] Deleted volume successfully. Nov 02 12:45:50 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b6a0aebb-7aa9-4833-8cfb-6347c4269726 tempest-ProjectReaderTests-921411335 None] Lock "cinder-6044d9b9-9d5b-4ace-ac18-2632b3e70c77-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5eb1b247-a88b-4e08-a4bf-041e8b6f896c tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d3ec996-e568-45ff-acb5-fa35cadbaec2 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:50 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d3ec996-e568-45ff-acb5-fa35cadbaec2 Nov 02 12:45:50 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:50 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9e798195-e944-494e-a62b-280fe4429291 tempest-ProjectReaderTests-153927055 None] Acquiring lock "cinder-39a74901-86bd-4960-ad41-2a24729ad3d2-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:50 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5eb1b247-a88b-4e08-a4bf-041e8b6f896c tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d3ec996-e568-45ff-acb5-fa35cadbaec2" returned: 0 in 0.292s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:50 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5eb1b247-a88b-4e08-a4bf-041e8b6f896c tempest-CreateVolumesFromSnapshotTest-278666822 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:45:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5eb1b247-a88b-4e08-a4bf-041e8b6f896c tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-524558e4-06cd-47f1-925f-6cc22ae0f865 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.962s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:50 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-524558e4-06cd-47f1-925f-6cc22ae0f865 tempest-CreateVolumesFromSnapshotTest-278666822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1455199717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd11ca83-b0fc-409b-a5d0-d9cb056fae03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce877e21e4b14f8e954bcd6d98b8d237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:46Z,use_quota=True,user_id='dacbce82b49e4514894656b674c09c0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:45:50 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-524558e4-06cd-47f1-925f-6cc22ae0f865 tempest-CreateVolumesFromSnapshotTest-278666822 None] Creating volume bd11ca83-b0fc-409b-a5d0-d9cb056fae03 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:45:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-524558e4-06cd-47f1-925f-6cc22ae0f865 tempest-CreateVolumesFromSnapshotTest-278666822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-524558e4-06cd-47f1-925f-6cc22ae0f865 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:50 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-524558e4-06cd-47f1-925f-6cc22ae0f865 tempest-CreateVolumesFromSnapshotTest-278666822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:50 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-524558e4-06cd-47f1-925f-6cc22ae0f865 tempest-CreateVolumesFromSnapshotTest-278666822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-524558e4-06cd-47f1-925f-6cc22ae0f865 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:50 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-524558e4-06cd-47f1-925f-6cc22ae0f865 tempest-CreateVolumesFromSnapshotTest-278666822 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:45:50 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-524558e4-06cd-47f1-925f-6cc22ae0f865 tempest-CreateVolumesFromSnapshotTest-278666822 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:45:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-524558e4-06cd-47f1-925f-6cc22ae0f865 tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd11ca83-b0fc-409b-a5d0-d9cb056fae03 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:50 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9e798195-e944-494e-a62b-280fe4429291 tempest-ProjectReaderTests-153927055 None] Lock "cinder-39a74901-86bd-4960-ad41-2a24729ad3d2-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:50 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd11ca83-b0fc-409b-a5d0-d9cb056fae03 1073741824 Nov 02 12:45:50 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:50 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5eb1b247-a88b-4e08-a4bf-041e8b6f896c tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2828eb6-4956-46f2-99f2-6abc941f6e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d3ec996-e568-45ff-acb5-fa35cadbaec2', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:50 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5eb1b247-a88b-4e08-a4bf-041e8b6f896c tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b748318-14dc-4363-9fe3-71db19dc2a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:50 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-5eb1b247-a88b-4e08-a4bf-041e8b6f896c tempest-CreateVolumesFromSnapshotTest-278666822 None] Volume volume-3d3ec996-e568-45ff-acb5-fa35cadbaec2 (3d3ec996-e568-45ff-acb5-fa35cadbaec2): created successfully Nov 02 12:45:50 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5eb1b247-a88b-4e08-a4bf-041e8b6f896c tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b748318-14dc-4363-9fe3-71db19dc2a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:50 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-5eb1b247-a88b-4e08-a4bf-041e8b6f896c tempest-CreateVolumesFromSnapshotTest-278666822 None] Flow 'volume_create_manager' (f4fe8bd8-71cf-44e2-9792-992279545c56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:50 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-5eb1b247-a88b-4e08-a4bf-041e8b6f896c tempest-CreateVolumesFromSnapshotTest-278666822 None] Created volume successfully. Nov 02 12:45:50 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9e798195-e944-494e-a62b-280fe4429291 tempest-ProjectReaderTests-153927055 None] Acquiring lock "cinder-quobyte-39a74901-86bd-4960-ad41-2a24729ad3d2" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:50 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9e798195-e944-494e-a62b-280fe4429291 tempest-ProjectReaderTests-153927055 None] Lock "cinder-quobyte-39a74901-86bd-4960-ad41-2a24729ad3d2" acquired by "delete_volume" :: waited 0.021s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:50 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[304aa80c-6b52-4357-af87-3b94c92505bd]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9e798195-e944-494e-a62b-280fe4429291 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:50 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2 Nov 02 12:45:50 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-1037b863-300f-4f44-a51a-cc730432e501 tempest-ProjectMemberTests-1154001707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1037b863-300f-4f44-a51a-cc730432e501 tempest-ProjectMemberTests-1154001707 None] Flow 'volume_create_manager' (10adbfbd-b0b6-414b-b694-68caf044a404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1037b863-300f-4f44-a51a-cc730432e501 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4305b556-8f2b-4989-b52c-4ff235d6482d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1037b863-300f-4f44-a51a-cc730432e501 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4305b556-8f2b-4989-b52c-4ff235d6482d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1512292069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad01bc10-fe33-44e0-86e8-3cce0aede892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60099afac3fc4cb3b2313235ee5a57b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:51Z,use_quota=True,user_id='466fcf287769488eaa04f91080ae1f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1037b863-300f-4f44-a51a-cc730432e501 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (743f0044-8fa0-44da-a5af-c3fa99956abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:51 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1037b863-300f-4f44-a51a-cc730432e501 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (743f0044-8fa0-44da-a5af-c3fa99956abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1037b863-300f-4f44-a51a-cc730432e501 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fbd1c76-efb2-468e-94c8-948b9ac29249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1037b863-300f-4f44-a51a-cc730432e501 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fbd1c76-efb2-468e-94c8-948b9ac29249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad01bc10-fe33-44e0-86e8-3cce0aede892', 'volume_name': 'volume-ad01bc10-fe33-44e0-86e8-3cce0aede892', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1037b863-300f-4f44-a51a-cc730432e501 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77f6aacd-eab9-4ebe-a807-5c554eb2f830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1037b863-300f-4f44-a51a-cc730432e501 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77f6aacd-eab9-4ebe-a807-5c554eb2f830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1037b863-300f-4f44-a51a-cc730432e501 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95c020b2-2f56-49af-aab3-99d2855b5b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:51 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-1037b863-300f-4f44-a51a-cc730432e501 tempest-ProjectMemberTests-1154001707 None] Volume ad01bc10-fe33-44e0-86e8-3cce0aede892: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad01bc10-fe33-44e0-86e8-3cce0aede892', 'volume_size': 1} Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1037b863-300f-4f44-a51a-cc730432e501 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-524558e4-06cd-47f1-925f-6cc22ae0f865 tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd11ca83-b0fc-409b-a5d0-d9cb056fae03 1073741824" returned: 0 in 0.633s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-524558e4-06cd-47f1-925f-6cc22ae0f865 tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd11ca83-b0fc-409b-a5d0-d9cb056fae03 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:51 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd11ca83-b0fc-409b-a5d0-d9cb056fae03 Nov 02 12:45:51 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:51 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9e798195-e944-494e-a62b-280fe4429291 tempest-ProjectReaderTests-153927055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2" returned: 0 in 0.518s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9e798195-e944-494e-a62b-280fe4429291 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:51 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2 Nov 02 12:45:51 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:51 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-524558e4-06cd-47f1-925f-6cc22ae0f865 tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd11ca83-b0fc-409b-a5d0-d9cb056fae03" returned: 0 in 0.264s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-524558e4-06cd-47f1-925f-6cc22ae0f865 tempest-CreateVolumesFromSnapshotTest-278666822 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-524558e4-06cd-47f1-925f-6cc22ae0f865 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d9867ae3-6b43-4fd0-93bc-5d851f07a778 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.556s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d9867ae3-6b43-4fd0-93bc-5d851f07a778 tempest-CreateVolumesFromSnapshotTest-278666822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1618901330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cd834b2-21df-4346-8196-a338ad785b65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce877e21e4b14f8e954bcd6d98b8d237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:47Z,use_quota=True,user_id='dacbce82b49e4514894656b674c09c0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-d9867ae3-6b43-4fd0-93bc-5d851f07a778 tempest-CreateVolumesFromSnapshotTest-278666822 None] Creating volume 1cd834b2-21df-4346-8196-a338ad785b65 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d9867ae3-6b43-4fd0-93bc-5d851f07a778 tempest-CreateVolumesFromSnapshotTest-278666822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d9867ae3-6b43-4fd0-93bc-5d851f07a778 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d9867ae3-6b43-4fd0-93bc-5d851f07a778 tempest-CreateVolumesFromSnapshotTest-278666822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d9867ae3-6b43-4fd0-93bc-5d851f07a778 tempest-CreateVolumesFromSnapshotTest-278666822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d9867ae3-6b43-4fd0-93bc-5d851f07a778 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d9867ae3-6b43-4fd0-93bc-5d851f07a778 tempest-CreateVolumesFromSnapshotTest-278666822 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:45:51 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-d9867ae3-6b43-4fd0-93bc-5d851f07a778 tempest-CreateVolumesFromSnapshotTest-278666822 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d9867ae3-6b43-4fd0-93bc-5d851f07a778 tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1cd834b2-21df-4346-8196-a338ad785b65 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-524558e4-06cd-47f1-925f-6cc22ae0f865 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e88c1b4e-fb11-486d-88c7-caa8a5bd4bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd11ca83-b0fc-409b-a5d0-d9cb056fae03', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-524558e4-06cd-47f1-925f-6cc22ae0f865 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09ad31a5-de27-4752-a21f-76f9ec409067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:51 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1cd834b2-21df-4346-8196-a338ad785b65 1073741824 Nov 02 12:45:51 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:51 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-524558e4-06cd-47f1-925f-6cc22ae0f865 tempest-CreateVolumesFromSnapshotTest-278666822 None] Volume volume-bd11ca83-b0fc-409b-a5d0-d9cb056fae03 (bd11ca83-b0fc-409b-a5d0-d9cb056fae03): created successfully Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-524558e4-06cd-47f1-925f-6cc22ae0f865 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09ad31a5-de27-4752-a21f-76f9ec409067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-524558e4-06cd-47f1-925f-6cc22ae0f865 tempest-CreateVolumesFromSnapshotTest-278666822 None] Flow 'volume_create_manager' (a167c9b1-e8c5-42be-8dc1-c2c7f0bb4839) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:51 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9e798195-e944-494e-a62b-280fe4429291 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-39a74901-86bd-4960-ad41-2a24729ad3d2" returned: 0 in 0.314s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9e798195-e944-494e-a62b-280fe4429291 tempest-ProjectReaderTests-153927055 None] Lock "cinder-quobyte-39a74901-86bd-4960-ad41-2a24729ad3d2" released by "delete_volume" :: held 0.928s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:51 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-524558e4-06cd-47f1-925f-6cc22ae0f865 tempest-CreateVolumesFromSnapshotTest-278666822 None] Created volume successfully. Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-9e798195-e944-494e-a62b-280fe4429291 tempest-ProjectReaderTests-153927055 None] Created reservations ['42136305-a080-4a00-ab94-7d3c56d2ac04', 'ca939ded-eb22-478d-bb3e-6e9ff34f1cb6', '4634f46e-2b1c-4afa-917b-5cd3a670c84c', 'edabe8ab-13aa-4379-9046-08558666ec1a'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-9e798195-e944-494e-a62b-280fe4429291 tempest-ProjectReaderTests-153927055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-9e798195-e944-494e-a62b-280fe4429291 tempest-ProjectReaderTests-153927055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-9e798195-e944-494e-a62b-280fe4429291 tempest-ProjectReaderTests-153927055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-9e798195-e944-494e-a62b-280fe4429291 tempest-ProjectReaderTests-153927055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-9e798195-e944-494e-a62b-280fe4429291 tempest-ProjectReaderTests-153927055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9e798195-e944-494e-a62b-280fe4429291 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:51 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:45:51 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:52 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d9867ae3-6b43-4fd0-93bc-5d851f07a778 tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1cd834b2-21df-4346-8196-a338ad785b65 1073741824" returned: 0 in 0.529s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d9867ae3-6b43-4fd0-93bc-5d851f07a778 tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1cd834b2-21df-4346-8196-a338ad785b65 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:52 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9e798195-e944-494e-a62b-280fe4429291 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.324s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:52 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-9e798195-e944-494e-a62b-280fe4429291 tempest-ProjectReaderTests-153927055 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:45:52 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-9e798195-e944-494e-a62b-280fe4429291 tempest-ProjectReaderTests-153927055 None] Deleted volume successfully. Nov 02 12:45:52 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1cd834b2-21df-4346-8196-a338ad785b65 Nov 02 12:45:52 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:52 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9e798195-e944-494e-a62b-280fe4429291 tempest-ProjectReaderTests-153927055 None] Lock "cinder-39a74901-86bd-4960-ad41-2a24729ad3d2-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:52 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d9867ae3-6b43-4fd0-93bc-5d851f07a778 tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1cd834b2-21df-4346-8196-a338ad785b65" returned: 0 in 0.287s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:52 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d9867ae3-6b43-4fd0-93bc-5d851f07a778 tempest-CreateVolumesFromSnapshotTest-278666822 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:45:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d9867ae3-6b43-4fd0-93bc-5d851f07a778 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1037b863-300f-4f44-a51a-cc730432e501 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.209s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:52 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-1037b863-300f-4f44-a51a-cc730432e501 tempest-ProjectMemberTests-1154001707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1512292069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad01bc10-fe33-44e0-86e8-3cce0aede892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60099afac3fc4cb3b2313235ee5a57b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:51Z,use_quota=True,user_id='466fcf287769488eaa04f91080ae1f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:45:52 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-1037b863-300f-4f44-a51a-cc730432e501 tempest-ProjectMemberTests-1154001707 None] Creating volume ad01bc10-fe33-44e0-86e8-3cce0aede892 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:45:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1037b863-300f-4f44-a51a-cc730432e501 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1037b863-300f-4f44-a51a-cc730432e501 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:52 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-1037b863-300f-4f44-a51a-cc730432e501 tempest-ProjectMemberTests-1154001707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:52 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-1037b863-300f-4f44-a51a-cc730432e501 tempest-ProjectMemberTests-1154001707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1037b863-300f-4f44-a51a-cc730432e501 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:52 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-1037b863-300f-4f44-a51a-cc730432e501 tempest-ProjectMemberTests-1154001707 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:45:52 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-1037b863-300f-4f44-a51a-cc730432e501 tempest-ProjectMemberTests-1154001707 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:45:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1037b863-300f-4f44-a51a-cc730432e501 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:52 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9867ae3-6b43-4fd0-93bc-5d851f07a778 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (772ad44a-57c0-4879-b921-3fd23504535d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cd834b2-21df-4346-8196-a338ad785b65', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:52 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892 1073741824 Nov 02 12:45:52 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:52 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9867ae3-6b43-4fd0-93bc-5d851f07a778 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eca75a9b-6ded-473a-ace7-bf82b8d1a2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:52 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-d9867ae3-6b43-4fd0-93bc-5d851f07a778 tempest-CreateVolumesFromSnapshotTest-278666822 None] Volume volume-1cd834b2-21df-4346-8196-a338ad785b65 (1cd834b2-21df-4346-8196-a338ad785b65): created successfully Nov 02 12:45:52 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9867ae3-6b43-4fd0-93bc-5d851f07a778 tempest-CreateVolumesFromSnapshotTest-278666822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eca75a9b-6ded-473a-ace7-bf82b8d1a2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:52 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-d9867ae3-6b43-4fd0-93bc-5d851f07a778 tempest-CreateVolumesFromSnapshotTest-278666822 None] Flow 'volume_create_manager' (a606cba9-988e-4be0-b0e8-31ebe24957f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:52 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-d9867ae3-6b43-4fd0-93bc-5d851f07a778 tempest-CreateVolumesFromSnapshotTest-278666822 None] Created volume successfully. Nov 02 12:45:52 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1037b863-300f-4f44-a51a-cc730432e501 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892 1073741824" returned: 0 in 0.498s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1037b863-300f-4f44-a51a-cc730432e501 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:52 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892 Nov 02 12:45:52 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:53 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1037b863-300f-4f44-a51a-cc730432e501 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892" returned: 0 in 0.330s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-1037b863-300f-4f44-a51a-cc730432e501 tempest-ProjectMemberTests-1154001707 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1037b863-300f-4f44-a51a-cc730432e501 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1037b863-300f-4f44-a51a-cc730432e501 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95c020b2-2f56-49af-aab3-99d2855b5b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad01bc10-fe33-44e0-86e8-3cce0aede892', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1037b863-300f-4f44-a51a-cc730432e501 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1e1097c-d613-4b2e-9f12-d3e45a3c1b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:53 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-1037b863-300f-4f44-a51a-cc730432e501 tempest-ProjectMemberTests-1154001707 None] Volume volume-ad01bc10-fe33-44e0-86e8-3cce0aede892 (ad01bc10-fe33-44e0-86e8-3cce0aede892): created successfully Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1037b863-300f-4f44-a51a-cc730432e501 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1e1097c-d613-4b2e-9f12-d3e45a3c1b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1037b863-300f-4f44-a51a-cc730432e501 tempest-ProjectMemberTests-1154001707 None] Flow 'volume_create_manager' (10adbfbd-b0b6-414b-b694-68caf044a404) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:53 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-1037b863-300f-4f44-a51a-cc730432e501 tempest-ProjectMemberTests-1154001707 None] Created volume successfully. Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-6da72f0d-026f-4c68-acf6-e9b10dd52c64 tempest-ProjectReaderTests-153927055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-6da72f0d-026f-4c68-acf6-e9b10dd52c64 tempest-ProjectReaderTests-153927055 None] Flow 'volume_create_manager' (2121ef0f-3234-436b-8062-1367dfa8380f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-6da72f0d-026f-4c68-acf6-e9b10dd52c64 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8673b74f-fd5d-46ee-90a0-1c94e6d1be9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-6da72f0d-026f-4c68-acf6-e9b10dd52c64 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8673b74f-fd5d-46ee-90a0-1c94e6d1be9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-745838299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=667bf6ed-afa9-4a86-9d51-86079de1e4a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='371854aebb9b4c37b51206a234c0f7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:53Z,use_quota=True,user_id='2859c42cc4c64316a323f9dd6c533e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-6da72f0d-026f-4c68-acf6-e9b10dd52c64 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11723f4e-6eb7-477d-b420-5b354b76173f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-6da72f0d-026f-4c68-acf6-e9b10dd52c64 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11723f4e-6eb7-477d-b420-5b354b76173f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-6da72f0d-026f-4c68-acf6-e9b10dd52c64 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3139626a-9675-490d-9c0d-5d8612dc408b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-6da72f0d-026f-4c68-acf6-e9b10dd52c64 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3139626a-9675-490d-9c0d-5d8612dc408b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '667bf6ed-afa9-4a86-9d51-86079de1e4a3', 'volume_name': 'volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-6da72f0d-026f-4c68-acf6-e9b10dd52c64 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ccf89dc-15ab-4f19-a901-c1a89126d8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-6da72f0d-026f-4c68-acf6-e9b10dd52c64 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ccf89dc-15ab-4f19-a901-c1a89126d8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-6da72f0d-026f-4c68-acf6-e9b10dd52c64 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3129b7b2-02ba-436b-a2ac-29bcee809bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:53 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-6da72f0d-026f-4c68-acf6-e9b10dd52c64 tempest-ProjectReaderTests-153927055 None] Volume 667bf6ed-afa9-4a86-9d51-86079de1e4a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3', 'volume_size': 1} Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-6da72f0d-026f-4c68-acf6-e9b10dd52c64 tempest-ProjectReaderTests-153927055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-6da72f0d-026f-4c68-acf6-e9b10dd52c64 tempest-ProjectReaderTests-153927055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-6da72f0d-026f-4c68-acf6-e9b10dd52c64 tempest-ProjectReaderTests-153927055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-745838299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=667bf6ed-afa9-4a86-9d51-86079de1e4a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='371854aebb9b4c37b51206a234c0f7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:45:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:45:53Z,use_quota=True,user_id='2859c42cc4c64316a323f9dd6c533e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-6da72f0d-026f-4c68-acf6-e9b10dd52c64 tempest-ProjectReaderTests-153927055 None] Creating volume 667bf6ed-afa9-4a86-9d51-86079de1e4a3 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-6da72f0d-026f-4c68-acf6-e9b10dd52c64 tempest-ProjectReaderTests-153927055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-6da72f0d-026f-4c68-acf6-e9b10dd52c64 tempest-ProjectReaderTests-153927055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-6da72f0d-026f-4c68-acf6-e9b10dd52c64 tempest-ProjectReaderTests-153927055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-6da72f0d-026f-4c68-acf6-e9b10dd52c64 tempest-ProjectReaderTests-153927055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-6da72f0d-026f-4c68-acf6-e9b10dd52c64 tempest-ProjectReaderTests-153927055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-6da72f0d-026f-4c68-acf6-e9b10dd52c64 tempest-ProjectReaderTests-153927055 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:45:53 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-6da72f0d-026f-4c68-acf6-e9b10dd52c64 tempest-ProjectReaderTests-153927055 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6da72f0d-026f-4c68-acf6-e9b10dd52c64 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:53 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3 1073741824 Nov 02 12:45:53 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d0331979-ed11-48f7-84f6-cedb801f82d9 tempest-CreateVolumesFromSnapshotTest-278666822 None] Acquiring lock "cinder-1cd834b2-21df-4346-8196-a338ad785b65-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d0331979-ed11-48f7-84f6-cedb801f82d9 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "cinder-1cd834b2-21df-4346-8196-a338ad785b65-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d0331979-ed11-48f7-84f6-cedb801f82d9 tempest-CreateVolumesFromSnapshotTest-278666822 None] Acquiring lock "cinder-quobyte-1cd834b2-21df-4346-8196-a338ad785b65" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d0331979-ed11-48f7-84f6-cedb801f82d9 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "cinder-quobyte-1cd834b2-21df-4346-8196-a338ad785b65" acquired by "delete_volume" :: waited 0.024s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6aac7a8-88c9-4b0b-83f8-a6504d5e5736]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d0331979-ed11-48f7-84f6-cedb801f82d9 tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1cd834b2-21df-4346-8196-a338ad785b65 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:53 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1cd834b2-21df-4346-8196-a338ad785b65 Nov 02 12:45:53 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:53 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6da72f0d-026f-4c68-acf6-e9b10dd52c64 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3 1073741824" returned: 0 in 0.463s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6da72f0d-026f-4c68-acf6-e9b10dd52c64 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:53 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3 Nov 02 12:45:53 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:54 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d0331979-ed11-48f7-84f6-cedb801f82d9 tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1cd834b2-21df-4346-8196-a338ad785b65" returned: 0 in 0.381s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d0331979-ed11-48f7-84f6-cedb801f82d9 tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1cd834b2-21df-4346-8196-a338ad785b65 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:54 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1cd834b2-21df-4346-8196-a338ad785b65 Nov 02 12:45:54 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:54 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6da72f0d-026f-4c68-acf6-e9b10dd52c64 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3" returned: 0 in 0.278s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-6da72f0d-026f-4c68-acf6-e9b10dd52c64 tempest-ProjectReaderTests-153927055 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:45:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-6da72f0d-026f-4c68-acf6-e9b10dd52c64 tempest-ProjectReaderTests-153927055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-6da72f0d-026f-4c68-acf6-e9b10dd52c64 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3129b7b2-02ba-436b-a2ac-29bcee809bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-6da72f0d-026f-4c68-acf6-e9b10dd52c64 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c540d101-9df6-4d69-b1e8-59b448ef3151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:45:54 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-6da72f0d-026f-4c68-acf6-e9b10dd52c64 tempest-ProjectReaderTests-153927055 None] Volume volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3 (667bf6ed-afa9-4a86-9d51-86079de1e4a3): created successfully Nov 02 12:45:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-6da72f0d-026f-4c68-acf6-e9b10dd52c64 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c540d101-9df6-4d69-b1e8-59b448ef3151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:45:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-6da72f0d-026f-4c68-acf6-e9b10dd52c64 tempest-ProjectReaderTests-153927055 None] Flow 'volume_create_manager' (2121ef0f-3234-436b-8062-1367dfa8380f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:45:54 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-6da72f0d-026f-4c68-acf6-e9b10dd52c64 tempest-ProjectReaderTests-153927055 None] Created volume successfully. Nov 02 12:45:54 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d0331979-ed11-48f7-84f6-cedb801f82d9 tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-1cd834b2-21df-4346-8196-a338ad785b65" returned: 0 in 0.290s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:54 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d0331979-ed11-48f7-84f6-cedb801f82d9 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "cinder-quobyte-1cd834b2-21df-4346-8196-a338ad785b65" released by "delete_volume" :: held 0.720s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:54 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-d0331979-ed11-48f7-84f6-cedb801f82d9 tempest-CreateVolumesFromSnapshotTest-278666822 None] Created reservations ['cdfd94b6-7edc-4c8b-bf61-acf4b2fcad11', 'd9a33a8a-a51e-4169-8ca8-244d3915be60', 'ddf3a5b9-c57a-4209-b836-4a00c2638469', '325a8df6-e84f-479c-9af6-f1fb66deee46'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d0331979-ed11-48f7-84f6-cedb801f82d9 tempest-CreateVolumesFromSnapshotTest-278666822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d0331979-ed11-48f7-84f6-cedb801f82d9 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d0331979-ed11-48f7-84f6-cedb801f82d9 tempest-CreateVolumesFromSnapshotTest-278666822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-d0331979-ed11-48f7-84f6-cedb801f82d9 tempest-CreateVolumesFromSnapshotTest-278666822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-d0331979-ed11-48f7-84f6-cedb801f82d9 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d0331979-ed11-48f7-84f6-cedb801f82d9 tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:54 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:45:54 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:54 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-87774b91-1130-4e33-ba1a-508460f4c5a3 tempest-CreateVolumesFromSnapshotTest-278666822 None] Acquiring lock "cinder-bd11ca83-b0fc-409b-a5d0-d9cb056fae03-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:54 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b3c5f3bc-664f-4cf4-a277-fbfcb6026b6a tempest-ProjectMemberTests-1154001707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b3c5f3bc-664f-4cf4-a277-fbfcb6026b6a tempest-ProjectMemberTests-1154001707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d0331979-ed11-48f7-84f6-cedb801f82d9 tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.284s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:54 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-d0331979-ed11-48f7-84f6-cedb801f82d9 tempest-CreateVolumesFromSnapshotTest-278666822 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:45:54 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-87774b91-1130-4e33-ba1a-508460f4c5a3 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "cinder-bd11ca83-b0fc-409b-a5d0-d9cb056fae03-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:54 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-d0331979-ed11-48f7-84f6-cedb801f82d9 tempest-CreateVolumesFromSnapshotTest-278666822 None] Deleted volume successfully. Nov 02 12:45:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-b3c5f3bc-664f-4cf4-a277-fbfcb6026b6a tempest-ProjectMemberTests-1154001707 None] Creating offline snapshot ed2d652c-4411-4d62-b779-375b09360ef0 of volume ad01bc10-fe33-44e0-86e8-3cce0aede892 {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:45:54 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dd9bc0-9bac-462f-a8e7-920b80166bf1]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b3c5f3bc-664f-4cf4-a277-fbfcb6026b6a tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:54 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d0331979-ed11-48f7-84f6-cedb801f82d9 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "cinder-1cd834b2-21df-4346-8196-a338ad785b65-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:54 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-87774b91-1130-4e33-ba1a-508460f4c5a3 tempest-CreateVolumesFromSnapshotTest-278666822 None] Acquiring lock "cinder-quobyte-bd11ca83-b0fc-409b-a5d0-d9cb056fae03" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:54 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-87774b91-1130-4e33-ba1a-508460f4c5a3 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "cinder-quobyte-bd11ca83-b0fc-409b-a5d0-d9cb056fae03" acquired by "delete_volume" :: waited 0.013s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:54 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[70546664-2783-43e6-8eca-b29426532d13]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-87774b91-1130-4e33-ba1a-508460f4c5a3 tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd11ca83-b0fc-409b-a5d0-d9cb056fae03 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:54 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892 Nov 02 12:45:54 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:55 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd11ca83-b0fc-409b-a5d0-d9cb056fae03 Nov 02 12:45:55 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:55 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b3c5f3bc-664f-4cf4-a277-fbfcb6026b6a tempest-ProjectMemberTests-1154001707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892" returned: 0 in 0.394s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b3c5f3bc-664f-4cf4-a277-fbfcb6026b6a tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892.ed2d652c-4411-4d62-b779-375b09360ef0 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:55 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892.ed2d652c-4411-4d62-b779-375b09360ef0 1G Nov 02 12:45:55 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:55 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-87774b91-1130-4e33-ba1a-508460f4c5a3 tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd11ca83-b0fc-409b-a5d0-d9cb056fae03" returned: 0 in 0.373s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-87774b91-1130-4e33-ba1a-508460f4c5a3 tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd11ca83-b0fc-409b-a5d0-d9cb056fae03 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:55 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd11ca83-b0fc-409b-a5d0-d9cb056fae03 Nov 02 12:45:55 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:55 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-87774b91-1130-4e33-ba1a-508460f4c5a3 tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bd11ca83-b0fc-409b-a5d0-d9cb056fae03" returned: 0 in 0.324s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:55 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-87774b91-1130-4e33-ba1a-508460f4c5a3 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "cinder-quobyte-bd11ca83-b0fc-409b-a5d0-d9cb056fae03" released by "delete_volume" :: held 0.743s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ddfde317-4805-401d-a133-39dc048444dc tempest-ProjectReaderTests-153927055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:55 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-87774b91-1130-4e33-ba1a-508460f4c5a3 tempest-CreateVolumesFromSnapshotTest-278666822 None] Created reservations ['b771da8b-aed6-4e06-b15a-e57fd942000a', '83b74c41-6d22-4de6-8267-626fd9159bc8', '1774d9c5-2d3c-4514-bf23-c75d1070a0b2', 'c0d31a8a-0afa-4e6f-8968-ac09e87108fc'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:55 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b3c5f3bc-664f-4cf4-a277-fbfcb6026b6a tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892.ed2d652c-4411-4d62-b779-375b09360ef0 1G" returned: 0 in 0.468s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b3c5f3bc-664f-4cf4-a277-fbfcb6026b6a tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad01bc10-fe33-44e0-86e8-3cce0aede892 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892.ed2d652c-4411-4d62-b779-375b09360ef0 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:55 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad01bc10-fe33-44e0-86e8-3cce0aede892 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892.ed2d652c-4411-4d62-b779-375b09360ef0 Nov 02 12:45:55 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-87774b91-1130-4e33-ba1a-508460f4c5a3 tempest-CreateVolumesFromSnapshotTest-278666822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-87774b91-1130-4e33-ba1a-508460f4c5a3 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:55 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-87774b91-1130-4e33-ba1a-508460f4c5a3 tempest-CreateVolumesFromSnapshotTest-278666822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:55 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-87774b91-1130-4e33-ba1a-508460f4c5a3 tempest-CreateVolumesFromSnapshotTest-278666822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-87774b91-1130-4e33-ba1a-508460f4c5a3 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-87774b91-1130-4e33-ba1a-508460f4c5a3 tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:55 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:45:55 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:55 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c7fa937f-2fb2-47d0-9690-ad329c12c130 tempest-CreateVolumesFromSnapshotTest-278666822 None] Acquiring lock "cinder-3d3ec996-e568-45ff-acb5-fa35cadbaec2-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:55 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c7fa937f-2fb2-47d0-9690-ad329c12c130 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "cinder-3d3ec996-e568-45ff-acb5-fa35cadbaec2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:56 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b3c5f3bc-664f-4cf4-a277-fbfcb6026b6a tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad01bc10-fe33-44e0-86e8-3cce0aede892 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892.ed2d652c-4411-4d62-b779-375b09360ef0" returned: 0 in 0.344s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:56 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-b3c5f3bc-664f-4cf4-a277-fbfcb6026b6a tempest-ProjectMemberTests-1154001707 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892.ed2d652c-4411-4d62-b779-375b09360ef0 is being set with open permissions: ugo+rw Nov 02 12:45:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b3c5f3bc-664f-4cf4-a277-fbfcb6026b6a tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892.ed2d652c-4411-4d62-b779-375b09360ef0 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:56 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-87774b91-1130-4e33-ba1a-508460f4c5a3 tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.305s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:56 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-87774b91-1130-4e33-ba1a-508460f4c5a3 tempest-CreateVolumesFromSnapshotTest-278666822 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:45:56 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892.ed2d652c-4411-4d62-b779-375b09360ef0 Nov 02 12:45:56 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:56 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c7fa937f-2fb2-47d0-9690-ad329c12c130 tempest-CreateVolumesFromSnapshotTest-278666822 None] Acquiring lock "cinder-quobyte-3d3ec996-e568-45ff-acb5-fa35cadbaec2" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:56 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-87774b91-1130-4e33-ba1a-508460f4c5a3 tempest-CreateVolumesFromSnapshotTest-278666822 None] Deleted volume successfully. Nov 02 12:45:56 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c7fa937f-2fb2-47d0-9690-ad329c12c130 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "cinder-quobyte-3d3ec996-e568-45ff-acb5-fa35cadbaec2" acquired by "delete_volume" :: waited 0.027s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:56 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-87774b91-1130-4e33-ba1a-508460f4c5a3 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "cinder-bd11ca83-b0fc-409b-a5d0-d9cb056fae03-delete_volume" released by "delete_volume" :: held 1.334s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:56 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd92efc7-fe37-4655-b2b5-a5905441850d]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c7fa937f-2fb2-47d0-9690-ad329c12c130 tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d3ec996-e568-45ff-acb5-fa35cadbaec2 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:56 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d3ec996-e568-45ff-acb5-fa35cadbaec2 Nov 02 12:45:56 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:56 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b3c5f3bc-664f-4cf4-a277-fbfcb6026b6a tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892.ed2d652c-4411-4d62-b779-375b09360ef0" returned: 0 in 0.249s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b3c5f3bc-664f-4cf4-a277-fbfcb6026b6a tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:56 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892.info Nov 02 12:45:56 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:56 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c7fa937f-2fb2-47d0-9690-ad329c12c130 tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d3ec996-e568-45ff-acb5-fa35cadbaec2" returned: 0 in 0.387s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c7fa937f-2fb2-47d0-9690-ad329c12c130 tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d3ec996-e568-45ff-acb5-fa35cadbaec2 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:56 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d3ec996-e568-45ff-acb5-fa35cadbaec2 Nov 02 12:45:56 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:56 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b3c5f3bc-664f-4cf4-a277-fbfcb6026b6a tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892.info" returned: 0 in 0.264s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:56 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-b3c5f3bc-664f-4cf4-a277-fbfcb6026b6a tempest-ProjectMemberTests-1154001707 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892.info is being set with open permissions: ugo+rw Nov 02 12:45:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b3c5f3bc-664f-4cf4-a277-fbfcb6026b6a tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:56 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892.info Nov 02 12:45:56 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:56 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c7fa937f-2fb2-47d0-9690-ad329c12c130 tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d3ec996-e568-45ff-acb5-fa35cadbaec2" returned: 0 in 0.256s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:56 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c7fa937f-2fb2-47d0-9690-ad329c12c130 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "cinder-quobyte-3d3ec996-e568-45ff-acb5-fa35cadbaec2" released by "delete_volume" :: held 0.691s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:56 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-c7fa937f-2fb2-47d0-9690-ad329c12c130 tempest-CreateVolumesFromSnapshotTest-278666822 None] Created reservations ['8a3a21fd-a3a8-4c87-9f1b-9a10b34c3b2f', '5dc08111-faf5-48d6-8fc5-e7cb5006cdb0', '1292fe86-f752-4b3d-a637-428de06c5872', '22f61d2c-6b74-4562-89c2-ac7b4338a130'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:56 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b3c5f3bc-664f-4cf4-a277-fbfcb6026b6a tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892.info" returned: 0 in 0.273s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b3c5f3bc-664f-4cf4-a277-fbfcb6026b6a tempest-ProjectMemberTests-1154001707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.121s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ddfde317-4805-401d-a133-39dc048444dc tempest-ProjectReaderTests-153927055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.267s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:56 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-ddfde317-4805-401d-a133-39dc048444dc tempest-ProjectReaderTests-153927055 None] Creating offline snapshot 8bb02f4e-b4b7-4bfd-b054-b58d4d08b26e of volume 667bf6ed-afa9-4a86-9d51-86079de1e4a3 {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:45:56 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-b3c5f3bc-664f-4cf4-a277-fbfcb6026b6a tempest-ProjectMemberTests-1154001707 None] Create snapshot completed successfully Nov 02 12:45:56 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fd935b-2e94-45d3-ad8c-76cfc1667eb6]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ddfde317-4805-401d-a133-39dc048444dc tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c7fa937f-2fb2-47d0-9690-ad329c12c130 tempest-CreateVolumesFromSnapshotTest-278666822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c7fa937f-2fb2-47d0-9690-ad329c12c130 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:56 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-c7fa937f-2fb2-47d0-9690-ad329c12c130 tempest-CreateVolumesFromSnapshotTest-278666822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:56 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-c7fa937f-2fb2-47d0-9690-ad329c12c130 tempest-CreateVolumesFromSnapshotTest-278666822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c7fa937f-2fb2-47d0-9690-ad329c12c130 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c7fa937f-2fb2-47d0-9690-ad329c12c130 tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:57 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:45:57 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:57 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3 Nov 02 12:45:57 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:57 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3d286086-2889-4574-b4ce-9cbdda7a8b47 tempest-CreateVolumesFromSnapshotTest-278666822 None] Acquiring lock "cinder-bca542b7-2341-4918-bbf1-2d664fa3dc64-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:57 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3d286086-2889-4574-b4ce-9cbdda7a8b47 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "cinder-bca542b7-2341-4918-bbf1-2d664fa3dc64-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:57 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3d286086-2889-4574-b4ce-9cbdda7a8b47 tempest-CreateVolumesFromSnapshotTest-278666822 None] Acquiring lock "cinder-quobyte-bca542b7-2341-4918-bbf1-2d664fa3dc64" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:57 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3d286086-2889-4574-b4ce-9cbdda7a8b47 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "cinder-quobyte-bca542b7-2341-4918-bbf1-2d664fa3dc64" acquired by "delete_volume" :: waited 0.028s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:57 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2f3f0b-db74-405c-8875-c030df164f24]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3d286086-2889-4574-b4ce-9cbdda7a8b47 tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bca542b7-2341-4918-bbf1-2d664fa3dc64 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:57 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c7fa937f-2fb2-47d0-9690-ad329c12c130 tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.348s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:57 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-c7fa937f-2fb2-47d0-9690-ad329c12c130 tempest-CreateVolumesFromSnapshotTest-278666822 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:45:57 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-c7fa937f-2fb2-47d0-9690-ad329c12c130 tempest-CreateVolumesFromSnapshotTest-278666822 None] Deleted volume successfully. Nov 02 12:45:57 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ddfde317-4805-401d-a133-39dc048444dc tempest-ProjectReaderTests-153927055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3" returned: 0 in 0.409s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ddfde317-4805-401d-a133-39dc048444dc tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3.8bb02f4e-b4b7-4bfd-b054-b58d4d08b26e 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:57 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bca542b7-2341-4918-bbf1-2d664fa3dc64 Nov 02 12:45:57 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:57 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-c7fa937f-2fb2-47d0-9690-ad329c12c130 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "cinder-3d3ec996-e568-45ff-acb5-fa35cadbaec2-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:57 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3.8bb02f4e-b4b7-4bfd-b054-b58d4d08b26e 1G Nov 02 12:45:57 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:57 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3d286086-2889-4574-b4ce-9cbdda7a8b47 tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bca542b7-2341-4918-bbf1-2d664fa3dc64" returned: 0 in 0.375s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3d286086-2889-4574-b4ce-9cbdda7a8b47 tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bca542b7-2341-4918-bbf1-2d664fa3dc64 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:57 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bca542b7-2341-4918-bbf1-2d664fa3dc64 Nov 02 12:45:57 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:57 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4bf826a0-0481-4632-a46b-b4ed2bd8de8c tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-ed2d652c-4411-4d62-b779-375b09360ef0-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:57 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ddfde317-4805-401d-a133-39dc048444dc tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3.8bb02f4e-b4b7-4bfd-b054-b58d4d08b26e 1G" returned: 0 in 0.487s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ddfde317-4805-401d-a133-39dc048444dc tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3.8bb02f4e-b4b7-4bfd-b054-b58d4d08b26e {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:57 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4bf826a0-0481-4632-a46b-b4ed2bd8de8c tempest-ProjectMemberTests-1154001707 None] Lock "cinder-ed2d652c-4411-4d62-b779-375b09360ef0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:57 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4bf826a0-0481-4632-a46b-b4ed2bd8de8c tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-quobyte-ad01bc10-fe33-44e0-86e8-3cce0aede892" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:57 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3.8bb02f4e-b4b7-4bfd-b054-b58d4d08b26e Nov 02 12:45:57 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:57 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4bf826a0-0481-4632-a46b-b4ed2bd8de8c tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-ad01bc10-fe33-44e0-86e8-3cce0aede892" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:57 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4bf826a0-0481-4632-a46b-b4ed2bd8de8c tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-quobyte-ed2d652c-4411-4d62-b779-375b09360ef0" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:57 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4bf826a0-0481-4632-a46b-b4ed2bd8de8c tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-ed2d652c-4411-4d62-b779-375b09360ef0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:57 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-4bf826a0-0481-4632-a46b-b4ed2bd8de8c tempest-ProjectMemberTests-1154001707 None] Deleting offline snapshot ed2d652c-4411-4d62-b779-375b09360ef0 of volume ad01bc10-fe33-44e0-86e8-3cce0aede892 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:45:57 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-4bf826a0-0481-4632-a46b-b4ed2bd8de8c tempest-ProjectMemberTests-1154001707 None] snapshot_file for this snap is: volume-ad01bc10-fe33-44e0-86e8-3cce0aede892.ed2d652c-4411-4d62-b779-375b09360ef0 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:45:57 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3d286086-2889-4574-b4ce-9cbdda7a8b47 tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-bca542b7-2341-4918-bbf1-2d664fa3dc64" returned: 0 in 0.317s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:57 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7595e4-8c4a-4ebb-a753-57bfd77b90a3]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4bf826a0-0481-4632-a46b-b4ed2bd8de8c tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892.ed2d652c-4411-4d62-b779-375b09360ef0 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:57 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3d286086-2889-4574-b4ce-9cbdda7a8b47 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "cinder-quobyte-bca542b7-2341-4918-bbf1-2d664fa3dc64" released by "delete_volume" :: held 0.748s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:58 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-3d286086-2889-4574-b4ce-9cbdda7a8b47 tempest-CreateVolumesFromSnapshotTest-278666822 None] Created reservations ['b19b5333-8a9f-4199-8dba-5b4958a9d5d6', 'c659e6c3-d067-48f4-bdd4-e5701d97eaf5', '5f546fc9-47f6-41a6-8b5b-25d07a1f5b7e', '4c860677-de6d-423b-a104-ba2a4396b54d'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:58 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892.ed2d652c-4411-4d62-b779-375b09360ef0 Nov 02 12:45:58 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3d286086-2889-4574-b4ce-9cbdda7a8b47 tempest-CreateVolumesFromSnapshotTest-278666822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3d286086-2889-4574-b4ce-9cbdda7a8b47 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:58 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3d286086-2889-4574-b4ce-9cbdda7a8b47 tempest-CreateVolumesFromSnapshotTest-278666822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:58 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3d286086-2889-4574-b4ce-9cbdda7a8b47 tempest-CreateVolumesFromSnapshotTest-278666822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3d286086-2889-4574-b4ce-9cbdda7a8b47 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3d286086-2889-4574-b4ce-9cbdda7a8b47 tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:58 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:45:58 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:58 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ddfde317-4805-401d-a133-39dc048444dc tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3.8bb02f4e-b4b7-4bfd-b054-b58d4d08b26e" returned: 0 in 0.334s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:58 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-ddfde317-4805-401d-a133-39dc048444dc tempest-ProjectReaderTests-153927055 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3.8bb02f4e-b4b7-4bfd-b054-b58d4d08b26e is being set with open permissions: ugo+rw Nov 02 12:45:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ddfde317-4805-401d-a133-39dc048444dc tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3.8bb02f4e-b4b7-4bfd-b054-b58d4d08b26e {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:58 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3.8bb02f4e-b4b7-4bfd-b054-b58d4d08b26e Nov 02 12:45:58 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:58 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e2d12538-5c95-4cc1-b710-a6b3bd54ca62 tempest-CreateVolumesFromSnapshotTest-278666822 None] Acquiring lock "cinder-5ae97964-918e-4ba8-a46c-48e4b5e457bd-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:58 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e2d12538-5c95-4cc1-b710-a6b3bd54ca62 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "cinder-5ae97964-918e-4ba8-a46c-48e4b5e457bd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:58 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e2d12538-5c95-4cc1-b710-a6b3bd54ca62 tempest-CreateVolumesFromSnapshotTest-278666822 None] Acquiring lock "cinder-quobyte-5ae97964-918e-4ba8-a46c-48e4b5e457bd" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:58 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3d286086-2889-4574-b4ce-9cbdda7a8b47 tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.293s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:58 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-3d286086-2889-4574-b4ce-9cbdda7a8b47 tempest-CreateVolumesFromSnapshotTest-278666822 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:45:58 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-3d286086-2889-4574-b4ce-9cbdda7a8b47 tempest-CreateVolumesFromSnapshotTest-278666822 None] Deleted volume successfully. Nov 02 12:45:58 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:58 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e2d12538-5c95-4cc1-b710-a6b3bd54ca62 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "cinder-quobyte-5ae97964-918e-4ba8-a46c-48e4b5e457bd" acquired by "delete_volume" :: waited 0.030s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4bf826a0-0481-4632-a46b-b4ed2bd8de8c tempest-ProjectMemberTests-1154001707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892.ed2d652c-4411-4d62-b779-375b09360ef0" returned: 0 in 0.480s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:58 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-4bf826a0-0481-4632-a46b-b4ed2bd8de8c tempest-ProjectMemberTests-1154001707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad01bc10-fe33-44e0-86e8-3cce0aede892(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:45:58 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[170f13f0-e1a1-428b-87c1-6226a746d8b8]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e2d12538-5c95-4cc1-b710-a6b3bd54ca62 tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5ae97964-918e-4ba8-a46c-48e4b5e457bd {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:58 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[6baf8faf-b34a-471a-8e96-86bb7189a5f7]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4bf826a0-0481-4632-a46b-b4ed2bd8de8c tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:58 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3d286086-2889-4574-b4ce-9cbdda7a8b47 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "cinder-bca542b7-2341-4918-bbf1-2d664fa3dc64-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:58 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ddfde317-4805-401d-a133-39dc048444dc tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3.8bb02f4e-b4b7-4bfd-b054-b58d4d08b26e" returned: 0 in 0.351s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:58 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5ae97964-918e-4ba8-a46c-48e4b5e457bd Nov 02 12:45:58 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ddfde317-4805-401d-a133-39dc048444dc tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:58 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3.info Nov 02 12:45:58 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:58 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892 Nov 02 12:45:58 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:58 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ddfde317-4805-401d-a133-39dc048444dc tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3.info" returned: 0 in 0.257s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:58 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-ddfde317-4805-401d-a133-39dc048444dc tempest-ProjectReaderTests-153927055 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3.info is being set with open permissions: ugo+rw Nov 02 12:45:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ddfde317-4805-401d-a133-39dc048444dc tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:58 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3.info Nov 02 12:45:58 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:58 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e2d12538-5c95-4cc1-b710-a6b3bd54ca62 tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5ae97964-918e-4ba8-a46c-48e4b5e457bd" returned: 0 in 0.428s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e2d12538-5c95-4cc1-b710-a6b3bd54ca62 tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5ae97964-918e-4ba8-a46c-48e4b5e457bd {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:58 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5ae97964-918e-4ba8-a46c-48e4b5e457bd Nov 02 12:45:58 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:58 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4bf826a0-0481-4632-a46b-b4ed2bd8de8c tempest-ProjectMemberTests-1154001707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892" returned: 0 in 0.455s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4bf826a0-0481-4632-a46b-b4ed2bd8de8c tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892.ed2d652c-4411-4d62-b779-375b09360ef0 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:58 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892.ed2d652c-4411-4d62-b779-375b09360ef0 Nov 02 12:45:58 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:59 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ddfde317-4805-401d-a133-39dc048444dc tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3.info" returned: 0 in 0.268s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ddfde317-4805-401d-a133-39dc048444dc tempest-ProjectReaderTests-153927055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.260s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:59 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e2d12538-5c95-4cc1-b710-a6b3bd54ca62 tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-5ae97964-918e-4ba8-a46c-48e4b5e457bd" returned: 0 in 0.274s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e2d12538-5c95-4cc1-b710-a6b3bd54ca62 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "cinder-quobyte-5ae97964-918e-4ba8-a46c-48e4b5e457bd" released by "delete_volume" :: held 0.758s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:59 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-ddfde317-4805-401d-a133-39dc048444dc tempest-ProjectReaderTests-153927055 None] Create snapshot completed successfully Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-e2d12538-5c95-4cc1-b710-a6b3bd54ca62 tempest-CreateVolumesFromSnapshotTest-278666822 None] Created reservations ['e1a2acc5-c64c-43ed-8f92-2e854459eb5e', '4d252b22-dbd8-4023-9b59-5796887e9df7', '8af927b6-8608-4fc2-b09d-804ecb93011c', '5f158cca-d754-4ca3-b292-3c34cd78a1e9'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e2d12538-5c95-4cc1-b710-a6b3bd54ca62 tempest-CreateVolumesFromSnapshotTest-278666822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e2d12538-5c95-4cc1-b710-a6b3bd54ca62 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e2d12538-5c95-4cc1-b710-a6b3bd54ca62 tempest-CreateVolumesFromSnapshotTest-278666822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e2d12538-5c95-4cc1-b710-a6b3bd54ca62 tempest-CreateVolumesFromSnapshotTest-278666822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e2d12538-5c95-4cc1-b710-a6b3bd54ca62 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e2d12538-5c95-4cc1-b710-a6b3bd54ca62 tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:59 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4bf826a0-0481-4632-a46b-b4ed2bd8de8c tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892.ed2d652c-4411-4d62-b779-375b09360ef0" returned: 0 in 0.392s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4bf826a0-0481-4632-a46b-b4ed2bd8de8c tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892.ed2d652c-4411-4d62-b779-375b09360ef0 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:59 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:45:59 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:59 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892.ed2d652c-4411-4d62-b779-375b09360ef0 Nov 02 12:45:59 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7686f1b0-2e53-44b6-a12c-a6f27266ac07 tempest-CreateVolumesFromSnapshotTest-278666822 None] Acquiring lock "cinder-7cc6434c-dffb-45d7-8c7f-07f3102bea57-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7686f1b0-2e53-44b6-a12c-a6f27266ac07 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "cinder-7cc6434c-dffb-45d7-8c7f-07f3102bea57-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7686f1b0-2e53-44b6-a12c-a6f27266ac07 tempest-CreateVolumesFromSnapshotTest-278666822 None] Acquiring lock "cinder-quobyte-e02d4e74-e545-4e8c-8112-4873b93e7a87" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7686f1b0-2e53-44b6-a12c-a6f27266ac07 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "cinder-quobyte-e02d4e74-e545-4e8c-8112-4873b93e7a87" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7686f1b0-2e53-44b6-a12c-a6f27266ac07 tempest-CreateVolumesFromSnapshotTest-278666822 None] Acquiring lock "cinder-quobyte-7cc6434c-dffb-45d7-8c7f-07f3102bea57" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7686f1b0-2e53-44b6-a12c-a6f27266ac07 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "cinder-quobyte-7cc6434c-dffb-45d7-8c7f-07f3102bea57" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-7686f1b0-2e53-44b6-a12c-a6f27266ac07 tempest-CreateVolumesFromSnapshotTest-278666822 None] Deleting offline snapshot 7cc6434c-dffb-45d7-8c7f-07f3102bea57 of volume e02d4e74-e545-4e8c-8112-4873b93e7a87 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:45:59 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:59 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-7686f1b0-2e53-44b6-a12c-a6f27266ac07 tempest-CreateVolumesFromSnapshotTest-278666822 None] snapshot_file for this snap is: volume-e02d4e74-e545-4e8c-8112-4873b93e7a87.7cc6434c-dffb-45d7-8c7f-07f3102bea57 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-4bf826a0-0481-4632-a46b-b4ed2bd8de8c tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892.ed2d652c-4411-4d62-b779-375b09360ef0" returned: 0 in 0.286s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e2d12538-5c95-4cc1-b710-a6b3bd54ca62 tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.298s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-e2d12538-5c95-4cc1-b710-a6b3bd54ca62 tempest-CreateVolumesFromSnapshotTest-278666822 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:45:59 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-e2d12538-5c95-4cc1-b710-a6b3bd54ca62 tempest-CreateVolumesFromSnapshotTest-278666822 None] Deleted volume successfully. Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3662ff-345b-45ee-b3ad-964381c6cacf]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7686f1b0-2e53-44b6-a12c-a6f27266ac07 tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87.7cc6434c-dffb-45d7-8c7f-07f3102bea57 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4bf826a0-0481-4632-a46b-b4ed2bd8de8c tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-ed2d652c-4411-4d62-b779-375b09360ef0" released by "_delete_snapshot" :: held 1.767s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e2d12538-5c95-4cc1-b710-a6b3bd54ca62 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "cinder-5ae97964-918e-4ba8-a46c-48e4b5e457bd-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4bf826a0-0481-4632-a46b-b4ed2bd8de8c tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-ad01bc10-fe33-44e0-86e8-3cce0aede892" released by "delete_snapshot" :: held 1.789s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-4bf826a0-0481-4632-a46b-b4ed2bd8de8c tempest-ProjectMemberTests-1154001707 None] Created reservations ['89ddb154-3731-45d9-bfb3-bf8b7a6e4c32', 'f73519b7-9060-4d54-ba7f-e8c47c931b5b', '807e2ef5-02d3-4c41-97e2-6a661a0ab9fa', 'bcf4eea0-d31c-4057-9080-f5e23c4fcddc'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:45:59 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87.7cc6434c-dffb-45d7-8c7f-07f3102bea57 Nov 02 12:45:59 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:45:59 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-4bf826a0-0481-4632-a46b-b4ed2bd8de8c tempest-ProjectMemberTests-1154001707 None] Delete snapshot completed successfully. Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-4bf826a0-0481-4632-a46b-b4ed2bd8de8c tempest-ProjectMemberTests-1154001707 None] Lock "cinder-ed2d652c-4411-4d62-b779-375b09360ef0-delete_snapshot" released by "delete_snapshot" :: held 1.937s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-abee6120-a74b-4143-ac6f-f248013b8e43 tempest-ProjectReaderTests-153927055 None] Acquiring lock "cinder-8bb02f4e-b4b7-4bfd-b054-b58d4d08b26e-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-abee6120-a74b-4143-ac6f-f248013b8e43 tempest-ProjectReaderTests-153927055 None] Lock "cinder-8bb02f4e-b4b7-4bfd-b054-b58d4d08b26e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-abee6120-a74b-4143-ac6f-f248013b8e43 tempest-ProjectReaderTests-153927055 None] Acquiring lock "cinder-quobyte-667bf6ed-afa9-4a86-9d51-86079de1e4a3" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-abee6120-a74b-4143-ac6f-f248013b8e43 tempest-ProjectReaderTests-153927055 None] Lock "cinder-quobyte-667bf6ed-afa9-4a86-9d51-86079de1e4a3" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-abee6120-a74b-4143-ac6f-f248013b8e43 tempest-ProjectReaderTests-153927055 None] Acquiring lock "cinder-quobyte-8bb02f4e-b4b7-4bfd-b054-b58d4d08b26e" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-abee6120-a74b-4143-ac6f-f248013b8e43 tempest-ProjectReaderTests-153927055 None] Lock "cinder-quobyte-8bb02f4e-b4b7-4bfd-b054-b58d4d08b26e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-abee6120-a74b-4143-ac6f-f248013b8e43 tempest-ProjectReaderTests-153927055 None] Deleting offline snapshot 8bb02f4e-b4b7-4bfd-b054-b58d4d08b26e of volume 667bf6ed-afa9-4a86-9d51-86079de1e4a3 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-abee6120-a74b-4143-ac6f-f248013b8e43 tempest-ProjectReaderTests-153927055 None] snapshot_file for this snap is: volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3.8bb02f4e-b4b7-4bfd-b054-b58d4d08b26e {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c5311f-d079-4999-a45f-6714bb9360a3]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-abee6120-a74b-4143-ac6f-f248013b8e43 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3.8bb02f4e-b4b7-4bfd-b054-b58d4d08b26e {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:45:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9f24379e-bc29-4d7a-9049-e3d57782c877 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-ad01bc10-fe33-44e0-86e8-3cce0aede892-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:00 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9f24379e-bc29-4d7a-9049-e3d57782c877 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-ad01bc10-fe33-44e0-86e8-3cce0aede892-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:00 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:00 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3.8bb02f4e-b4b7-4bfd-b054-b58d4d08b26e Nov 02 12:46:00 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9f24379e-bc29-4d7a-9049-e3d57782c877 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-quobyte-ad01bc10-fe33-44e0-86e8-3cce0aede892" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:00 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7686f1b0-2e53-44b6-a12c-a6f27266ac07 tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87.7cc6434c-dffb-45d7-8c7f-07f3102bea57" returned: 0 in 0.446s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:00 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-7686f1b0-2e53-44b6-a12c-a6f27266ac07 tempest-CreateVolumesFromSnapshotTest-278666822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e02d4e74-e545-4e8c-8112-4873b93e7a87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:46:00 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9f24379e-bc29-4d7a-9049-e3d57782c877 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-ad01bc10-fe33-44e0-86e8-3cce0aede892" acquired by "delete_volume" :: waited 0.033s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:00 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0e6d9d-aae9-44ca-bcb5-768d7e0193ff]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7686f1b0-2e53-44b6-a12c-a6f27266ac07 tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:00 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e63dbaa-613d-44c6-b7b7-de301962f848]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9f24379e-bc29-4d7a-9049-e3d57782c877 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:00 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87 Nov 02 12:46:00 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:00 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892 Nov 02 12:46:00 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:00 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-abee6120-a74b-4143-ac6f-f248013b8e43 tempest-ProjectReaderTests-153927055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3.8bb02f4e-b4b7-4bfd-b054-b58d4d08b26e" returned: 0 in 0.425s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:00 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-abee6120-a74b-4143-ac6f-f248013b8e43 tempest-ProjectReaderTests-153927055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:46:00 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ddbb88-edda-4331-8c79-75cc1ed51b67]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-abee6120-a74b-4143-ac6f-f248013b8e43 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:00 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3 Nov 02 12:46:00 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:00 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9f24379e-bc29-4d7a-9049-e3d57782c877 tempest-ProjectMemberTests-1154001707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892" returned: 0 in 0.381s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9f24379e-bc29-4d7a-9049-e3d57782c877 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:00 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7686f1b0-2e53-44b6-a12c-a6f27266ac07 tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87" returned: 0 in 0.430s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:00 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892 Nov 02 12:46:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7686f1b0-2e53-44b6-a12c-a6f27266ac07 tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87.7cc6434c-dffb-45d7-8c7f-07f3102bea57 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:00 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:00 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87.7cc6434c-dffb-45d7-8c7f-07f3102bea57 Nov 02 12:46:00 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:00 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-abee6120-a74b-4143-ac6f-f248013b8e43 tempest-ProjectReaderTests-153927055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3" returned: 0 in 0.377s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-abee6120-a74b-4143-ac6f-f248013b8e43 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3.8bb02f4e-b4b7-4bfd-b054-b58d4d08b26e {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:00 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3.8bb02f4e-b4b7-4bfd-b054-b58d4d08b26e Nov 02 12:46:00 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:00 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9f24379e-bc29-4d7a-9049-e3d57782c877 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-ad01bc10-fe33-44e0-86e8-3cce0aede892" returned: 0 in 0.298s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:00 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9f24379e-bc29-4d7a-9049-e3d57782c877 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-ad01bc10-fe33-44e0-86e8-3cce0aede892" released by "delete_volume" :: held 0.743s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:00 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-9f24379e-bc29-4d7a-9049-e3d57782c877 tempest-ProjectMemberTests-1154001707 None] Created reservations ['ccb938fa-3371-44ee-84c9-411a46a64988', '614c652e-ca96-4287-bd8e-7626eb61b21e', 'fad86997-5d84-45f4-b60e-dd10e9271f2e', 'ee4c1b27-5689-423a-a714-7cb3105035a5'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:00 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7686f1b0-2e53-44b6-a12c-a6f27266ac07 tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87.7cc6434c-dffb-45d7-8c7f-07f3102bea57" returned: 0 in 0.362s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7686f1b0-2e53-44b6-a12c-a6f27266ac07 tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87.7cc6434c-dffb-45d7-8c7f-07f3102bea57 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:00 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87.7cc6434c-dffb-45d7-8c7f-07f3102bea57 Nov 02 12:46:00 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-9f24379e-bc29-4d7a-9049-e3d57782c877 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-9f24379e-bc29-4d7a-9049-e3d57782c877 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:00 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-9f24379e-bc29-4d7a-9049-e3d57782c877 tempest-ProjectMemberTests-1154001707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:00 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-9f24379e-bc29-4d7a-9049-e3d57782c877 tempest-ProjectMemberTests-1154001707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-9f24379e-bc29-4d7a-9049-e3d57782c877 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9f24379e-bc29-4d7a-9049-e3d57782c877 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:01 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:46:01 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:01 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-abee6120-a74b-4143-ac6f-f248013b8e43 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3.8bb02f4e-b4b7-4bfd-b054-b58d4d08b26e" returned: 0 in 0.408s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-abee6120-a74b-4143-ac6f-f248013b8e43 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3.8bb02f4e-b4b7-4bfd-b054-b58d4d08b26e {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:01 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3.8bb02f4e-b4b7-4bfd-b054-b58d4d08b26e Nov 02 12:46:01 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:01 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7686f1b0-2e53-44b6-a12c-a6f27266ac07 tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87.7cc6434c-dffb-45d7-8c7f-07f3102bea57" returned: 0 in 0.303s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:01 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7686f1b0-2e53-44b6-a12c-a6f27266ac07 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "cinder-quobyte-7cc6434c-dffb-45d7-8c7f-07f3102bea57" released by "_delete_snapshot" :: held 1.703s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9f24379e-bc29-4d7a-9049-e3d57782c877 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.280s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-9f24379e-bc29-4d7a-9049-e3d57782c877 tempest-ProjectMemberTests-1154001707 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:46:01 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-9f24379e-bc29-4d7a-9049-e3d57782c877 tempest-ProjectMemberTests-1154001707 None] Deleted volume successfully. Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7686f1b0-2e53-44b6-a12c-a6f27266ac07 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "cinder-quobyte-e02d4e74-e545-4e8c-8112-4873b93e7a87" released by "delete_snapshot" :: held 1.739s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9f24379e-bc29-4d7a-9049-e3d57782c877 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-ad01bc10-fe33-44e0-86e8-3cce0aede892-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-7686f1b0-2e53-44b6-a12c-a6f27266ac07 tempest-CreateVolumesFromSnapshotTest-278666822 None] Created reservations ['a99b01a9-1827-44d1-aeb4-8bb731f0951f', '28f9003a-4e7f-4c86-b65e-698ea242ba75', '69b054af-763f-4ff5-b7ab-656c73140ac5', 'ef8dd254-bb47-4819-b745-4a19466216ed'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:01 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:01 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-7686f1b0-2e53-44b6-a12c-a6f27266ac07 tempest-CreateVolumesFromSnapshotTest-278666822 None] Delete snapshot completed successfully. Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-abee6120-a74b-4143-ac6f-f248013b8e43 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3.8bb02f4e-b4b7-4bfd-b054-b58d4d08b26e" returned: 0 in 0.319s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7686f1b0-2e53-44b6-a12c-a6f27266ac07 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "cinder-7cc6434c-dffb-45d7-8c7f-07f3102bea57-delete_snapshot" released by "delete_snapshot" :: held 1.994s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-abee6120-a74b-4143-ac6f-f248013b8e43 tempest-ProjectReaderTests-153927055 None] Lock "cinder-quobyte-8bb02f4e-b4b7-4bfd-b054-b58d4d08b26e" released by "_delete_snapshot" :: held 1.658s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-abee6120-a74b-4143-ac6f-f248013b8e43 tempest-ProjectReaderTests-153927055 None] Lock "cinder-quobyte-667bf6ed-afa9-4a86-9d51-86079de1e4a3" released by "delete_snapshot" :: held 1.683s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-abee6120-a74b-4143-ac6f-f248013b8e43 tempest-ProjectReaderTests-153927055 None] Created reservations ['dba13e1d-a575-4764-ba0a-afd4655a88c5', 'bff52b1e-16ff-402e-ac64-3510bc2af334', '04a35ad4-41b9-4f5f-9ab3-81f9f8af0dee', '2d7accf5-e55a-4d7b-ae0c-6275c6643ba9'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ff18504-8902-48b3-b100-9a9d24dc32e2 tempest-ProjectMemberTests-1154001707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-9ff18504-8902-48b3-b100-9a9d24dc32e2 tempest-ProjectMemberTests-1154001707 None] Flow 'volume_create_manager' (8667dd46-5605-410b-8f3d-ab8c1ae68a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-9ff18504-8902-48b3-b100-9a9d24dc32e2 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef678fc6-7cd7-429a-bc8a-d269c6e1786d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:01 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-abee6120-a74b-4143-ac6f-f248013b8e43 tempest-ProjectReaderTests-153927055 None] Delete snapshot completed successfully. Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-15f4a24f-d52d-465b-8ffc-82f8f32ecd94 tempest-CreateVolumesFromSnapshotTest-278666822 None] Acquiring lock "cinder-e02d4e74-e545-4e8c-8112-4873b93e7a87-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-9ff18504-8902-48b3-b100-9a9d24dc32e2 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef678fc6-7cd7-429a-bc8a-d269c6e1786d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1638578479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f1bb1ec-e870-4639-a56a-97371038d100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60099afac3fc4cb3b2313235ee5a57b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:02Z,use_quota=True,user_id='466fcf287769488eaa04f91080ae1f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-9ff18504-8902-48b3-b100-9a9d24dc32e2 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65dc8727-2e9a-4fd8-8f47-39fac014f507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-9ff18504-8902-48b3-b100-9a9d24dc32e2 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65dc8727-2e9a-4fd8-8f47-39fac014f507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-9ff18504-8902-48b3-b100-9a9d24dc32e2 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (332b9dea-0907-4955-9347-b4d5cb9736bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-9ff18504-8902-48b3-b100-9a9d24dc32e2 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (332b9dea-0907-4955-9347-b4d5cb9736bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f1bb1ec-e870-4639-a56a-97371038d100', 'volume_name': 'volume-4f1bb1ec-e870-4639-a56a-97371038d100', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-9ff18504-8902-48b3-b100-9a9d24dc32e2 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a422c0db-5ea5-4b2f-87e4-d805f3871c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-9ff18504-8902-48b3-b100-9a9d24dc32e2 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a422c0db-5ea5-4b2f-87e4-d805f3871c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-9ff18504-8902-48b3-b100-9a9d24dc32e2 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3389ef4-97b6-4378-a5da-41b32f450c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:01 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-9ff18504-8902-48b3-b100-9a9d24dc32e2 tempest-ProjectMemberTests-1154001707 None] Volume 4f1bb1ec-e870-4639-a56a-97371038d100: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f1bb1ec-e870-4639-a56a-97371038d100', 'volume_size': 1} Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-9ff18504-8902-48b3-b100-9a9d24dc32e2 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-9ff18504-8902-48b3-b100-9a9d24dc32e2 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-9ff18504-8902-48b3-b100-9a9d24dc32e2 tempest-ProjectMemberTests-1154001707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1638578479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f1bb1ec-e870-4639-a56a-97371038d100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60099afac3fc4cb3b2313235ee5a57b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:02Z,use_quota=True,user_id='466fcf287769488eaa04f91080ae1f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-9ff18504-8902-48b3-b100-9a9d24dc32e2 tempest-ProjectMemberTests-1154001707 None] Creating volume 4f1bb1ec-e870-4639-a56a-97371038d100 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-9ff18504-8902-48b3-b100-9a9d24dc32e2 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-9ff18504-8902-48b3-b100-9a9d24dc32e2 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-9ff18504-8902-48b3-b100-9a9d24dc32e2 tempest-ProjectMemberTests-1154001707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-9ff18504-8902-48b3-b100-9a9d24dc32e2 tempest-ProjectMemberTests-1154001707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-9ff18504-8902-48b3-b100-9a9d24dc32e2 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-9ff18504-8902-48b3-b100-9a9d24dc32e2 tempest-ProjectMemberTests-1154001707 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:46:01 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-9ff18504-8902-48b3-b100-9a9d24dc32e2 tempest-ProjectMemberTests-1154001707 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9ff18504-8902-48b3-b100-9a9d24dc32e2 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-abee6120-a74b-4143-ac6f-f248013b8e43 tempest-ProjectReaderTests-153927055 None] Lock "cinder-8bb02f4e-b4b7-4bfd-b054-b58d4d08b26e-delete_snapshot" released by "delete_snapshot" :: held 1.979s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:01 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100 1073741824 Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-15f4a24f-d52d-465b-8ffc-82f8f32ecd94 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "cinder-e02d4e74-e545-4e8c-8112-4873b93e7a87-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:01 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-15f4a24f-d52d-465b-8ffc-82f8f32ecd94 tempest-CreateVolumesFromSnapshotTest-278666822 None] Acquiring lock "cinder-quobyte-e02d4e74-e545-4e8c-8112-4873b93e7a87" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-15f4a24f-d52d-465b-8ffc-82f8f32ecd94 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "cinder-quobyte-e02d4e74-e545-4e8c-8112-4873b93e7a87" acquired by "delete_volume" :: waited 0.015s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[1689941a-6e00-4650-a65c-444a7ea9d16a]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-15f4a24f-d52d-465b-8ffc-82f8f32ecd94 tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:02 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-89ae4d31-df24-4bf1-b35d-4c3a8d3ede67 tempest-ProjectReaderTests-153927055 None] Acquiring lock "cinder-667bf6ed-afa9-4a86-9d51-86079de1e4a3-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:02 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-89ae4d31-df24-4bf1-b35d-4c3a8d3ede67 tempest-ProjectReaderTests-153927055 None] Lock "cinder-667bf6ed-afa9-4a86-9d51-86079de1e4a3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:02 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87 Nov 02 12:46:02 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:02 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-89ae4d31-df24-4bf1-b35d-4c3a8d3ede67 tempest-ProjectReaderTests-153927055 None] Acquiring lock "cinder-quobyte-667bf6ed-afa9-4a86-9d51-86079de1e4a3" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:02 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-89ae4d31-df24-4bf1-b35d-4c3a8d3ede67 tempest-ProjectReaderTests-153927055 None] Lock "cinder-quobyte-667bf6ed-afa9-4a86-9d51-86079de1e4a3" acquired by "delete_volume" :: waited 0.032s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:02 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[00def944-3af1-421c-93b9-2c5efff81459]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-89ae4d31-df24-4bf1-b35d-4c3a8d3ede67 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:02 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9ff18504-8902-48b3-b100-9a9d24dc32e2 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100 1073741824" returned: 0 in 0.498s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:02 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3 Nov 02 12:46:02 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9ff18504-8902-48b3-b100-9a9d24dc32e2 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:02 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100 Nov 02 12:46:02 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:02 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-15f4a24f-d52d-465b-8ffc-82f8f32ecd94 tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87" returned: 0 in 0.466s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-15f4a24f-d52d-465b-8ffc-82f8f32ecd94 tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:02 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87 Nov 02 12:46:02 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:02 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-89ae4d31-df24-4bf1-b35d-4c3a8d3ede67 tempest-ProjectReaderTests-153927055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3" returned: 0 in 0.427s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-89ae4d31-df24-4bf1-b35d-4c3a8d3ede67 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:02 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3 Nov 02 12:46:02 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:02 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9ff18504-8902-48b3-b100-9a9d24dc32e2 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100" returned: 0 in 0.319s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-9ff18504-8902-48b3-b100-9a9d24dc32e2 tempest-ProjectMemberTests-1154001707 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:46:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-9ff18504-8902-48b3-b100-9a9d24dc32e2 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:02 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-15f4a24f-d52d-465b-8ffc-82f8f32ecd94 tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e02d4e74-e545-4e8c-8112-4873b93e7a87" returned: 0 in 0.278s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-9ff18504-8902-48b3-b100-9a9d24dc32e2 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3389ef4-97b6-4378-a5da-41b32f450c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f1bb1ec-e870-4639-a56a-97371038d100', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-9ff18504-8902-48b3-b100-9a9d24dc32e2 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3de00fd-c1d4-4c17-b78c-773178474ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:02 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-15f4a24f-d52d-465b-8ffc-82f8f32ecd94 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "cinder-quobyte-e02d4e74-e545-4e8c-8112-4873b93e7a87" released by "delete_volume" :: held 0.820s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:02 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-9ff18504-8902-48b3-b100-9a9d24dc32e2 tempest-ProjectMemberTests-1154001707 None] Volume volume-4f1bb1ec-e870-4639-a56a-97371038d100 (4f1bb1ec-e870-4639-a56a-97371038d100): created successfully Nov 02 12:46:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-9ff18504-8902-48b3-b100-9a9d24dc32e2 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3de00fd-c1d4-4c17-b78c-773178474ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:02 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-9ff18504-8902-48b3-b100-9a9d24dc32e2 tempest-ProjectMemberTests-1154001707 None] Flow 'volume_create_manager' (8667dd46-5605-410b-8f3d-ab8c1ae68a3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:02 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-9ff18504-8902-48b3-b100-9a9d24dc32e2 tempest-ProjectMemberTests-1154001707 None] Created volume successfully. Nov 02 12:46:02 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-15f4a24f-d52d-465b-8ffc-82f8f32ecd94 tempest-CreateVolumesFromSnapshotTest-278666822 None] Created reservations ['104b6fbc-fbcb-4f4d-a565-27f93d8330dc', '6c737111-297e-4606-be82-0a41235e22d4', '7c8f5b73-3701-4df5-92ce-50653f8bd03b', 'f70dd9f2-d964-4ed9-b4d4-3807d9d913f1'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-15f4a24f-d52d-465b-8ffc-82f8f32ecd94 tempest-CreateVolumesFromSnapshotTest-278666822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-15f4a24f-d52d-465b-8ffc-82f8f32ecd94 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-15f4a24f-d52d-465b-8ffc-82f8f32ecd94 tempest-CreateVolumesFromSnapshotTest-278666822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:02 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-15f4a24f-d52d-465b-8ffc-82f8f32ecd94 tempest-CreateVolumesFromSnapshotTest-278666822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-15f4a24f-d52d-465b-8ffc-82f8f32ecd94 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-15f4a24f-d52d-465b-8ffc-82f8f32ecd94 tempest-CreateVolumesFromSnapshotTest-278666822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:02 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:46:02 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:02 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-89ae4d31-df24-4bf1-b35d-4c3a8d3ede67 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-667bf6ed-afa9-4a86-9d51-86079de1e4a3" returned: 0 in 0.289s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:02 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-89ae4d31-df24-4bf1-b35d-4c3a8d3ede67 tempest-ProjectReaderTests-153927055 None] Lock "cinder-quobyte-667bf6ed-afa9-4a86-9d51-86079de1e4a3" released by "delete_volume" :: held 0.784s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:02 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-89ae4d31-df24-4bf1-b35d-4c3a8d3ede67 tempest-ProjectReaderTests-153927055 None] Created reservations ['05cff378-d9e3-47a9-9b83-654078cd3d3e', 'a8ff2411-2d6f-48d3-a02f-7eb0c0ec4856', '0eea354f-7d0b-47d2-bb55-c1fa12d4d15c', '860b97e7-44d3-445c-a968-bb6d6964ad44'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-89ae4d31-df24-4bf1-b35d-4c3a8d3ede67 tempest-ProjectReaderTests-153927055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-89ae4d31-df24-4bf1-b35d-4c3a8d3ede67 tempest-ProjectReaderTests-153927055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:03 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-89ae4d31-df24-4bf1-b35d-4c3a8d3ede67 tempest-ProjectReaderTests-153927055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:03 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-89ae4d31-df24-4bf1-b35d-4c3a8d3ede67 tempest-ProjectReaderTests-153927055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-89ae4d31-df24-4bf1-b35d-4c3a8d3ede67 tempest-ProjectReaderTests-153927055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-89ae4d31-df24-4bf1-b35d-4c3a8d3ede67 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:03 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:46:03 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:03 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-15f4a24f-d52d-465b-8ffc-82f8f32ecd94 tempest-CreateVolumesFromSnapshotTest-278666822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.286s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:03 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-15f4a24f-d52d-465b-8ffc-82f8f32ecd94 tempest-CreateVolumesFromSnapshotTest-278666822 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:46:03 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-15f4a24f-d52d-465b-8ffc-82f8f32ecd94 tempest-CreateVolumesFromSnapshotTest-278666822 None] Deleted volume successfully. Nov 02 12:46:03 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-15f4a24f-d52d-465b-8ffc-82f8f32ecd94 tempest-CreateVolumesFromSnapshotTest-278666822 None] Lock "cinder-e02d4e74-e545-4e8c-8112-4873b93e7a87-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:03 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-89ae4d31-df24-4bf1-b35d-4c3a8d3ede67 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.301s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:03 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-89ae4d31-df24-4bf1-b35d-4c3a8d3ede67 tempest-ProjectReaderTests-153927055 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:46:03 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-89ae4d31-df24-4bf1-b35d-4c3a8d3ede67 tempest-ProjectReaderTests-153927055 None] Deleted volume successfully. Nov 02 12:46:03 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-89ae4d31-df24-4bf1-b35d-4c3a8d3ede67 tempest-ProjectReaderTests-153927055 None] Lock "cinder-667bf6ed-afa9-4a86-9d51-86079de1e4a3-delete_volume" released by "delete_volume" :: held 1.334s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:03 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-3181e7f9-b69b-4cd3-818a-ea844ab85fa0 tempest-ProjectReaderTests-153927055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:46:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3181e7f9-b69b-4cd3-818a-ea844ab85fa0 tempest-ProjectReaderTests-153927055 None] Flow 'volume_create_manager' (65437e2d-6aac-4c37-90a3-68601ec451d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3181e7f9-b69b-4cd3-818a-ea844ab85fa0 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1600805-fed8-4a7c-b853-eca5b734fcb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3181e7f9-b69b-4cd3-818a-ea844ab85fa0 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1600805-fed8-4a7c-b853-eca5b734fcb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1997315616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31dc18e1-0d61-42e6-90e7-c7c15ef9337b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='371854aebb9b4c37b51206a234c0f7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:04Z,use_quota=True,user_id='2859c42cc4c64316a323f9dd6c533e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3181e7f9-b69b-4cd3-818a-ea844ab85fa0 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a93212d-f7be-45d4-b461-794e00daa49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3181e7f9-b69b-4cd3-818a-ea844ab85fa0 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a93212d-f7be-45d4-b461-794e00daa49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3181e7f9-b69b-4cd3-818a-ea844ab85fa0 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a1d7f1-6230-49d9-804f-d9cefd24b7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3181e7f9-b69b-4cd3-818a-ea844ab85fa0 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a1d7f1-6230-49d9-804f-d9cefd24b7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31dc18e1-0d61-42e6-90e7-c7c15ef9337b', 'volume_name': 'volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3181e7f9-b69b-4cd3-818a-ea844ab85fa0 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e3c5156-a829-441d-8225-9ad1f6acf5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3181e7f9-b69b-4cd3-818a-ea844ab85fa0 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e3c5156-a829-441d-8225-9ad1f6acf5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:03 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3181e7f9-b69b-4cd3-818a-ea844ab85fa0 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a3d0dbd-d58d-4218-8d8a-af3d6e948fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:03 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-3181e7f9-b69b-4cd3-818a-ea844ab85fa0 tempest-ProjectReaderTests-153927055 None] Volume 31dc18e1-0d61-42e6-90e7-c7c15ef9337b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b', 'volume_size': 1} Nov 02 12:46:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3181e7f9-b69b-4cd3-818a-ea844ab85fa0 tempest-ProjectReaderTests-153927055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3181e7f9-b69b-4cd3-818a-ea844ab85fa0 tempest-ProjectReaderTests-153927055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:03 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3181e7f9-b69b-4cd3-818a-ea844ab85fa0 tempest-ProjectReaderTests-153927055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1997315616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31dc18e1-0d61-42e6-90e7-c7c15ef9337b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='371854aebb9b4c37b51206a234c0f7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:04Z,use_quota=True,user_id='2859c42cc4c64316a323f9dd6c533e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:46:03 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-3181e7f9-b69b-4cd3-818a-ea844ab85fa0 tempest-ProjectReaderTests-153927055 None] Creating volume 31dc18e1-0d61-42e6-90e7-c7c15ef9337b {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:46:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3181e7f9-b69b-4cd3-818a-ea844ab85fa0 tempest-ProjectReaderTests-153927055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3181e7f9-b69b-4cd3-818a-ea844ab85fa0 tempest-ProjectReaderTests-153927055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:03 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3181e7f9-b69b-4cd3-818a-ea844ab85fa0 tempest-ProjectReaderTests-153927055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:03 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3181e7f9-b69b-4cd3-818a-ea844ab85fa0 tempest-ProjectReaderTests-153927055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3181e7f9-b69b-4cd3-818a-ea844ab85fa0 tempest-ProjectReaderTests-153927055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:03 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3181e7f9-b69b-4cd3-818a-ea844ab85fa0 tempest-ProjectReaderTests-153927055 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:46:03 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-3181e7f9-b69b-4cd3-818a-ea844ab85fa0 tempest-ProjectReaderTests-153927055 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:46:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3181e7f9-b69b-4cd3-818a-ea844ab85fa0 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:03 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b 1073741824 Nov 02 12:46:03 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f864266b-ad92-4ccc-ab44-181a0d768444 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:04 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3181e7f9-b69b-4cd3-818a-ea844ab85fa0 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b 1073741824" returned: 0 in 0.581s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3181e7f9-b69b-4cd3-818a-ea844ab85fa0 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:04 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b Nov 02 12:46:04 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:04 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3181e7f9-b69b-4cd3-818a-ea844ab85fa0 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b" returned: 0 in 0.337s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:04 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3181e7f9-b69b-4cd3-818a-ea844ab85fa0 tempest-ProjectReaderTests-153927055 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:46:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3181e7f9-b69b-4cd3-818a-ea844ab85fa0 tempest-ProjectReaderTests-153927055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f864266b-ad92-4ccc-ab44-181a0d768444 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.806s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:04 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-f864266b-ad92-4ccc-ab44-181a0d768444 tempest-ProjectMemberTests-1154001707 None] Creating offline snapshot 8c800ad5-01c9-4bfc-8dcf-deebc4caa848 of volume 4f1bb1ec-e870-4639-a56a-97371038d100 {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:46:04 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3181e7f9-b69b-4cd3-818a-ea844ab85fa0 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a3d0dbd-d58d-4218-8d8a-af3d6e948fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:04 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3181e7f9-b69b-4cd3-818a-ea844ab85fa0 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aefdd08e-3f09-4c69-94fe-b086bb6f9d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:04 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[35428d30-6180-4066-b435-7afc2821dc70]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f864266b-ad92-4ccc-ab44-181a0d768444 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:04 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-3181e7f9-b69b-4cd3-818a-ea844ab85fa0 tempest-ProjectReaderTests-153927055 None] Volume volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b (31dc18e1-0d61-42e6-90e7-c7c15ef9337b): created successfully Nov 02 12:46:04 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3181e7f9-b69b-4cd3-818a-ea844ab85fa0 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aefdd08e-3f09-4c69-94fe-b086bb6f9d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:04 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3181e7f9-b69b-4cd3-818a-ea844ab85fa0 tempest-ProjectReaderTests-153927055 None] Flow 'volume_create_manager' (65437e2d-6aac-4c37-90a3-68601ec451d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:04 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-3181e7f9-b69b-4cd3-818a-ea844ab85fa0 tempest-ProjectReaderTests-153927055 None] Created volume successfully. Nov 02 12:46:05 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100 Nov 02 12:46:05 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:05 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f864266b-ad92-4ccc-ab44-181a0d768444 tempest-ProjectMemberTests-1154001707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100" returned: 0 in 0.441s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f864266b-ad92-4ccc-ab44-181a0d768444 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100.8c800ad5-01c9-4bfc-8dcf-deebc4caa848 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:05 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100.8c800ad5-01c9-4bfc-8dcf-deebc4caa848 1G Nov 02 12:46:05 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:05 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f864266b-ad92-4ccc-ab44-181a0d768444 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100.8c800ad5-01c9-4bfc-8dcf-deebc4caa848 1G" returned: 0 in 0.416s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f864266b-ad92-4ccc-ab44-181a0d768444 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f1bb1ec-e870-4639-a56a-97371038d100 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100.8c800ad5-01c9-4bfc-8dcf-deebc4caa848 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:05 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f1bb1ec-e870-4639-a56a-97371038d100 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100.8c800ad5-01c9-4bfc-8dcf-deebc4caa848 Nov 02 12:46:05 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-10a9cc7e-0678-4f78-ac0b-111cf44a3dbd tempest-ProjectReaderTests-153927055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:06 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f864266b-ad92-4ccc-ab44-181a0d768444 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f1bb1ec-e870-4639-a56a-97371038d100 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100.8c800ad5-01c9-4bfc-8dcf-deebc4caa848" returned: 0 in 0.353s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:06 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-f864266b-ad92-4ccc-ab44-181a0d768444 tempest-ProjectMemberTests-1154001707 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100.8c800ad5-01c9-4bfc-8dcf-deebc4caa848 is being set with open permissions: ugo+rw Nov 02 12:46:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f864266b-ad92-4ccc-ab44-181a0d768444 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100.8c800ad5-01c9-4bfc-8dcf-deebc4caa848 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:06 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100.8c800ad5-01c9-4bfc-8dcf-deebc4caa848 Nov 02 12:46:06 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:06 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f864266b-ad92-4ccc-ab44-181a0d768444 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100.8c800ad5-01c9-4bfc-8dcf-deebc4caa848" returned: 0 in 0.244s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f864266b-ad92-4ccc-ab44-181a0d768444 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:06 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100.info Nov 02 12:46:06 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:06 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f864266b-ad92-4ccc-ab44-181a0d768444 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100.info" returned: 0 in 0.246s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:06 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-f864266b-ad92-4ccc-ab44-181a0d768444 tempest-ProjectMemberTests-1154001707 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100.info is being set with open permissions: ugo+rw Nov 02 12:46:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f864266b-ad92-4ccc-ab44-181a0d768444 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:06 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100.info Nov 02 12:46:06 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:06 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f864266b-ad92-4ccc-ab44-181a0d768444 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100.info" returned: 0 in 0.252s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f864266b-ad92-4ccc-ab44-181a0d768444 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.045s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-10a9cc7e-0678-4f78-ac0b-111cf44a3dbd tempest-ProjectReaderTests-153927055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.834s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:06 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-10a9cc7e-0678-4f78-ac0b-111cf44a3dbd tempest-ProjectReaderTests-153927055 None] Creating offline snapshot 0f48747f-fc06-4e3a-b5ce-557efaa0407a of volume 31dc18e1-0d61-42e6-90e7-c7c15ef9337b {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:46:06 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-f864266b-ad92-4ccc-ab44-181a0d768444 tempest-ProjectMemberTests-1154001707 None] Create snapshot completed successfully Nov 02 12:46:06 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a1b55c-2971-417a-8571-af98eef884a6]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-10a9cc7e-0678-4f78-ac0b-111cf44a3dbd tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:07 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b Nov 02 12:46:07 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:07 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-aa90eec8-c8b6-4d4a-b588-7e1937660c04 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-8c800ad5-01c9-4bfc-8dcf-deebc4caa848-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:07 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-aa90eec8-c8b6-4d4a-b588-7e1937660c04 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-8c800ad5-01c9-4bfc-8dcf-deebc4caa848-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:07 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-aa90eec8-c8b6-4d4a-b588-7e1937660c04 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-quobyte-4f1bb1ec-e870-4639-a56a-97371038d100" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:07 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-aa90eec8-c8b6-4d4a-b588-7e1937660c04 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-4f1bb1ec-e870-4639-a56a-97371038d100" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:07 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-aa90eec8-c8b6-4d4a-b588-7e1937660c04 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-quobyte-8c800ad5-01c9-4bfc-8dcf-deebc4caa848" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:07 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-aa90eec8-c8b6-4d4a-b588-7e1937660c04 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-8c800ad5-01c9-4bfc-8dcf-deebc4caa848" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:07 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-aa90eec8-c8b6-4d4a-b588-7e1937660c04 tempest-ProjectMemberTests-1154001707 None] Deleting offline snapshot 8c800ad5-01c9-4bfc-8dcf-deebc4caa848 of volume 4f1bb1ec-e870-4639-a56a-97371038d100 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:46:07 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-aa90eec8-c8b6-4d4a-b588-7e1937660c04 tempest-ProjectMemberTests-1154001707 None] snapshot_file for this snap is: volume-4f1bb1ec-e870-4639-a56a-97371038d100.8c800ad5-01c9-4bfc-8dcf-deebc4caa848 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:46:07 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b6df13-7fca-425a-8fc4-05dbbaba2c77]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-aa90eec8-c8b6-4d4a-b588-7e1937660c04 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100.8c800ad5-01c9-4bfc-8dcf-deebc4caa848 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:07 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-10a9cc7e-0678-4f78-ac0b-111cf44a3dbd tempest-ProjectReaderTests-153927055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b" returned: 0 in 0.423s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-10a9cc7e-0678-4f78-ac0b-111cf44a3dbd tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b.0f48747f-fc06-4e3a-b5ce-557efaa0407a 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:07 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b.0f48747f-fc06-4e3a-b5ce-557efaa0407a 1G Nov 02 12:46:07 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:07 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100.8c800ad5-01c9-4bfc-8dcf-deebc4caa848 Nov 02 12:46:07 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:07 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-aa90eec8-c8b6-4d4a-b588-7e1937660c04 tempest-ProjectMemberTests-1154001707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100.8c800ad5-01c9-4bfc-8dcf-deebc4caa848" returned: 0 in 0.389s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:07 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-aa90eec8-c8b6-4d4a-b588-7e1937660c04 tempest-ProjectMemberTests-1154001707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f1bb1ec-e870-4639-a56a-97371038d100(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:46:07 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[0628be5f-556c-4c43-858a-c11cd2b1d413]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-aa90eec8-c8b6-4d4a-b588-7e1937660c04 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:07 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-10a9cc7e-0678-4f78-ac0b-111cf44a3dbd tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b.0f48747f-fc06-4e3a-b5ce-557efaa0407a 1G" returned: 0 in 0.466s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-10a9cc7e-0678-4f78-ac0b-111cf44a3dbd tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b.0f48747f-fc06-4e3a-b5ce-557efaa0407a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:07 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b.0f48747f-fc06-4e3a-b5ce-557efaa0407a Nov 02 12:46:07 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:07 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100 Nov 02 12:46:07 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:08 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-aa90eec8-c8b6-4d4a-b588-7e1937660c04 tempest-ProjectMemberTests-1154001707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100" returned: 0 in 0.397s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-aa90eec8-c8b6-4d4a-b588-7e1937660c04 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100.8c800ad5-01c9-4bfc-8dcf-deebc4caa848 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:08 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-10a9cc7e-0678-4f78-ac0b-111cf44a3dbd tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b.0f48747f-fc06-4e3a-b5ce-557efaa0407a" returned: 0 in 0.317s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:08 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-10a9cc7e-0678-4f78-ac0b-111cf44a3dbd tempest-ProjectReaderTests-153927055 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b.0f48747f-fc06-4e3a-b5ce-557efaa0407a is being set with open permissions: ugo+rw Nov 02 12:46:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-10a9cc7e-0678-4f78-ac0b-111cf44a3dbd tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b.0f48747f-fc06-4e3a-b5ce-557efaa0407a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:08 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100.8c800ad5-01c9-4bfc-8dcf-deebc4caa848 Nov 02 12:46:08 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:08 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b.0f48747f-fc06-4e3a-b5ce-557efaa0407a Nov 02 12:46:08 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:08 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-10a9cc7e-0678-4f78-ac0b-111cf44a3dbd tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b.0f48747f-fc06-4e3a-b5ce-557efaa0407a" returned: 0 in 0.255s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-10a9cc7e-0678-4f78-ac0b-111cf44a3dbd tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:08 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b.info Nov 02 12:46:08 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:08 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-aa90eec8-c8b6-4d4a-b588-7e1937660c04 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100.8c800ad5-01c9-4bfc-8dcf-deebc4caa848" returned: 0 in 0.397s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-aa90eec8-c8b6-4d4a-b588-7e1937660c04 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100.8c800ad5-01c9-4bfc-8dcf-deebc4caa848 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:08 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100.8c800ad5-01c9-4bfc-8dcf-deebc4caa848 Nov 02 12:46:08 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:08 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-10a9cc7e-0678-4f78-ac0b-111cf44a3dbd tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b.info" returned: 0 in 0.271s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:08 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-10a9cc7e-0678-4f78-ac0b-111cf44a3dbd tempest-ProjectReaderTests-153927055 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b.info is being set with open permissions: ugo+rw Nov 02 12:46:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-10a9cc7e-0678-4f78-ac0b-111cf44a3dbd tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:08 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b.info Nov 02 12:46:08 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:08 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-aa90eec8-c8b6-4d4a-b588-7e1937660c04 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100.8c800ad5-01c9-4bfc-8dcf-deebc4caa848" returned: 0 in 0.264s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:08 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-aa90eec8-c8b6-4d4a-b588-7e1937660c04 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-8c800ad5-01c9-4bfc-8dcf-deebc4caa848" released by "_delete_snapshot" :: held 1.578s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:08 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-aa90eec8-c8b6-4d4a-b588-7e1937660c04 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-4f1bb1ec-e870-4639-a56a-97371038d100" released by "delete_snapshot" :: held 1.606s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:08 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-aa90eec8-c8b6-4d4a-b588-7e1937660c04 tempest-ProjectMemberTests-1154001707 None] Created reservations ['f5e445e4-1f53-4b28-b3f7-a5ea2bbf57b6', '415d4b79-a3c2-4976-88b6-ef8d40fb1647', '08f569d5-681f-46cd-a4da-4f2bd783b158', 'c4ca6f7e-1a18-4a50-a928-fee1d6c9021a'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:08 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:08 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-10a9cc7e-0678-4f78-ac0b-111cf44a3dbd tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b.info" returned: 0 in 0.286s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-10a9cc7e-0678-4f78-ac0b-111cf44a3dbd tempest-ProjectReaderTests-153927055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.131s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:09 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-aa90eec8-c8b6-4d4a-b588-7e1937660c04 tempest-ProjectMemberTests-1154001707 None] Delete snapshot completed successfully. Nov 02 12:46:09 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-aa90eec8-c8b6-4d4a-b588-7e1937660c04 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-8c800ad5-01c9-4bfc-8dcf-deebc4caa848-delete_snapshot" released by "delete_snapshot" :: held 1.817s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:09 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-10a9cc7e-0678-4f78-ac0b-111cf44a3dbd tempest-ProjectReaderTests-153927055 None] Create snapshot completed successfully Nov 02 12:46:09 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ed4ecf12-662c-4794-9b7b-a795ec059060 tempest-ProjectReaderTests-153927055 None] Acquiring lock "cinder-0f48747f-fc06-4e3a-b5ce-557efaa0407a-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:09 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ed4ecf12-662c-4794-9b7b-a795ec059060 tempest-ProjectReaderTests-153927055 None] Lock "cinder-0f48747f-fc06-4e3a-b5ce-557efaa0407a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:09 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ed4ecf12-662c-4794-9b7b-a795ec059060 tempest-ProjectReaderTests-153927055 None] Acquiring lock "cinder-quobyte-31dc18e1-0d61-42e6-90e7-c7c15ef9337b" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:09 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ed4ecf12-662c-4794-9b7b-a795ec059060 tempest-ProjectReaderTests-153927055 None] Lock "cinder-quobyte-31dc18e1-0d61-42e6-90e7-c7c15ef9337b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:09 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ed4ecf12-662c-4794-9b7b-a795ec059060 tempest-ProjectReaderTests-153927055 None] Acquiring lock "cinder-quobyte-0f48747f-fc06-4e3a-b5ce-557efaa0407a" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:09 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ed4ecf12-662c-4794-9b7b-a795ec059060 tempest-ProjectReaderTests-153927055 None] Lock "cinder-quobyte-0f48747f-fc06-4e3a-b5ce-557efaa0407a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:09 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-ed4ecf12-662c-4794-9b7b-a795ec059060 tempest-ProjectReaderTests-153927055 None] Deleting offline snapshot 0f48747f-fc06-4e3a-b5ce-557efaa0407a of volume 31dc18e1-0d61-42e6-90e7-c7c15ef9337b {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:46:09 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-ed4ecf12-662c-4794-9b7b-a795ec059060 tempest-ProjectReaderTests-153927055 None] snapshot_file for this snap is: volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b.0f48747f-fc06-4e3a-b5ce-557efaa0407a {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:46:09 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[baab2d9a-fb59-4e3d-b2f0-ffcb0754b0b9]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ed4ecf12-662c-4794-9b7b-a795ec059060 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b.0f48747f-fc06-4e3a-b5ce-557efaa0407a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:09 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-58a0a5be-ef67-45bb-bc13-56b20ae7e372 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-4f1bb1ec-e870-4639-a56a-97371038d100-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:09 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b.0f48747f-fc06-4e3a-b5ce-557efaa0407a Nov 02 12:46:09 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:09 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-58a0a5be-ef67-45bb-bc13-56b20ae7e372 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-4f1bb1ec-e870-4639-a56a-97371038d100-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:09 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-58a0a5be-ef67-45bb-bc13-56b20ae7e372 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-quobyte-4f1bb1ec-e870-4639-a56a-97371038d100" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:09 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-58a0a5be-ef67-45bb-bc13-56b20ae7e372 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-4f1bb1ec-e870-4639-a56a-97371038d100" acquired by "delete_volume" :: waited 0.021s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:09 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd7a44f-0896-4c8e-b98a-9933d9db7563]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-58a0a5be-ef67-45bb-bc13-56b20ae7e372 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:09 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100 Nov 02 12:46:09 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:09 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ed4ecf12-662c-4794-9b7b-a795ec059060 tempest-ProjectReaderTests-153927055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b.0f48747f-fc06-4e3a-b5ce-557efaa0407a" returned: 0 in 0.418s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:09 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-ed4ecf12-662c-4794-9b7b-a795ec059060 tempest-ProjectReaderTests-153927055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:46:09 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3506cf0-43b0-400d-b727-9e11b328bab6]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ed4ecf12-662c-4794-9b7b-a795ec059060 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:09 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b Nov 02 12:46:09 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:09 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-58a0a5be-ef67-45bb-bc13-56b20ae7e372 tempest-ProjectMemberTests-1154001707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100" returned: 0 in 0.404s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:09 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-58a0a5be-ef67-45bb-bc13-56b20ae7e372 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:09 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100 Nov 02 12:46:09 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:10 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ed4ecf12-662c-4794-9b7b-a795ec059060 tempest-ProjectReaderTests-153927055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b" returned: 0 in 0.383s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ed4ecf12-662c-4794-9b7b-a795ec059060 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b.0f48747f-fc06-4e3a-b5ce-557efaa0407a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:10 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b.0f48747f-fc06-4e3a-b5ce-557efaa0407a Nov 02 12:46:10 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:10 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-58a0a5be-ef67-45bb-bc13-56b20ae7e372 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-4f1bb1ec-e870-4639-a56a-97371038d100" returned: 0 in 0.279s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:10 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-58a0a5be-ef67-45bb-bc13-56b20ae7e372 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-4f1bb1ec-e870-4639-a56a-97371038d100" released by "delete_volume" :: held 0.754s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:10 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-58a0a5be-ef67-45bb-bc13-56b20ae7e372 tempest-ProjectMemberTests-1154001707 None] Created reservations ['4cb165c8-d033-4fd6-89fc-4b35504b1a82', '3e192812-cf46-4659-ba04-d29c424c643c', '633e32d2-0f86-4411-a86b-5cace41ce872', '7609dbe2-586e-4b34-8f5e-9afcdb78b137'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-58a0a5be-ef67-45bb-bc13-56b20ae7e372 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-58a0a5be-ef67-45bb-bc13-56b20ae7e372 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:10 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-58a0a5be-ef67-45bb-bc13-56b20ae7e372 tempest-ProjectMemberTests-1154001707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:10 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-58a0a5be-ef67-45bb-bc13-56b20ae7e372 tempest-ProjectMemberTests-1154001707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-58a0a5be-ef67-45bb-bc13-56b20ae7e372 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-58a0a5be-ef67-45bb-bc13-56b20ae7e372 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:10 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:46:10 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:10 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ed4ecf12-662c-4794-9b7b-a795ec059060 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b.0f48747f-fc06-4e3a-b5ce-557efaa0407a" returned: 0 in 0.369s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ed4ecf12-662c-4794-9b7b-a795ec059060 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b.0f48747f-fc06-4e3a-b5ce-557efaa0407a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:10 devstack sudo[107652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b.0f48747f-fc06-4e3a-b5ce-557efaa0407a Nov 02 12:46:10 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:10 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-58a0a5be-ef67-45bb-bc13-56b20ae7e372 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.265s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:10 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-58a0a5be-ef67-45bb-bc13-56b20ae7e372 tempest-ProjectMemberTests-1154001707 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:46:10 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-58a0a5be-ef67-45bb-bc13-56b20ae7e372 tempest-ProjectMemberTests-1154001707 None] Deleted volume successfully. Nov 02 12:46:10 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-58a0a5be-ef67-45bb-bc13-56b20ae7e372 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-4f1bb1ec-e870-4639-a56a-97371038d100-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:10 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:10 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ed4ecf12-662c-4794-9b7b-a795ec059060 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b.0f48747f-fc06-4e3a-b5ce-557efaa0407a" returned: 0 in 0.292s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:10 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ed4ecf12-662c-4794-9b7b-a795ec059060 tempest-ProjectReaderTests-153927055 None] Lock "cinder-quobyte-0f48747f-fc06-4e3a-b5ce-557efaa0407a" released by "_delete_snapshot" :: held 1.588s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:10 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ed4ecf12-662c-4794-9b7b-a795ec059060 tempest-ProjectReaderTests-153927055 None] Lock "cinder-quobyte-31dc18e1-0d61-42e6-90e7-c7c15ef9337b" released by "delete_snapshot" :: held 1.618s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:10 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-ed4ecf12-662c-4794-9b7b-a795ec059060 tempest-ProjectReaderTests-153927055 None] Created reservations ['3ebdca59-7c96-48f8-97b5-9bdc041edb5a', 'ac8c456c-9d4b-4f9c-9e78-b2c3328b5d32', '1a6cb753-5bae-4825-bda8-ec4dab83ea8f', 'dc112423-befd-4eb4-9a64-4cf14ea79ad2'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:11 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-ed4ecf12-662c-4794-9b7b-a795ec059060 tempest-ProjectReaderTests-153927055 None] Delete snapshot completed successfully. Nov 02 12:46:11 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ed4ecf12-662c-4794-9b7b-a795ec059060 tempest-ProjectReaderTests-153927055 None] Lock "cinder-0f48747f-fc06-4e3a-b5ce-557efaa0407a-delete_snapshot" released by "delete_snapshot" :: held 1.791s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:11 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad179f9e-1c1d-4f6f-a4aa-1d93d35ae6db tempest-ProjectMemberTests-1154001707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:46:11 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ad179f9e-1c1d-4f6f-a4aa-1d93d35ae6db tempest-ProjectMemberTests-1154001707 None] Flow 'volume_create_manager' (4aa02cfe-7828-4125-9e5e-65e5311119ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:11 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ad179f9e-1c1d-4f6f-a4aa-1d93d35ae6db tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f001a27-64d2-40af-b264-f066e3b51a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:11 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ad179f9e-1c1d-4f6f-a4aa-1d93d35ae6db tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f001a27-64d2-40af-b264-f066e3b51a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-10807755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74ea7636-b870-46d0-939a-6e8f8e716ff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60099afac3fc4cb3b2313235ee5a57b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:11Z,use_quota=True,user_id='466fcf287769488eaa04f91080ae1f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:11 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ad179f9e-1c1d-4f6f-a4aa-1d93d35ae6db tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bceb5bc-c42a-43e4-a855-7ad9fd664cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:11 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ad179f9e-1c1d-4f6f-a4aa-1d93d35ae6db tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bceb5bc-c42a-43e4-a855-7ad9fd664cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:11 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ad179f9e-1c1d-4f6f-a4aa-1d93d35ae6db tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e23d502-512b-4184-914d-5fe1430ee37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:11 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ad179f9e-1c1d-4f6f-a4aa-1d93d35ae6db tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e23d502-512b-4184-914d-5fe1430ee37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74ea7636-b870-46d0-939a-6e8f8e716ff6', 'volume_name': 'volume-74ea7636-b870-46d0-939a-6e8f8e716ff6', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:11 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ad179f9e-1c1d-4f6f-a4aa-1d93d35ae6db tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bf8ce2d-eaaa-4975-8a7c-1899d8fe1bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:11 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ad179f9e-1c1d-4f6f-a4aa-1d93d35ae6db tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bf8ce2d-eaaa-4975-8a7c-1899d8fe1bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:11 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ad179f9e-1c1d-4f6f-a4aa-1d93d35ae6db tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c70c9bd1-5587-4dff-9522-a1ee42f91a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:11 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-ad179f9e-1c1d-4f6f-a4aa-1d93d35ae6db tempest-ProjectMemberTests-1154001707 None] Volume 74ea7636-b870-46d0-939a-6e8f8e716ff6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74ea7636-b870-46d0-939a-6e8f8e716ff6', 'volume_size': 1} Nov 02 12:46:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ad179f9e-1c1d-4f6f-a4aa-1d93d35ae6db tempest-ProjectMemberTests-1154001707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ad179f9e-1c1d-4f6f-a4aa-1d93d35ae6db tempest-ProjectMemberTests-1154001707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:11 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ad179f9e-1c1d-4f6f-a4aa-1d93d35ae6db tempest-ProjectMemberTests-1154001707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-10807755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74ea7636-b870-46d0-939a-6e8f8e716ff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60099afac3fc4cb3b2313235ee5a57b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:11Z,use_quota=True,user_id='466fcf287769488eaa04f91080ae1f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:46:11 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-ad179f9e-1c1d-4f6f-a4aa-1d93d35ae6db tempest-ProjectMemberTests-1154001707 None] Creating volume 74ea7636-b870-46d0-939a-6e8f8e716ff6 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:46:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ad179f9e-1c1d-4f6f-a4aa-1d93d35ae6db tempest-ProjectMemberTests-1154001707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ad179f9e-1c1d-4f6f-a4aa-1d93d35ae6db tempest-ProjectMemberTests-1154001707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:11 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ad179f9e-1c1d-4f6f-a4aa-1d93d35ae6db tempest-ProjectMemberTests-1154001707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:11 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ad179f9e-1c1d-4f6f-a4aa-1d93d35ae6db tempest-ProjectMemberTests-1154001707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ad179f9e-1c1d-4f6f-a4aa-1d93d35ae6db tempest-ProjectMemberTests-1154001707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:11 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ad179f9e-1c1d-4f6f-a4aa-1d93d35ae6db tempest-ProjectMemberTests-1154001707 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:46:11 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-ad179f9e-1c1d-4f6f-a4aa-1d93d35ae6db tempest-ProjectMemberTests-1154001707 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:46:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ad179f9e-1c1d-4f6f-a4aa-1d93d35ae6db tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:11 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f8b3a440-e022-4263-9cfd-62cf2c983bfe tempest-ProjectReaderTests-153927055 None] Acquiring lock "cinder-31dc18e1-0d61-42e6-90e7-c7c15ef9337b-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:11 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6 1073741824 Nov 02 12:46:11 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:11 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f8b3a440-e022-4263-9cfd-62cf2c983bfe tempest-ProjectReaderTests-153927055 None] Lock "cinder-31dc18e1-0d61-42e6-90e7-c7c15ef9337b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:11 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f8b3a440-e022-4263-9cfd-62cf2c983bfe tempest-ProjectReaderTests-153927055 None] Acquiring lock "cinder-quobyte-31dc18e1-0d61-42e6-90e7-c7c15ef9337b" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:11 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f8b3a440-e022-4263-9cfd-62cf2c983bfe tempest-ProjectReaderTests-153927055 None] Lock "cinder-quobyte-31dc18e1-0d61-42e6-90e7-c7c15ef9337b" acquired by "delete_volume" :: waited 0.013s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:11 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[87477d63-d2ec-4f20-857c-fd93002b56ac]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f8b3a440-e022-4263-9cfd-62cf2c983bfe tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:11 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b Nov 02 12:46:11 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:11 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ad179f9e-1c1d-4f6f-a4aa-1d93d35ae6db tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6 1073741824" returned: 0 in 0.431s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ad179f9e-1c1d-4f6f-a4aa-1d93d35ae6db tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:11 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6 Nov 02 12:46:11 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:11 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f8b3a440-e022-4263-9cfd-62cf2c983bfe tempest-ProjectReaderTests-153927055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b" returned: 0 in 0.377s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:11 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f8b3a440-e022-4263-9cfd-62cf2c983bfe tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:11 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b Nov 02 12:46:11 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:12 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ad179f9e-1c1d-4f6f-a4aa-1d93d35ae6db tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6" returned: 0 in 0.262s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:12 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ad179f9e-1c1d-4f6f-a4aa-1d93d35ae6db tempest-ProjectMemberTests-1154001707 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:46:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ad179f9e-1c1d-4f6f-a4aa-1d93d35ae6db tempest-ProjectMemberTests-1154001707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:12 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ad179f9e-1c1d-4f6f-a4aa-1d93d35ae6db tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c70c9bd1-5587-4dff-9522-a1ee42f91a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74ea7636-b870-46d0-939a-6e8f8e716ff6', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:12 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ad179f9e-1c1d-4f6f-a4aa-1d93d35ae6db tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13e0645e-9bcd-470b-b252-00374802cbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:12 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f8b3a440-e022-4263-9cfd-62cf2c983bfe tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-31dc18e1-0d61-42e6-90e7-c7c15ef9337b" returned: 0 in 0.256s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:12 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-ad179f9e-1c1d-4f6f-a4aa-1d93d35ae6db tempest-ProjectMemberTests-1154001707 None] Volume volume-74ea7636-b870-46d0-939a-6e8f8e716ff6 (74ea7636-b870-46d0-939a-6e8f8e716ff6): created successfully Nov 02 12:46:12 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ad179f9e-1c1d-4f6f-a4aa-1d93d35ae6db tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13e0645e-9bcd-470b-b252-00374802cbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:12 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ad179f9e-1c1d-4f6f-a4aa-1d93d35ae6db tempest-ProjectMemberTests-1154001707 None] Flow 'volume_create_manager' (4aa02cfe-7828-4125-9e5e-65e5311119ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:12 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f8b3a440-e022-4263-9cfd-62cf2c983bfe tempest-ProjectReaderTests-153927055 None] Lock "cinder-quobyte-31dc18e1-0d61-42e6-90e7-c7c15ef9337b" released by "delete_volume" :: held 0.714s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:12 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-ad179f9e-1c1d-4f6f-a4aa-1d93d35ae6db tempest-ProjectMemberTests-1154001707 None] Created volume successfully. Nov 02 12:46:12 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-f8b3a440-e022-4263-9cfd-62cf2c983bfe tempest-ProjectReaderTests-153927055 None] Created reservations ['30c7c99e-2e3c-4298-9991-e7112fe39115', 'd2cee45d-f7f3-4930-8500-87d89bea8ee5', '407560fa-6037-4219-868b-0544ac638620', '548aebd9-6aa8-4be8-ab08-c64802282281'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f8b3a440-e022-4263-9cfd-62cf2c983bfe tempest-ProjectReaderTests-153927055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f8b3a440-e022-4263-9cfd-62cf2c983bfe tempest-ProjectReaderTests-153927055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:12 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f8b3a440-e022-4263-9cfd-62cf2c983bfe tempest-ProjectReaderTests-153927055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:12 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f8b3a440-e022-4263-9cfd-62cf2c983bfe tempest-ProjectReaderTests-153927055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f8b3a440-e022-4263-9cfd-62cf2c983bfe tempest-ProjectReaderTests-153927055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f8b3a440-e022-4263-9cfd-62cf2c983bfe tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:12 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:46:12 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:12 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:12 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f8b3a440-e022-4263-9cfd-62cf2c983bfe tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.292s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:12 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-f8b3a440-e022-4263-9cfd-62cf2c983bfe tempest-ProjectReaderTests-153927055 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:46:12 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-f8b3a440-e022-4263-9cfd-62cf2c983bfe tempest-ProjectReaderTests-153927055 None] Deleted volume successfully. Nov 02 12:46:12 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f8b3a440-e022-4263-9cfd-62cf2c983bfe tempest-ProjectReaderTests-153927055 None] Lock "cinder-31dc18e1-0d61-42e6-90e7-c7c15ef9337b-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:13 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fe4d21f-3823-4b58-b734-5dfb3ef72928 tempest-ProjectReaderTests-153927055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:46:13 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0fe4d21f-3823-4b58-b734-5dfb3ef72928 tempest-ProjectReaderTests-153927055 None] Flow 'volume_create_manager' (4168ae54-5080-4e15-915e-ab9cca1b0e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:13 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0fe4d21f-3823-4b58-b734-5dfb3ef72928 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad9831a7-f2ac-49dd-881d-47198f1617b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:13 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0fe4d21f-3823-4b58-b734-5dfb3ef72928 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad9831a7-f2ac-49dd-881d-47198f1617b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1952005281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aec6bb0-4854-4799-8efa-c56ef2e6396f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='371854aebb9b4c37b51206a234c0f7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:13Z,use_quota=True,user_id='2859c42cc4c64316a323f9dd6c533e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:13 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0fe4d21f-3823-4b58-b734-5dfb3ef72928 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a18476-6dac-4cd0-87a7-68655d320e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:13 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0fe4d21f-3823-4b58-b734-5dfb3ef72928 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15a18476-6dac-4cd0-87a7-68655d320e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:13 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0fe4d21f-3823-4b58-b734-5dfb3ef72928 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cfe13c9-75e1-40b4-8234-b2812f2aefe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:13 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0fe4d21f-3823-4b58-b734-5dfb3ef72928 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cfe13c9-75e1-40b4-8234-b2812f2aefe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aec6bb0-4854-4799-8efa-c56ef2e6396f', 'volume_name': 'volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:13 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0fe4d21f-3823-4b58-b734-5dfb3ef72928 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f22ec0ac-bf79-413e-8caf-6d15cd7603c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:13 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0fe4d21f-3823-4b58-b734-5dfb3ef72928 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f22ec0ac-bf79-413e-8caf-6d15cd7603c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:13 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0fe4d21f-3823-4b58-b734-5dfb3ef72928 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ae17ca-ff9c-4ca0-836b-2d5157bc1104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:13 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-0fe4d21f-3823-4b58-b734-5dfb3ef72928 tempest-ProjectReaderTests-153927055 None] Volume 6aec6bb0-4854-4799-8efa-c56ef2e6396f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f', 'volume_size': 1} Nov 02 12:46:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0fe4d21f-3823-4b58-b734-5dfb3ef72928 tempest-ProjectReaderTests-153927055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0fe4d21f-3823-4b58-b734-5dfb3ef72928 tempest-ProjectReaderTests-153927055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:13 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0fe4d21f-3823-4b58-b734-5dfb3ef72928 tempest-ProjectReaderTests-153927055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1952005281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aec6bb0-4854-4799-8efa-c56ef2e6396f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='371854aebb9b4c37b51206a234c0f7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:13Z,use_quota=True,user_id='2859c42cc4c64316a323f9dd6c533e7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:46:13 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-0fe4d21f-3823-4b58-b734-5dfb3ef72928 tempest-ProjectReaderTests-153927055 None] Creating volume 6aec6bb0-4854-4799-8efa-c56ef2e6396f {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:46:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0fe4d21f-3823-4b58-b734-5dfb3ef72928 tempest-ProjectReaderTests-153927055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0fe4d21f-3823-4b58-b734-5dfb3ef72928 tempest-ProjectReaderTests-153927055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:13 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0fe4d21f-3823-4b58-b734-5dfb3ef72928 tempest-ProjectReaderTests-153927055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:13 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0fe4d21f-3823-4b58-b734-5dfb3ef72928 tempest-ProjectReaderTests-153927055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0fe4d21f-3823-4b58-b734-5dfb3ef72928 tempest-ProjectReaderTests-153927055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:13 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0fe4d21f-3823-4b58-b734-5dfb3ef72928 tempest-ProjectReaderTests-153927055 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:46:13 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-0fe4d21f-3823-4b58-b734-5dfb3ef72928 tempest-ProjectReaderTests-153927055 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:46:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0fe4d21f-3823-4b58-b734-5dfb3ef72928 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:13 devstack sudo[107679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f 1073741824 Nov 02 12:46:13 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-6e8e7ed5-121c-4107-8395-e0acbcfcf896 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:13 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0fe4d21f-3823-4b58-b734-5dfb3ef72928 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f 1073741824" returned: 0 in 0.436s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:13 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0fe4d21f-3823-4b58-b734-5dfb3ef72928 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:13 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f Nov 02 12:46:13 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:14 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0fe4d21f-3823-4b58-b734-5dfb3ef72928 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f" returned: 0 in 0.264s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:14 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0fe4d21f-3823-4b58-b734-5dfb3ef72928 tempest-ProjectReaderTests-153927055 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:46:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0fe4d21f-3823-4b58-b734-5dfb3ef72928 tempest-ProjectReaderTests-153927055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-6e8e7ed5-121c-4107-8395-e0acbcfcf896 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.700s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:14 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-6e8e7ed5-121c-4107-8395-e0acbcfcf896 tempest-ProjectMemberTests-1154001707 None] Creating offline snapshot 332e16d1-066d-4263-b6b5-ecb1784ad7ae of volume 74ea7636-b870-46d0-939a-6e8f8e716ff6 {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:46:14 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0fe4d21f-3823-4b58-b734-5dfb3ef72928 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ae17ca-ff9c-4ca0-836b-2d5157bc1104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:14 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0fe4d21f-3823-4b58-b734-5dfb3ef72928 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (361b8343-65be-4913-b56f-02026dc5b269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:14 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[576e60fc-ce6b-4968-8565-778aa1e1ea1b]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6e8e7ed5-121c-4107-8395-e0acbcfcf896 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:14 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-0fe4d21f-3823-4b58-b734-5dfb3ef72928 tempest-ProjectReaderTests-153927055 None] Volume volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f (6aec6bb0-4854-4799-8efa-c56ef2e6396f): created successfully Nov 02 12:46:14 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0fe4d21f-3823-4b58-b734-5dfb3ef72928 tempest-ProjectReaderTests-153927055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (361b8343-65be-4913-b56f-02026dc5b269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:14 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0fe4d21f-3823-4b58-b734-5dfb3ef72928 tempest-ProjectReaderTests-153927055 None] Flow 'volume_create_manager' (4168ae54-5080-4e15-915e-ab9cca1b0e08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:14 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-0fe4d21f-3823-4b58-b734-5dfb3ef72928 tempest-ProjectReaderTests-153927055 None] Created volume successfully. Nov 02 12:46:14 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6 Nov 02 12:46:14 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:14 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6e8e7ed5-121c-4107-8395-e0acbcfcf896 tempest-ProjectMemberTests-1154001707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6" returned: 0 in 0.380s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6e8e7ed5-121c-4107-8395-e0acbcfcf896 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6.332e16d1-066d-4263-b6b5-ecb1784ad7ae 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:14 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6.332e16d1-066d-4263-b6b5-ecb1784ad7ae 1G Nov 02 12:46:14 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:14 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6e8e7ed5-121c-4107-8395-e0acbcfcf896 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6.332e16d1-066d-4263-b6b5-ecb1784ad7ae 1G" returned: 0 in 0.401s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:14 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6e8e7ed5-121c-4107-8395-e0acbcfcf896 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74ea7636-b870-46d0-939a-6e8f8e716ff6 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6.332e16d1-066d-4263-b6b5-ecb1784ad7ae {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:14 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74ea7636-b870-46d0-939a-6e8f8e716ff6 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6.332e16d1-066d-4263-b6b5-ecb1784ad7ae Nov 02 12:46:14 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:15 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6e8e7ed5-121c-4107-8395-e0acbcfcf896 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74ea7636-b870-46d0-939a-6e8f8e716ff6 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6.332e16d1-066d-4263-b6b5-ecb1784ad7ae" returned: 0 in 0.299s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:15 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-6e8e7ed5-121c-4107-8395-e0acbcfcf896 tempest-ProjectMemberTests-1154001707 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6.332e16d1-066d-4263-b6b5-ecb1784ad7ae is being set with open permissions: ugo+rw Nov 02 12:46:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6e8e7ed5-121c-4107-8395-e0acbcfcf896 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6.332e16d1-066d-4263-b6b5-ecb1784ad7ae {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:15 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6.332e16d1-066d-4263-b6b5-ecb1784ad7ae Nov 02 12:46:15 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e4e77abd-4207-47ce-aa67-4bd44ffaa639 tempest-ProjectReaderTests-153927055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:15 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6e8e7ed5-121c-4107-8395-e0acbcfcf896 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6.332e16d1-066d-4263-b6b5-ecb1784ad7ae" returned: 0 in 0.233s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6e8e7ed5-121c-4107-8395-e0acbcfcf896 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:15 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6.info Nov 02 12:46:15 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:15 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6e8e7ed5-121c-4107-8395-e0acbcfcf896 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6.info" returned: 0 in 0.240s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:15 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-6e8e7ed5-121c-4107-8395-e0acbcfcf896 tempest-ProjectMemberTests-1154001707 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6.info is being set with open permissions: ugo+rw Nov 02 12:46:15 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6e8e7ed5-121c-4107-8395-e0acbcfcf896 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:15 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6.info Nov 02 12:46:15 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:16 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-6e8e7ed5-121c-4107-8395-e0acbcfcf896 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6.info" returned: 0 in 0.248s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-6e8e7ed5-121c-4107-8395-e0acbcfcf896 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.888s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e4e77abd-4207-47ce-aa67-4bd44ffaa639 tempest-ProjectReaderTests-153927055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.686s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:16 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-e4e77abd-4207-47ce-aa67-4bd44ffaa639 tempest-ProjectReaderTests-153927055 None] Creating offline snapshot ad78178e-224c-4f31-b446-2be58db94817 of volume 6aec6bb0-4854-4799-8efa-c56ef2e6396f {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:46:16 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[767919f7-1199-4666-aed2-bd23241e1949]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:16 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-6e8e7ed5-121c-4107-8395-e0acbcfcf896 tempest-ProjectMemberTests-1154001707 None] Create snapshot completed successfully Nov 02 12:46:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e4e77abd-4207-47ce-aa67-4bd44ffaa639 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:16 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f Nov 02 12:46:16 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:16 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e4e77abd-4207-47ce-aa67-4bd44ffaa639 tempest-ProjectReaderTests-153927055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f" returned: 0 in 0.396s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e4e77abd-4207-47ce-aa67-4bd44ffaa639 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f.ad78178e-224c-4f31-b446-2be58db94817 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:16 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f.ad78178e-224c-4f31-b446-2be58db94817 1G Nov 02 12:46:16 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:16 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-595a2f9d-5fb2-4fda-918c-271343127a6f tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-332e16d1-066d-4263-b6b5-ecb1784ad7ae-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:16 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-595a2f9d-5fb2-4fda-918c-271343127a6f tempest-ProjectMemberTests-1154001707 None] Lock "cinder-332e16d1-066d-4263-b6b5-ecb1784ad7ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:16 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-595a2f9d-5fb2-4fda-918c-271343127a6f tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-quobyte-74ea7636-b870-46d0-939a-6e8f8e716ff6" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:16 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-595a2f9d-5fb2-4fda-918c-271343127a6f tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-74ea7636-b870-46d0-939a-6e8f8e716ff6" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:16 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-595a2f9d-5fb2-4fda-918c-271343127a6f tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-quobyte-332e16d1-066d-4263-b6b5-ecb1784ad7ae" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:16 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-595a2f9d-5fb2-4fda-918c-271343127a6f tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-332e16d1-066d-4263-b6b5-ecb1784ad7ae" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:16 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-595a2f9d-5fb2-4fda-918c-271343127a6f tempest-ProjectMemberTests-1154001707 None] Deleting offline snapshot 332e16d1-066d-4263-b6b5-ecb1784ad7ae of volume 74ea7636-b870-46d0-939a-6e8f8e716ff6 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:46:16 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-595a2f9d-5fb2-4fda-918c-271343127a6f tempest-ProjectMemberTests-1154001707 None] snapshot_file for this snap is: volume-74ea7636-b870-46d0-939a-6e8f8e716ff6.332e16d1-066d-4263-b6b5-ecb1784ad7ae {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:46:16 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[5baa736c-b848-40b5-807a-7a680493d723]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-595a2f9d-5fb2-4fda-918c-271343127a6f tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6.332e16d1-066d-4263-b6b5-ecb1784ad7ae {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:16 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6.332e16d1-066d-4263-b6b5-ecb1784ad7ae Nov 02 12:46:16 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:16 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e4e77abd-4207-47ce-aa67-4bd44ffaa639 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f.ad78178e-224c-4f31-b446-2be58db94817 1G" returned: 0 in 0.505s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:16 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e4e77abd-4207-47ce-aa67-4bd44ffaa639 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f.ad78178e-224c-4f31-b446-2be58db94817 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:17 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f.ad78178e-224c-4f31-b446-2be58db94817 Nov 02 12:46:17 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:17 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-595a2f9d-5fb2-4fda-918c-271343127a6f tempest-ProjectMemberTests-1154001707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6.332e16d1-066d-4263-b6b5-ecb1784ad7ae" returned: 0 in 0.451s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:17 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-595a2f9d-5fb2-4fda-918c-271343127a6f tempest-ProjectMemberTests-1154001707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74ea7636-b870-46d0-939a-6e8f8e716ff6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:46:17 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79af620-6276-457f-88b4-3fcb85b621f5]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-595a2f9d-5fb2-4fda-918c-271343127a6f tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:17 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6 Nov 02 12:46:17 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:17 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e4e77abd-4207-47ce-aa67-4bd44ffaa639 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f.ad78178e-224c-4f31-b446-2be58db94817" returned: 0 in 0.343s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:17 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-e4e77abd-4207-47ce-aa67-4bd44ffaa639 tempest-ProjectReaderTests-153927055 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f.ad78178e-224c-4f31-b446-2be58db94817 is being set with open permissions: ugo+rw Nov 02 12:46:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e4e77abd-4207-47ce-aa67-4bd44ffaa639 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f.ad78178e-224c-4f31-b446-2be58db94817 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:17 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f.ad78178e-224c-4f31-b446-2be58db94817 Nov 02 12:46:17 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:17 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-595a2f9d-5fb2-4fda-918c-271343127a6f tempest-ProjectMemberTests-1154001707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6" returned: 0 in 0.462s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-595a2f9d-5fb2-4fda-918c-271343127a6f tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6.332e16d1-066d-4263-b6b5-ecb1784ad7ae {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:17 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6.332e16d1-066d-4263-b6b5-ecb1784ad7ae Nov 02 12:46:17 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:17 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e4e77abd-4207-47ce-aa67-4bd44ffaa639 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f.ad78178e-224c-4f31-b446-2be58db94817" returned: 0 in 0.347s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e4e77abd-4207-47ce-aa67-4bd44ffaa639 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:17 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f.info Nov 02 12:46:17 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:17 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e4e77abd-4207-47ce-aa67-4bd44ffaa639 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f.info" returned: 0 in 0.256s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:17 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-e4e77abd-4207-47ce-aa67-4bd44ffaa639 tempest-ProjectReaderTests-153927055 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f.info is being set with open permissions: ugo+rw Nov 02 12:46:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e4e77abd-4207-47ce-aa67-4bd44ffaa639 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:17 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f.info Nov 02 12:46:17 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:17 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:17 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-595a2f9d-5fb2-4fda-918c-271343127a6f tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6.332e16d1-066d-4263-b6b5-ecb1784ad7ae" returned: 0 in 0.363s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-595a2f9d-5fb2-4fda-918c-271343127a6f tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6.332e16d1-066d-4263-b6b5-ecb1784ad7ae {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:18 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6.332e16d1-066d-4263-b6b5-ecb1784ad7ae Nov 02 12:46:18 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:18 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e4e77abd-4207-47ce-aa67-4bd44ffaa639 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f.info" returned: 0 in 0.285s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:18 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e4e77abd-4207-47ce-aa67-4bd44ffaa639 tempest-ProjectReaderTests-153927055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.249s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-595a2f9d-5fb2-4fda-918c-271343127a6f tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6.332e16d1-066d-4263-b6b5-ecb1784ad7ae" returned: 0 in 0.273s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:18 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-595a2f9d-5fb2-4fda-918c-271343127a6f tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-332e16d1-066d-4263-b6b5-ecb1784ad7ae" released by "_delete_snapshot" :: held 1.684s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:18 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-595a2f9d-5fb2-4fda-918c-271343127a6f tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-74ea7636-b870-46d0-939a-6e8f8e716ff6" released by "delete_snapshot" :: held 1.713s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:18 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-e4e77abd-4207-47ce-aa67-4bd44ffaa639 tempest-ProjectReaderTests-153927055 None] Create snapshot completed successfully Nov 02 12:46:18 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-595a2f9d-5fb2-4fda-918c-271343127a6f tempest-ProjectMemberTests-1154001707 None] Created reservations ['8eeee4d6-91c6-4c4b-a45a-348d8a2f71d4', 'e94b6a23-24ad-4325-80f7-18fc748c3d29', 'e3b4a003-3e49-4219-bf7e-3508c482b3bd', '5fa4257f-ec26-4a54-af45-c095b2f627f2'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:18 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-595a2f9d-5fb2-4fda-918c-271343127a6f tempest-ProjectMemberTests-1154001707 None] Delete snapshot completed successfully. Nov 02 12:46:18 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-595a2f9d-5fb2-4fda-918c-271343127a6f tempest-ProjectMemberTests-1154001707 None] Lock "cinder-332e16d1-066d-4263-b6b5-ecb1784ad7ae-delete_snapshot" released by "delete_snapshot" :: held 1.877s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:18 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9de22f03-af3c-47f7-b7e8-2571e2d3737e tempest-ProjectReaderTests-153927055 None] Acquiring lock "cinder-ad78178e-224c-4f31-b446-2be58db94817-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:18 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9de22f03-af3c-47f7-b7e8-2571e2d3737e tempest-ProjectReaderTests-153927055 None] Lock "cinder-ad78178e-224c-4f31-b446-2be58db94817-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:18 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9de22f03-af3c-47f7-b7e8-2571e2d3737e tempest-ProjectReaderTests-153927055 None] Acquiring lock "cinder-quobyte-6aec6bb0-4854-4799-8efa-c56ef2e6396f" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:18 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9de22f03-af3c-47f7-b7e8-2571e2d3737e tempest-ProjectReaderTests-153927055 None] Lock "cinder-quobyte-6aec6bb0-4854-4799-8efa-c56ef2e6396f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:18 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9de22f03-af3c-47f7-b7e8-2571e2d3737e tempest-ProjectReaderTests-153927055 None] Acquiring lock "cinder-quobyte-ad78178e-224c-4f31-b446-2be58db94817" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:18 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9de22f03-af3c-47f7-b7e8-2571e2d3737e tempest-ProjectReaderTests-153927055 None] Lock "cinder-quobyte-ad78178e-224c-4f31-b446-2be58db94817" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:18 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-9de22f03-af3c-47f7-b7e8-2571e2d3737e tempest-ProjectReaderTests-153927055 None] Deleting offline snapshot ad78178e-224c-4f31-b446-2be58db94817 of volume 6aec6bb0-4854-4799-8efa-c56ef2e6396f {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:46:18 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-9de22f03-af3c-47f7-b7e8-2571e2d3737e tempest-ProjectReaderTests-153927055 None] snapshot_file for this snap is: volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f.ad78178e-224c-4f31-b446-2be58db94817 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:46:18 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab1f98d-0682-4cd5-beda-55e965b77fc9]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9de22f03-af3c-47f7-b7e8-2571e2d3737e tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f.ad78178e-224c-4f31-b446-2be58db94817 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:18 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7db24836-9534-44d2-8abe-64f4ffe96c5c tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-74ea7636-b870-46d0-939a-6e8f8e716ff6-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:18 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7db24836-9534-44d2-8abe-64f4ffe96c5c tempest-ProjectMemberTests-1154001707 None] Lock "cinder-74ea7636-b870-46d0-939a-6e8f8e716ff6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:18 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f.ad78178e-224c-4f31-b446-2be58db94817 Nov 02 12:46:18 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:18 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7db24836-9534-44d2-8abe-64f4ffe96c5c tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-quobyte-74ea7636-b870-46d0-939a-6e8f8e716ff6" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:18 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7db24836-9534-44d2-8abe-64f4ffe96c5c tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-74ea7636-b870-46d0-939a-6e8f8e716ff6" acquired by "delete_volume" :: waited 0.017s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:18 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[47826d52-3fcb-483d-802a-7a38b5c69d33]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:18 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7db24836-9534-44d2-8abe-64f4ffe96c5c tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:19 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6 Nov 02 12:46:19 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:19 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9de22f03-af3c-47f7-b7e8-2571e2d3737e tempest-ProjectReaderTests-153927055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f.ad78178e-224c-4f31-b446-2be58db94817" returned: 0 in 0.433s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:19 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-9de22f03-af3c-47f7-b7e8-2571e2d3737e tempest-ProjectReaderTests-153927055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:46:19 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[e190e893-f749-47e5-bb9e-dbe0b93fdfd2]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9de22f03-af3c-47f7-b7e8-2571e2d3737e tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:19 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f Nov 02 12:46:19 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:19 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7db24836-9534-44d2-8abe-64f4ffe96c5c tempest-ProjectMemberTests-1154001707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6" returned: 0 in 0.410s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7db24836-9534-44d2-8abe-64f4ffe96c5c tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:19 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6 Nov 02 12:46:19 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:19 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9de22f03-af3c-47f7-b7e8-2571e2d3737e tempest-ProjectReaderTests-153927055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f" returned: 0 in 0.386s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9de22f03-af3c-47f7-b7e8-2571e2d3737e tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f.ad78178e-224c-4f31-b446-2be58db94817 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:19 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f.ad78178e-224c-4f31-b446-2be58db94817 Nov 02 12:46:19 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:19 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7db24836-9534-44d2-8abe-64f4ffe96c5c tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-74ea7636-b870-46d0-939a-6e8f8e716ff6" returned: 0 in 0.272s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:19 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7db24836-9534-44d2-8abe-64f4ffe96c5c tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-74ea7636-b870-46d0-939a-6e8f8e716ff6" released by "delete_volume" :: held 0.772s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:19 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-7db24836-9534-44d2-8abe-64f4ffe96c5c tempest-ProjectMemberTests-1154001707 None] Created reservations ['4f101ead-e470-426c-a7f8-0eebe0b3fe1f', 'b2288f2b-d856-415e-a785-590869c7fcae', '5067d618-cce2-4a68-9c33-cd50731713d3', 'e9777d09-bc06-469d-aaf2-34980f9daaa8'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7db24836-9534-44d2-8abe-64f4ffe96c5c tempest-ProjectMemberTests-1154001707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7db24836-9534-44d2-8abe-64f4ffe96c5c tempest-ProjectMemberTests-1154001707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:19 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-7db24836-9534-44d2-8abe-64f4ffe96c5c tempest-ProjectMemberTests-1154001707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:19 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-7db24836-9534-44d2-8abe-64f4ffe96c5c tempest-ProjectMemberTests-1154001707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-7db24836-9534-44d2-8abe-64f4ffe96c5c tempest-ProjectMemberTests-1154001707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7db24836-9534-44d2-8abe-64f4ffe96c5c tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:19 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:46:19 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:19 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9de22f03-af3c-47f7-b7e8-2571e2d3737e tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f.ad78178e-224c-4f31-b446-2be58db94817" returned: 0 in 0.433s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:19 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9de22f03-af3c-47f7-b7e8-2571e2d3737e tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f.ad78178e-224c-4f31-b446-2be58db94817 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:19 devstack sudo[107781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f.ad78178e-224c-4f31-b446-2be58db94817 Nov 02 12:46:19 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:20 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-7db24836-9534-44d2-8abe-64f4ffe96c5c tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.280s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:20 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-7db24836-9534-44d2-8abe-64f4ffe96c5c tempest-ProjectMemberTests-1154001707 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:46:20 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-7db24836-9534-44d2-8abe-64f4ffe96c5c tempest-ProjectMemberTests-1154001707 None] Deleted volume successfully. Nov 02 12:46:20 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-7db24836-9534-44d2-8abe-64f4ffe96c5c tempest-ProjectMemberTests-1154001707 None] Lock "cinder-74ea7636-b870-46d0-939a-6e8f8e716ff6-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:20 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-9de22f03-af3c-47f7-b7e8-2571e2d3737e tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f.ad78178e-224c-4f31-b446-2be58db94817" returned: 0 in 0.351s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:20 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9de22f03-af3c-47f7-b7e8-2571e2d3737e tempest-ProjectReaderTests-153927055 None] Lock "cinder-quobyte-ad78178e-224c-4f31-b446-2be58db94817" released by "_delete_snapshot" :: held 1.743s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:20 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9de22f03-af3c-47f7-b7e8-2571e2d3737e tempest-ProjectReaderTests-153927055 None] Lock "cinder-quobyte-6aec6bb0-4854-4799-8efa-c56ef2e6396f" released by "delete_snapshot" :: held 1.771s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:20 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-9de22f03-af3c-47f7-b7e8-2571e2d3737e tempest-ProjectReaderTests-153927055 None] Created reservations ['c57237b9-70d0-4fcf-bea0-09db48054fae', '5bb58d71-f35c-430a-9ffe-7f0f7753e47c', 'b05fbada-46b4-4fbc-a0f0-e4cdc022cfde', 'd869b5c2-c666-479f-8123-ad84828d3fb0'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:20 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-9de22f03-af3c-47f7-b7e8-2571e2d3737e tempest-ProjectReaderTests-153927055 None] Delete snapshot completed successfully. Nov 02 12:46:20 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-9de22f03-af3c-47f7-b7e8-2571e2d3737e tempest-ProjectReaderTests-153927055 None] Lock "cinder-ad78178e-224c-4f31-b446-2be58db94817-delete_snapshot" released by "delete_snapshot" :: held 1.944s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:20 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-0accb865-ee50-44e7-8031-727614b53b88 tempest-ProjectMemberTests-1154001707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:46:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0accb865-ee50-44e7-8031-727614b53b88 tempest-ProjectMemberTests-1154001707 None] Flow 'volume_create_manager' (9d55963d-26ce-4889-98fe-281de3de9ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0accb865-ee50-44e7-8031-727614b53b88 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad78e00b-96c3-4bbc-8ed1-91ddcf1f3a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0accb865-ee50-44e7-8031-727614b53b88 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad78e00b-96c3-4bbc-8ed1-91ddcf1f3a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1435595821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60099afac3fc4cb3b2313235ee5a57b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:20Z,use_quota=True,user_id='466fcf287769488eaa04f91080ae1f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0accb865-ee50-44e7-8031-727614b53b88 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94c5dd92-dd53-40f6-a2ad-b11b5d4def25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0accb865-ee50-44e7-8031-727614b53b88 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94c5dd92-dd53-40f6-a2ad-b11b5d4def25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0accb865-ee50-44e7-8031-727614b53b88 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fdc378f-196f-47b0-b3ed-c2b4008daa26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0accb865-ee50-44e7-8031-727614b53b88 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fdc378f-196f-47b0-b3ed-c2b4008daa26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a', 'volume_name': 'volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0accb865-ee50-44e7-8031-727614b53b88 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef87a8e-bef8-4b2b-bf9e-372c020de1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0accb865-ee50-44e7-8031-727614b53b88 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef87a8e-bef8-4b2b-bf9e-372c020de1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:20 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0accb865-ee50-44e7-8031-727614b53b88 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (764bb348-c46a-4bb7-8d87-ebcf69a9536f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:20 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-0accb865-ee50-44e7-8031-727614b53b88 tempest-ProjectMemberTests-1154001707 None] Volume 51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a', 'volume_size': 1} Nov 02 12:46:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0accb865-ee50-44e7-8031-727614b53b88 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0accb865-ee50-44e7-8031-727614b53b88 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0accb865-ee50-44e7-8031-727614b53b88 tempest-ProjectMemberTests-1154001707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1435595821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60099afac3fc4cb3b2313235ee5a57b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:20Z,use_quota=True,user_id='466fcf287769488eaa04f91080ae1f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:46:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-0accb865-ee50-44e7-8031-727614b53b88 tempest-ProjectMemberTests-1154001707 None] Creating volume 51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:46:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0accb865-ee50-44e7-8031-727614b53b88 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0accb865-ee50-44e7-8031-727614b53b88 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0accb865-ee50-44e7-8031-727614b53b88 tempest-ProjectMemberTests-1154001707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0accb865-ee50-44e7-8031-727614b53b88 tempest-ProjectMemberTests-1154001707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0accb865-ee50-44e7-8031-727614b53b88 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:20 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0accb865-ee50-44e7-8031-727614b53b88 tempest-ProjectMemberTests-1154001707 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:46:20 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-0accb865-ee50-44e7-8031-727614b53b88 tempest-ProjectMemberTests-1154001707 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:46:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0accb865-ee50-44e7-8031-727614b53b88 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:20 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a 1073741824 Nov 02 12:46:20 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:20 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-eaf5c3e5-dbdc-4b15-8e4e-03843ba34ff8 tempest-ProjectReaderTests-153927055 None] Acquiring lock "cinder-6aec6bb0-4854-4799-8efa-c56ef2e6396f-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:20 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-eaf5c3e5-dbdc-4b15-8e4e-03843ba34ff8 tempest-ProjectReaderTests-153927055 None] Lock "cinder-6aec6bb0-4854-4799-8efa-c56ef2e6396f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:20 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-eaf5c3e5-dbdc-4b15-8e4e-03843ba34ff8 tempest-ProjectReaderTests-153927055 None] Acquiring lock "cinder-quobyte-6aec6bb0-4854-4799-8efa-c56ef2e6396f" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:20 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-eaf5c3e5-dbdc-4b15-8e4e-03843ba34ff8 tempest-ProjectReaderTests-153927055 None] Lock "cinder-quobyte-6aec6bb0-4854-4799-8efa-c56ef2e6396f" acquired by "delete_volume" :: waited 0.029s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:20 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e5da20-3a8b-4dcd-a470-787005984fc5]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:20 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eaf5c3e5-dbdc-4b15-8e4e-03843ba34ff8 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:21 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f Nov 02 12:46:21 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:21 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0accb865-ee50-44e7-8031-727614b53b88 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a 1073741824" returned: 0 in 0.502s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0accb865-ee50-44e7-8031-727614b53b88 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:21 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a Nov 02 12:46:21 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:21 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eaf5c3e5-dbdc-4b15-8e4e-03843ba34ff8 tempest-ProjectReaderTests-153927055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f" returned: 0 in 0.415s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eaf5c3e5-dbdc-4b15-8e4e-03843ba34ff8 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:21 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f Nov 02 12:46:21 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:21 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-0accb865-ee50-44e7-8031-727614b53b88 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a" returned: 0 in 0.291s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:21 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-0accb865-ee50-44e7-8031-727614b53b88 tempest-ProjectMemberTests-1154001707 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:46:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-0accb865-ee50-44e7-8031-727614b53b88 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0accb865-ee50-44e7-8031-727614b53b88 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (764bb348-c46a-4bb7-8d87-ebcf69a9536f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0accb865-ee50-44e7-8031-727614b53b88 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628040b8-1438-4de4-83f7-c699d2983902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:21 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-0accb865-ee50-44e7-8031-727614b53b88 tempest-ProjectMemberTests-1154001707 None] Volume volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a (51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a): created successfully Nov 02 12:46:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0accb865-ee50-44e7-8031-727614b53b88 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628040b8-1438-4de4-83f7-c699d2983902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:21 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-0accb865-ee50-44e7-8031-727614b53b88 tempest-ProjectMemberTests-1154001707 None] Flow 'volume_create_manager' (9d55963d-26ce-4889-98fe-281de3de9ef7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:21 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-0accb865-ee50-44e7-8031-727614b53b88 tempest-ProjectMemberTests-1154001707 None] Created volume successfully. Nov 02 12:46:21 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eaf5c3e5-dbdc-4b15-8e4e-03843ba34ff8 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-6aec6bb0-4854-4799-8efa-c56ef2e6396f" returned: 0 in 0.294s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:21 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-eaf5c3e5-dbdc-4b15-8e4e-03843ba34ff8 tempest-ProjectReaderTests-153927055 None] Lock "cinder-quobyte-6aec6bb0-4854-4799-8efa-c56ef2e6396f" released by "delete_volume" :: held 0.779s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:21 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-eaf5c3e5-dbdc-4b15-8e4e-03843ba34ff8 tempest-ProjectReaderTests-153927055 None] Created reservations ['62ae0e77-df97-45e0-bcef-608520116e51', 'b86374cc-5f29-41a2-a7bf-c7ceaf00606b', 'c97c1bfd-57b4-4f62-95b5-7d0ffce9180a', '62f2684a-3895-4c7a-9f67-d93dc9690b53'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-eaf5c3e5-dbdc-4b15-8e4e-03843ba34ff8 tempest-ProjectReaderTests-153927055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-eaf5c3e5-dbdc-4b15-8e4e-03843ba34ff8 tempest-ProjectReaderTests-153927055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:21 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-eaf5c3e5-dbdc-4b15-8e4e-03843ba34ff8 tempest-ProjectReaderTests-153927055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:21 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-eaf5c3e5-dbdc-4b15-8e4e-03843ba34ff8 tempest-ProjectReaderTests-153927055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-eaf5c3e5-dbdc-4b15-8e4e-03843ba34ff8 tempest-ProjectReaderTests-153927055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eaf5c3e5-dbdc-4b15-8e4e-03843ba34ff8 tempest-ProjectReaderTests-153927055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:21 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:46:21 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:21 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:21 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eaf5c3e5-dbdc-4b15-8e4e-03843ba34ff8 tempest-ProjectReaderTests-153927055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.249s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:22 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-eaf5c3e5-dbdc-4b15-8e4e-03843ba34ff8 tempest-ProjectReaderTests-153927055 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:46:22 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-eaf5c3e5-dbdc-4b15-8e4e-03843ba34ff8 tempest-ProjectReaderTests-153927055 None] Deleted volume successfully. Nov 02 12:46:22 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-eaf5c3e5-dbdc-4b15-8e4e-03843ba34ff8 tempest-ProjectReaderTests-153927055 None] Lock "cinder-6aec6bb0-4854-4799-8efa-c56ef2e6396f-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-bee078ce-d8f8-4750-93a6-a718114fd17b tempest-ProjectMemberTests-1154001707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-bee078ce-d8f8-4750-93a6-a718114fd17b tempest-ProjectMemberTests-1154001707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:22 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-bee078ce-d8f8-4750-93a6-a718114fd17b tempest-ProjectMemberTests-1154001707 None] Creating offline snapshot fc052cb1-3e99-4a55-aba0-966613d37215 of volume 51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:46:22 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[4baea695-7be1-4719-b179-22b99d1cc99b]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:22 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bee078ce-d8f8-4750-93a6-a718114fd17b tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:22 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a Nov 02 12:46:22 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:23 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bee078ce-d8f8-4750-93a6-a718114fd17b tempest-ProjectMemberTests-1154001707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a" returned: 0 in 0.432s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bee078ce-d8f8-4750-93a6-a718114fd17b tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a.fc052cb1-3e99-4a55-aba0-966613d37215 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:23 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a.fc052cb1-3e99-4a55-aba0-966613d37215 1G Nov 02 12:46:23 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:23 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bee078ce-d8f8-4750-93a6-a718114fd17b tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a.fc052cb1-3e99-4a55-aba0-966613d37215 1G" returned: 0 in 0.480s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:23 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bee078ce-d8f8-4750-93a6-a718114fd17b tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a.fc052cb1-3e99-4a55-aba0-966613d37215 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:23 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a.fc052cb1-3e99-4a55-aba0-966613d37215 Nov 02 12:46:23 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:24 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bee078ce-d8f8-4750-93a6-a718114fd17b tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a.fc052cb1-3e99-4a55-aba0-966613d37215" returned: 0 in 0.293s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:24 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-bee078ce-d8f8-4750-93a6-a718114fd17b tempest-ProjectMemberTests-1154001707 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a.fc052cb1-3e99-4a55-aba0-966613d37215 is being set with open permissions: ugo+rw Nov 02 12:46:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bee078ce-d8f8-4750-93a6-a718114fd17b tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a.fc052cb1-3e99-4a55-aba0-966613d37215 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:24 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a.fc052cb1-3e99-4a55-aba0-966613d37215 Nov 02 12:46:24 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:24 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bee078ce-d8f8-4750-93a6-a718114fd17b tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a.fc052cb1-3e99-4a55-aba0-966613d37215" returned: 0 in 0.247s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bee078ce-d8f8-4750-93a6-a718114fd17b tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:24 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a.info Nov 02 12:46:24 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:24 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bee078ce-d8f8-4750-93a6-a718114fd17b tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a.info" returned: 0 in 0.309s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:24 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-bee078ce-d8f8-4750-93a6-a718114fd17b tempest-ProjectMemberTests-1154001707 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a.info is being set with open permissions: ugo+rw Nov 02 12:46:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bee078ce-d8f8-4750-93a6-a718114fd17b tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:24 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a.info Nov 02 12:46:24 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:24 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-bee078ce-d8f8-4750-93a6-a718114fd17b tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a.info" returned: 0 in 0.296s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:24 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-bee078ce-d8f8-4750-93a6-a718114fd17b tempest-ProjectMemberTests-1154001707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.150s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:24 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-bee078ce-d8f8-4750-93a6-a718114fd17b tempest-ProjectMemberTests-1154001707 None] Create snapshot completed successfully Nov 02 12:46:25 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-cbd2d575-07dd-4dad-bd7d-c8c4618a61ed tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-fc052cb1-3e99-4a55-aba0-966613d37215-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:25 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-cbd2d575-07dd-4dad-bd7d-c8c4618a61ed tempest-ProjectMemberTests-1154001707 None] Lock "cinder-fc052cb1-3e99-4a55-aba0-966613d37215-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:25 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-cbd2d575-07dd-4dad-bd7d-c8c4618a61ed tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-quobyte-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:25 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-cbd2d575-07dd-4dad-bd7d-c8c4618a61ed tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:25 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-cbd2d575-07dd-4dad-bd7d-c8c4618a61ed tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-quobyte-fc052cb1-3e99-4a55-aba0-966613d37215" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:25 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-cbd2d575-07dd-4dad-bd7d-c8c4618a61ed tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-fc052cb1-3e99-4a55-aba0-966613d37215" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:25 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-cbd2d575-07dd-4dad-bd7d-c8c4618a61ed tempest-ProjectMemberTests-1154001707 None] Deleting offline snapshot fc052cb1-3e99-4a55-aba0-966613d37215 of volume 51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:46:26 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-cbd2d575-07dd-4dad-bd7d-c8c4618a61ed tempest-ProjectMemberTests-1154001707 None] snapshot_file for this snap is: volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a.fc052cb1-3e99-4a55-aba0-966613d37215 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:46:26 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[80eaaca0-866e-46ae-8db5-9167202ad4c9]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cbd2d575-07dd-4dad-bd7d-c8c4618a61ed tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a.fc052cb1-3e99-4a55-aba0-966613d37215 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:26 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a.fc052cb1-3e99-4a55-aba0-966613d37215 Nov 02 12:46:26 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:26 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cbd2d575-07dd-4dad-bd7d-c8c4618a61ed tempest-ProjectMemberTests-1154001707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a.fc052cb1-3e99-4a55-aba0-966613d37215" returned: 0 in 0.344s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:26 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-cbd2d575-07dd-4dad-bd7d-c8c4618a61ed tempest-ProjectMemberTests-1154001707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:46:26 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ade3ed3-f0da-4208-88c8-783e053f076a]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cbd2d575-07dd-4dad-bd7d-c8c4618a61ed tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:26 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a Nov 02 12:46:26 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:26 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cbd2d575-07dd-4dad-bd7d-c8c4618a61ed tempest-ProjectMemberTests-1154001707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a" returned: 0 in 0.341s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:26 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cbd2d575-07dd-4dad-bd7d-c8c4618a61ed tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a.fc052cb1-3e99-4a55-aba0-966613d37215 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:26 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a.fc052cb1-3e99-4a55-aba0-966613d37215 Nov 02 12:46:26 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:27 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cbd2d575-07dd-4dad-bd7d-c8c4618a61ed tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a.fc052cb1-3e99-4a55-aba0-966613d37215" returned: 0 in 0.322s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cbd2d575-07dd-4dad-bd7d-c8c4618a61ed tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a.fc052cb1-3e99-4a55-aba0-966613d37215 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:27 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a.fc052cb1-3e99-4a55-aba0-966613d37215 Nov 02 12:46:27 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:27 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:27 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-cbd2d575-07dd-4dad-bd7d-c8c4618a61ed tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a.fc052cb1-3e99-4a55-aba0-966613d37215" returned: 0 in 0.255s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:27 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-cbd2d575-07dd-4dad-bd7d-c8c4618a61ed tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-fc052cb1-3e99-4a55-aba0-966613d37215" released by "_delete_snapshot" :: held 1.366s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:27 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-cbd2d575-07dd-4dad-bd7d-c8c4618a61ed tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a" released by "delete_snapshot" :: held 1.389s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:27 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-cbd2d575-07dd-4dad-bd7d-c8c4618a61ed tempest-ProjectMemberTests-1154001707 None] Created reservations ['3705f8a5-f9fd-4a6b-a288-7dc5c63ac99d', '7822419f-3b7a-47d7-8f8f-7abbdbf73e2a', '29323609-cead-436e-b4ef-f53d5cf52259', '45ad9b1d-0467-47f0-b984-d02d207b0963'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:27 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-cbd2d575-07dd-4dad-bd7d-c8c4618a61ed tempest-ProjectMemberTests-1154001707 None] Delete snapshot completed successfully. Nov 02 12:46:27 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-cbd2d575-07dd-4dad-bd7d-c8c4618a61ed tempest-ProjectMemberTests-1154001707 None] Lock "cinder-fc052cb1-3e99-4a55-aba0-966613d37215-delete_snapshot" released by "delete_snapshot" :: held 1.556s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-50a9cb30-d46d-4c25-aa46-0e2366229720 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-50a9cb30-d46d-4c25-aa46-0e2366229720 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-50a9cb30-d46d-4c25-aa46-0e2366229720 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-quobyte-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-50a9cb30-d46d-4c25-aa46-0e2366229720 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a" acquired by "delete_volume" :: waited 0.014s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:28 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc82e6f-e59c-42aa-9097-7f777f3fe777]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-50a9cb30-d46d-4c25-aa46-0e2366229720 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:28 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a Nov 02 12:46:28 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:28 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-50a9cb30-d46d-4c25-aa46-0e2366229720 tempest-ProjectMemberTests-1154001707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a" returned: 0 in 0.342s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-50a9cb30-d46d-4c25-aa46-0e2366229720 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:28 devstack sudo[107857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a Nov 02 12:46:28 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:28 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-50a9cb30-d46d-4c25-aa46-0e2366229720 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a" returned: 0 in 0.233s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:28 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-50a9cb30-d46d-4c25-aa46-0e2366229720 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a" released by "delete_volume" :: held 0.631s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:28 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-50a9cb30-d46d-4c25-aa46-0e2366229720 tempest-ProjectMemberTests-1154001707 None] Created reservations ['b08f9d70-c468-4a41-8ccb-30da2e209b6b', '41d37b9b-c99a-47de-8199-bb9655cbdd86', '739aabf0-8ddc-4c30-ac34-2e09ce8438d8', 'b8b57042-6dc0-43cb-bd46-faeca3ecca6b'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-50a9cb30-d46d-4c25-aa46-0e2366229720 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-50a9cb30-d46d-4c25-aa46-0e2366229720 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:28 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-50a9cb30-d46d-4c25-aa46-0e2366229720 tempest-ProjectMemberTests-1154001707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:28 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-50a9cb30-d46d-4c25-aa46-0e2366229720 tempest-ProjectMemberTests-1154001707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-50a9cb30-d46d-4c25-aa46-0e2366229720 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:28 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-50a9cb30-d46d-4c25-aa46-0e2366229720 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:28 devstack sudo[107860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:46:28 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:29 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-50a9cb30-d46d-4c25-aa46-0e2366229720 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.250s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:29 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-50a9cb30-d46d-4c25-aa46-0e2366229720 tempest-ProjectMemberTests-1154001707 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:46:29 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-50a9cb30-d46d-4c25-aa46-0e2366229720 tempest-ProjectMemberTests-1154001707 None] Deleted volume successfully. Nov 02 12:46:29 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-50a9cb30-d46d-4c25-aa46-0e2366229720 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-51ff7b55-b280-4c1b-8c95-8a4b0b7adf1a-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:29 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8e5cf60-6acc-4c0d-90e0-a5cb56c772aa tempest-ProjectMemberTests-1154001707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:46:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b8e5cf60-6acc-4c0d-90e0-a5cb56c772aa tempest-ProjectMemberTests-1154001707 None] Flow 'volume_create_manager' (2e8dd0c7-afac-4be4-afbc-69ddf991c2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b8e5cf60-6acc-4c0d-90e0-a5cb56c772aa tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5265f9e-b528-4dc2-a01a-362d29008b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b8e5cf60-6acc-4c0d-90e0-a5cb56c772aa tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5265f9e-b528-4dc2-a01a-362d29008b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-845966579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f748f23-f568-4969-80d8-e53912727de9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60099afac3fc4cb3b2313235ee5a57b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:30Z,use_quota=True,user_id='466fcf287769488eaa04f91080ae1f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b8e5cf60-6acc-4c0d-90e0-a5cb56c772aa tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d2d327d-0e9f-4298-a4da-f605e23d350a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b8e5cf60-6acc-4c0d-90e0-a5cb56c772aa tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d2d327d-0e9f-4298-a4da-f605e23d350a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b8e5cf60-6acc-4c0d-90e0-a5cb56c772aa tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1ec436b-6a68-4892-b613-b534c0104f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b8e5cf60-6acc-4c0d-90e0-a5cb56c772aa tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1ec436b-6a68-4892-b613-b534c0104f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f748f23-f568-4969-80d8-e53912727de9', 'volume_name': 'volume-0f748f23-f568-4969-80d8-e53912727de9', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b8e5cf60-6acc-4c0d-90e0-a5cb56c772aa tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1196762-e418-4f64-b19e-e04899a97a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b8e5cf60-6acc-4c0d-90e0-a5cb56c772aa tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1196762-e418-4f64-b19e-e04899a97a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:29 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b8e5cf60-6acc-4c0d-90e0-a5cb56c772aa tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e9793cd-b3e0-4e9b-b6b3-cf12ba40e115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:29 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-b8e5cf60-6acc-4c0d-90e0-a5cb56c772aa tempest-ProjectMemberTests-1154001707 None] Volume 0f748f23-f568-4969-80d8-e53912727de9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f748f23-f568-4969-80d8-e53912727de9', 'volume_size': 1} Nov 02 12:46:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b8e5cf60-6acc-4c0d-90e0-a5cb56c772aa tempest-ProjectMemberTests-1154001707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b8e5cf60-6acc-4c0d-90e0-a5cb56c772aa tempest-ProjectMemberTests-1154001707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:29 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b8e5cf60-6acc-4c0d-90e0-a5cb56c772aa tempest-ProjectMemberTests-1154001707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-845966579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f748f23-f568-4969-80d8-e53912727de9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60099afac3fc4cb3b2313235ee5a57b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:30Z,use_quota=True,user_id='466fcf287769488eaa04f91080ae1f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:46:29 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-b8e5cf60-6acc-4c0d-90e0-a5cb56c772aa tempest-ProjectMemberTests-1154001707 None] Creating volume 0f748f23-f568-4969-80d8-e53912727de9 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:46:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b8e5cf60-6acc-4c0d-90e0-a5cb56c772aa tempest-ProjectMemberTests-1154001707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b8e5cf60-6acc-4c0d-90e0-a5cb56c772aa tempest-ProjectMemberTests-1154001707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:29 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b8e5cf60-6acc-4c0d-90e0-a5cb56c772aa tempest-ProjectMemberTests-1154001707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:29 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b8e5cf60-6acc-4c0d-90e0-a5cb56c772aa tempest-ProjectMemberTests-1154001707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b8e5cf60-6acc-4c0d-90e0-a5cb56c772aa tempest-ProjectMemberTests-1154001707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:29 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b8e5cf60-6acc-4c0d-90e0-a5cb56c772aa tempest-ProjectMemberTests-1154001707 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:46:29 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-b8e5cf60-6acc-4c0d-90e0-a5cb56c772aa tempest-ProjectMemberTests-1154001707 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:46:29 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b8e5cf60-6acc-4c0d-90e0-a5cb56c772aa tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:29 devstack sudo[107863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9 1073741824 Nov 02 12:46:29 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:30 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b8e5cf60-6acc-4c0d-90e0-a5cb56c772aa tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9 1073741824" returned: 0 in 0.427s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b8e5cf60-6acc-4c0d-90e0-a5cb56c772aa tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:30 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9 Nov 02 12:46:30 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:30 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b8e5cf60-6acc-4c0d-90e0-a5cb56c772aa tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9" returned: 0 in 0.246s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b8e5cf60-6acc-4c0d-90e0-a5cb56c772aa tempest-ProjectMemberTests-1154001707 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:46:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b8e5cf60-6acc-4c0d-90e0-a5cb56c772aa tempest-ProjectMemberTests-1154001707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b8e5cf60-6acc-4c0d-90e0-a5cb56c772aa tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e9793cd-b3e0-4e9b-b6b3-cf12ba40e115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f748f23-f568-4969-80d8-e53912727de9', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b8e5cf60-6acc-4c0d-90e0-a5cb56c772aa tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2448f740-f9ec-46d7-a5a2-ec67cd6d15e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:30 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-b8e5cf60-6acc-4c0d-90e0-a5cb56c772aa tempest-ProjectMemberTests-1154001707 None] Volume volume-0f748f23-f568-4969-80d8-e53912727de9 (0f748f23-f568-4969-80d8-e53912727de9): created successfully Nov 02 12:46:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b8e5cf60-6acc-4c0d-90e0-a5cb56c772aa tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2448f740-f9ec-46d7-a5a2-ec67cd6d15e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:30 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b8e5cf60-6acc-4c0d-90e0-a5cb56c772aa tempest-ProjectMemberTests-1154001707 None] Flow 'volume_create_manager' (2e8dd0c7-afac-4be4-afbc-69ddf991c2c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:30 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-b8e5cf60-6acc-4c0d-90e0-a5cb56c772aa tempest-ProjectMemberTests-1154001707 None] Created volume successfully. Nov 02 12:46:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5e515dcf-55e1-464c-bee7-0e4bb684db15 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5e515dcf-55e1-464c-bee7-0e4bb684db15 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:30 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-5e515dcf-55e1-464c-bee7-0e4bb684db15 tempest-ProjectMemberTests-1154001707 None] Creating offline snapshot 76844694-3055-4640-9746-5c2b837d3db1 of volume 0f748f23-f568-4969-80d8-e53912727de9 {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:46:30 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c159b85-c820-4806-9203-0c7fe8164240]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:30 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5e515dcf-55e1-464c-bee7-0e4bb684db15 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:31 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9 Nov 02 12:46:31 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:31 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5e515dcf-55e1-464c-bee7-0e4bb684db15 tempest-ProjectMemberTests-1154001707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9" returned: 0 in 0.371s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5e515dcf-55e1-464c-bee7-0e4bb684db15 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9.76844694-3055-4640-9746-5c2b837d3db1 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:31 devstack sudo[107877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9.76844694-3055-4640-9746-5c2b837d3db1 1G Nov 02 12:46:31 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:31 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5e515dcf-55e1-464c-bee7-0e4bb684db15 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9.76844694-3055-4640-9746-5c2b837d3db1 1G" returned: 0 in 0.420s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5e515dcf-55e1-464c-bee7-0e4bb684db15 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f748f23-f568-4969-80d8-e53912727de9 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9.76844694-3055-4640-9746-5c2b837d3db1 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:31 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f748f23-f568-4969-80d8-e53912727de9 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9.76844694-3055-4640-9746-5c2b837d3db1 Nov 02 12:46:31 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:31 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5e515dcf-55e1-464c-bee7-0e4bb684db15 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f748f23-f568-4969-80d8-e53912727de9 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9.76844694-3055-4640-9746-5c2b837d3db1" returned: 0 in 0.286s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:31 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-5e515dcf-55e1-464c-bee7-0e4bb684db15 tempest-ProjectMemberTests-1154001707 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9.76844694-3055-4640-9746-5c2b837d3db1 is being set with open permissions: ugo+rw Nov 02 12:46:31 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5e515dcf-55e1-464c-bee7-0e4bb684db15 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9.76844694-3055-4640-9746-5c2b837d3db1 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:32 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9.76844694-3055-4640-9746-5c2b837d3db1 Nov 02 12:46:32 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:32 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5e515dcf-55e1-464c-bee7-0e4bb684db15 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9.76844694-3055-4640-9746-5c2b837d3db1" returned: 0 in 0.282s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5e515dcf-55e1-464c-bee7-0e4bb684db15 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:32 devstack sudo[107892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9.info Nov 02 12:46:32 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:32 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5e515dcf-55e1-464c-bee7-0e4bb684db15 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9.info" returned: 0 in 0.242s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:32 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-5e515dcf-55e1-464c-bee7-0e4bb684db15 tempest-ProjectMemberTests-1154001707 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9.info is being set with open permissions: ugo+rw Nov 02 12:46:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5e515dcf-55e1-464c-bee7-0e4bb684db15 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:32 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9.info Nov 02 12:46:32 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:32 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5e515dcf-55e1-464c-bee7-0e4bb684db15 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9.info" returned: 0 in 0.261s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:32 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5e515dcf-55e1-464c-bee7-0e4bb684db15 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.954s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:32 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-5e515dcf-55e1-464c-bee7-0e4bb684db15 tempest-ProjectMemberTests-1154001707 None] Create snapshot completed successfully Nov 02 12:46:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-56e620aa-2a98-4a7d-b859-dc7a896abbf9 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-76844694-3055-4640-9746-5c2b837d3db1-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-56e620aa-2a98-4a7d-b859-dc7a896abbf9 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-76844694-3055-4640-9746-5c2b837d3db1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-56e620aa-2a98-4a7d-b859-dc7a896abbf9 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-quobyte-0f748f23-f568-4969-80d8-e53912727de9" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-56e620aa-2a98-4a7d-b859-dc7a896abbf9 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-0f748f23-f568-4969-80d8-e53912727de9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-56e620aa-2a98-4a7d-b859-dc7a896abbf9 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-quobyte-76844694-3055-4640-9746-5c2b837d3db1" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:33 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-56e620aa-2a98-4a7d-b859-dc7a896abbf9 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-76844694-3055-4640-9746-5c2b837d3db1" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-56e620aa-2a98-4a7d-b859-dc7a896abbf9 tempest-ProjectMemberTests-1154001707 None] Deleting offline snapshot 76844694-3055-4640-9746-5c2b837d3db1 of volume 0f748f23-f568-4969-80d8-e53912727de9 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:46:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-56e620aa-2a98-4a7d-b859-dc7a896abbf9 tempest-ProjectMemberTests-1154001707 None] snapshot_file for this snap is: volume-0f748f23-f568-4969-80d8-e53912727de9.76844694-3055-4640-9746-5c2b837d3db1 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:46:33 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf5526a-3095-4914-ba6e-826aef238741]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-56e620aa-2a98-4a7d-b859-dc7a896abbf9 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9.76844694-3055-4640-9746-5c2b837d3db1 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:33 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9.76844694-3055-4640-9746-5c2b837d3db1 Nov 02 12:46:33 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:33 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-56e620aa-2a98-4a7d-b859-dc7a896abbf9 tempest-ProjectMemberTests-1154001707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9.76844694-3055-4640-9746-5c2b837d3db1" returned: 0 in 0.371s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-56e620aa-2a98-4a7d-b859-dc7a896abbf9 tempest-ProjectMemberTests-1154001707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f748f23-f568-4969-80d8-e53912727de9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:46:33 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cafd31-27e2-4cf7-9f45-ac4ccb3e5371]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-56e620aa-2a98-4a7d-b859-dc7a896abbf9 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:33 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9 Nov 02 12:46:33 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:33 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-56e620aa-2a98-4a7d-b859-dc7a896abbf9 tempest-ProjectMemberTests-1154001707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9" returned: 0 in 0.376s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-56e620aa-2a98-4a7d-b859-dc7a896abbf9 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9.76844694-3055-4640-9746-5c2b837d3db1 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:33 devstack sudo[107909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9.76844694-3055-4640-9746-5c2b837d3db1 Nov 02 12:46:33 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:34 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-56e620aa-2a98-4a7d-b859-dc7a896abbf9 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9.76844694-3055-4640-9746-5c2b837d3db1" returned: 0 in 0.343s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-56e620aa-2a98-4a7d-b859-dc7a896abbf9 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9.76844694-3055-4640-9746-5c2b837d3db1 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:34 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9.76844694-3055-4640-9746-5c2b837d3db1 Nov 02 12:46:34 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:34 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-56e620aa-2a98-4a7d-b859-dc7a896abbf9 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9.76844694-3055-4640-9746-5c2b837d3db1" returned: 0 in 0.249s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:34 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-56e620aa-2a98-4a7d-b859-dc7a896abbf9 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-76844694-3055-4640-9746-5c2b837d3db1" released by "_delete_snapshot" :: held 1.451s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:34 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-56e620aa-2a98-4a7d-b859-dc7a896abbf9 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-0f748f23-f568-4969-80d8-e53912727de9" released by "delete_snapshot" :: held 1.481s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:34 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-56e620aa-2a98-4a7d-b859-dc7a896abbf9 tempest-ProjectMemberTests-1154001707 None] Created reservations ['2de0dd0b-8ed5-46cb-9554-a6a49ad7eada', '838ded73-990f-4df8-8be7-7235bc62f941', 'c0a6e7e1-ed67-4f74-b7ea-4a88ff82bcf7', 'dfceead6-8979-4602-af17-fc7f234a3594'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:34 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-56e620aa-2a98-4a7d-b859-dc7a896abbf9 tempest-ProjectMemberTests-1154001707 None] Delete snapshot completed successfully. Nov 02 12:46:34 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-56e620aa-2a98-4a7d-b859-dc7a896abbf9 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-76844694-3055-4640-9746-5c2b837d3db1-delete_snapshot" released by "delete_snapshot" :: held 1.673s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:34 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5736177-115e-499b-91e2-ee6951543c78 tempest-ProjectReaderTests-117950554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:46:34 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b5736177-115e-499b-91e2-ee6951543c78 tempest-ProjectReaderTests-117950554 None] Flow 'volume_create_manager' (cbe60027-a7ff-4527-9f2e-9a2498f8ca25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b5736177-115e-499b-91e2-ee6951543c78 tempest-ProjectReaderTests-117950554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f45239-d409-4804-a860-788c0798f2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b5736177-115e-499b-91e2-ee6951543c78 tempest-ProjectReaderTests-117950554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f45239-d409-4804-a860-788c0798f2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1388575464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c995e1-fce2-469e-8aeb-d2e150b4f7cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f8c3fc2a744394a90a46618a55e603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:35Z,use_quota=True,user_id='8ed4f256244e41e999c60e8323d7f942',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b5736177-115e-499b-91e2-ee6951543c78 tempest-ProjectReaderTests-117950554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83dcf1f4-a19e-4d9c-9245-cdb5559628c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b5736177-115e-499b-91e2-ee6951543c78 tempest-ProjectReaderTests-117950554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83dcf1f4-a19e-4d9c-9245-cdb5559628c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b5736177-115e-499b-91e2-ee6951543c78 tempest-ProjectReaderTests-117950554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (890a8a5e-202a-40a7-bc18-927cec4f26dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b5736177-115e-499b-91e2-ee6951543c78 tempest-ProjectReaderTests-117950554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (890a8a5e-202a-40a7-bc18-927cec4f26dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8c995e1-fce2-469e-8aeb-d2e150b4f7cd', 'volume_name': 'volume-c8c995e1-fce2-469e-8aeb-d2e150b4f7cd', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b5736177-115e-499b-91e2-ee6951543c78 tempest-ProjectReaderTests-117950554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b63c2641-8a29-414a-b71a-1360858c651d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b5736177-115e-499b-91e2-ee6951543c78 tempest-ProjectReaderTests-117950554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b63c2641-8a29-414a-b71a-1360858c651d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b5736177-115e-499b-91e2-ee6951543c78 tempest-ProjectReaderTests-117950554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (523ad639-0046-49e9-b9b4-83e509fd65df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:35 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-b5736177-115e-499b-91e2-ee6951543c78 tempest-ProjectReaderTests-117950554 None] Volume c8c995e1-fce2-469e-8aeb-d2e150b4f7cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8c995e1-fce2-469e-8aeb-d2e150b4f7cd', 'volume_size': 1} Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b5736177-115e-499b-91e2-ee6951543c78 tempest-ProjectReaderTests-117950554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b5736177-115e-499b-91e2-ee6951543c78 tempest-ProjectReaderTests-117950554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b5736177-115e-499b-91e2-ee6951543c78 tempest-ProjectReaderTests-117950554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1388575464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c995e1-fce2-469e-8aeb-d2e150b4f7cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f8c3fc2a744394a90a46618a55e603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:35Z,use_quota=True,user_id='8ed4f256244e41e999c60e8323d7f942',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-b5736177-115e-499b-91e2-ee6951543c78 tempest-ProjectReaderTests-117950554 None] Creating volume c8c995e1-fce2-469e-8aeb-d2e150b4f7cd {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b5736177-115e-499b-91e2-ee6951543c78 tempest-ProjectReaderTests-117950554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b5736177-115e-499b-91e2-ee6951543c78 tempest-ProjectReaderTests-117950554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b5736177-115e-499b-91e2-ee6951543c78 tempest-ProjectReaderTests-117950554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b5736177-115e-499b-91e2-ee6951543c78 tempest-ProjectReaderTests-117950554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b5736177-115e-499b-91e2-ee6951543c78 tempest-ProjectReaderTests-117950554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b5736177-115e-499b-91e2-ee6951543c78 tempest-ProjectReaderTests-117950554 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:46:35 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-b5736177-115e-499b-91e2-ee6951543c78 tempest-ProjectReaderTests-117950554 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b5736177-115e-499b-91e2-ee6951543c78 tempest-ProjectReaderTests-117950554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c8c995e1-fce2-469e-8aeb-d2e150b4f7cd 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:35 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c8c995e1-fce2-469e-8aeb-d2e150b4f7cd 1073741824 Nov 02 12:46:35 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8aec2c3f-de52-4db9-a2b1-899334f4b648 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-0f748f23-f568-4969-80d8-e53912727de9-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8aec2c3f-de52-4db9-a2b1-899334f4b648 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-0f748f23-f568-4969-80d8-e53912727de9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8aec2c3f-de52-4db9-a2b1-899334f4b648 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-quobyte-0f748f23-f568-4969-80d8-e53912727de9" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8aec2c3f-de52-4db9-a2b1-899334f4b648 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-0f748f23-f568-4969-80d8-e53912727de9" acquired by "delete_volume" :: waited 0.014s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[901ae894-ea8a-4c51-b22d-0c855684aaae]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8aec2c3f-de52-4db9-a2b1-899334f4b648 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:35 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9 Nov 02 12:46:35 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:35 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b5736177-115e-499b-91e2-ee6951543c78 tempest-ProjectReaderTests-117950554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c8c995e1-fce2-469e-8aeb-d2e150b4f7cd 1073741824" returned: 0 in 0.459s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b5736177-115e-499b-91e2-ee6951543c78 tempest-ProjectReaderTests-117950554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c8c995e1-fce2-469e-8aeb-d2e150b4f7cd {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:35 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c8c995e1-fce2-469e-8aeb-d2e150b4f7cd Nov 02 12:46:35 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:35 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8aec2c3f-de52-4db9-a2b1-899334f4b648 tempest-ProjectMemberTests-1154001707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9" returned: 0 in 0.390s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8aec2c3f-de52-4db9-a2b1-899334f4b648 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:35 devstack sudo[107930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9 Nov 02 12:46:35 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:35 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b5736177-115e-499b-91e2-ee6951543c78 tempest-ProjectReaderTests-117950554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c8c995e1-fce2-469e-8aeb-d2e150b4f7cd" returned: 0 in 0.268s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b5736177-115e-499b-91e2-ee6951543c78 tempest-ProjectReaderTests-117950554 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b5736177-115e-499b-91e2-ee6951543c78 tempest-ProjectReaderTests-117950554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b5736177-115e-499b-91e2-ee6951543c78 tempest-ProjectReaderTests-117950554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (523ad639-0046-49e9-b9b4-83e509fd65df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8c995e1-fce2-469e-8aeb-d2e150b4f7cd', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b5736177-115e-499b-91e2-ee6951543c78 tempest-ProjectReaderTests-117950554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaa400e5-7943-40de-92d5-19e25ec0751d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:35 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-b5736177-115e-499b-91e2-ee6951543c78 tempest-ProjectReaderTests-117950554 None] Volume volume-c8c995e1-fce2-469e-8aeb-d2e150b4f7cd (c8c995e1-fce2-469e-8aeb-d2e150b4f7cd): created successfully Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b5736177-115e-499b-91e2-ee6951543c78 tempest-ProjectReaderTests-117950554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaa400e5-7943-40de-92d5-19e25ec0751d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-b5736177-115e-499b-91e2-ee6951543c78 tempest-ProjectReaderTests-117950554 None] Flow 'volume_create_manager' (cbe60027-a7ff-4527-9f2e-9a2498f8ca25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:35 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-b5736177-115e-499b-91e2-ee6951543c78 tempest-ProjectReaderTests-117950554 None] Created volume successfully. Nov 02 12:46:35 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8aec2c3f-de52-4db9-a2b1-899334f4b648 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-0f748f23-f568-4969-80d8-e53912727de9" returned: 0 in 0.281s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8aec2c3f-de52-4db9-a2b1-899334f4b648 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-0f748f23-f568-4969-80d8-e53912727de9" released by "delete_volume" :: held 0.741s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-8aec2c3f-de52-4db9-a2b1-899334f4b648 tempest-ProjectMemberTests-1154001707 None] Created reservations ['6a905e6c-b5c5-40be-b1d5-dc27c55d4d3c', '6375f6c8-5289-4b5e-9589-1408b18d5f35', '72cafa1e-22a1-404c-8d00-393a64ce8bac', 'f1010d02-7263-40f1-ab28-7962dc33a68c'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8aec2c3f-de52-4db9-a2b1-899334f4b648 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8aec2c3f-de52-4db9-a2b1-899334f4b648 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8aec2c3f-de52-4db9-a2b1-899334f4b648 tempest-ProjectMemberTests-1154001707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8aec2c3f-de52-4db9-a2b1-899334f4b648 tempest-ProjectMemberTests-1154001707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8aec2c3f-de52-4db9-a2b1-899334f4b648 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8aec2c3f-de52-4db9-a2b1-899334f4b648 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:36 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:46:36 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e5a32cc7-9145-4181-89a0-ac08752009bb tempest-ProjectReaderTests-117950554 None] Acquiring lock "cinder-c8c995e1-fce2-469e-8aeb-d2e150b4f7cd-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e5a32cc7-9145-4181-89a0-ac08752009bb tempest-ProjectReaderTests-117950554 None] Lock "cinder-c8c995e1-fce2-469e-8aeb-d2e150b4f7cd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e5a32cc7-9145-4181-89a0-ac08752009bb tempest-ProjectReaderTests-117950554 None] Acquiring lock "cinder-quobyte-c8c995e1-fce2-469e-8aeb-d2e150b4f7cd" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e5a32cc7-9145-4181-89a0-ac08752009bb tempest-ProjectReaderTests-117950554 None] Lock "cinder-quobyte-c8c995e1-fce2-469e-8aeb-d2e150b4f7cd" acquired by "delete_volume" :: waited 0.018s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ee279b-49b3-435d-a5c6-6a15278e0f05]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e5a32cc7-9145-4181-89a0-ac08752009bb tempest-ProjectReaderTests-117950554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c8c995e1-fce2-469e-8aeb-d2e150b4f7cd {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:36 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8aec2c3f-de52-4db9-a2b1-899334f4b648 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.294s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-8aec2c3f-de52-4db9-a2b1-899334f4b648 tempest-ProjectMemberTests-1154001707 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:46:36 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-8aec2c3f-de52-4db9-a2b1-899334f4b648 tempest-ProjectMemberTests-1154001707 None] Deleted volume successfully. Nov 02 12:46:36 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c8c995e1-fce2-469e-8aeb-d2e150b4f7cd Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-8aec2c3f-de52-4db9-a2b1-899334f4b648 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-0f748f23-f568-4969-80d8-e53912727de9-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:36 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:36 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e5a32cc7-9145-4181-89a0-ac08752009bb tempest-ProjectReaderTests-117950554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c8c995e1-fce2-469e-8aeb-d2e150b4f7cd" returned: 0 in 0.419s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e5a32cc7-9145-4181-89a0-ac08752009bb tempest-ProjectReaderTests-117950554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c8c995e1-fce2-469e-8aeb-d2e150b4f7cd {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:36 devstack sudo[107942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c8c995e1-fce2-469e-8aeb-d2e150b4f7cd Nov 02 12:46:36 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-1004c5d0-2d23-425b-9e10-a5939691025e tempest-ProjectMemberTests-1154001707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1004c5d0-2d23-425b-9e10-a5939691025e tempest-ProjectMemberTests-1154001707 None] Flow 'volume_create_manager' (c9c21c24-b24b-4625-b33a-5c745ca5de1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1004c5d0-2d23-425b-9e10-a5939691025e tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04f80cd1-8154-436a-a7a4-3440f4778741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1004c5d0-2d23-425b-9e10-a5939691025e tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04f80cd1-8154-436a-a7a4-3440f4778741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1070538405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d203753-240e-4c45-9dba-a0a176bdf508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60099afac3fc4cb3b2313235ee5a57b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:37Z,use_quota=True,user_id='466fcf287769488eaa04f91080ae1f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1004c5d0-2d23-425b-9e10-a5939691025e tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3fcfc0-6626-4427-a182-9d653765c305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1004c5d0-2d23-425b-9e10-a5939691025e tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3fcfc0-6626-4427-a182-9d653765c305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1004c5d0-2d23-425b-9e10-a5939691025e tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330441ba-1132-430a-b429-2da452f8cf44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1004c5d0-2d23-425b-9e10-a5939691025e tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330441ba-1132-430a-b429-2da452f8cf44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d203753-240e-4c45-9dba-a0a176bdf508', 'volume_name': 'volume-3d203753-240e-4c45-9dba-a0a176bdf508', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1004c5d0-2d23-425b-9e10-a5939691025e tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21e11ea7-6a13-484a-b07b-bb3418c42efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1004c5d0-2d23-425b-9e10-a5939691025e tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21e11ea7-6a13-484a-b07b-bb3418c42efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1004c5d0-2d23-425b-9e10-a5939691025e tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21a485a-2566-46d1-bac7-154ff718d752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:36 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-1004c5d0-2d23-425b-9e10-a5939691025e tempest-ProjectMemberTests-1154001707 None] Volume 3d203753-240e-4c45-9dba-a0a176bdf508: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d203753-240e-4c45-9dba-a0a176bdf508', 'volume_size': 1} Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1004c5d0-2d23-425b-9e10-a5939691025e tempest-ProjectMemberTests-1154001707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1004c5d0-2d23-425b-9e10-a5939691025e tempest-ProjectMemberTests-1154001707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-1004c5d0-2d23-425b-9e10-a5939691025e tempest-ProjectMemberTests-1154001707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1070538405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d203753-240e-4c45-9dba-a0a176bdf508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60099afac3fc4cb3b2313235ee5a57b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:37Z,use_quota=True,user_id='466fcf287769488eaa04f91080ae1f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-1004c5d0-2d23-425b-9e10-a5939691025e tempest-ProjectMemberTests-1154001707 None] Creating volume 3d203753-240e-4c45-9dba-a0a176bdf508 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1004c5d0-2d23-425b-9e10-a5939691025e tempest-ProjectMemberTests-1154001707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1004c5d0-2d23-425b-9e10-a5939691025e tempest-ProjectMemberTests-1154001707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-1004c5d0-2d23-425b-9e10-a5939691025e tempest-ProjectMemberTests-1154001707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-1004c5d0-2d23-425b-9e10-a5939691025e tempest-ProjectMemberTests-1154001707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1004c5d0-2d23-425b-9e10-a5939691025e tempest-ProjectMemberTests-1154001707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-1004c5d0-2d23-425b-9e10-a5939691025e tempest-ProjectMemberTests-1154001707 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:46:36 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-1004c5d0-2d23-425b-9e10-a5939691025e tempest-ProjectMemberTests-1154001707 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:46:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1004c5d0-2d23-425b-9e10-a5939691025e tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:37 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e5a32cc7-9145-4181-89a0-ac08752009bb tempest-ProjectReaderTests-117950554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-c8c995e1-fce2-469e-8aeb-d2e150b4f7cd" returned: 0 in 0.251s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:37 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508 1073741824 Nov 02 12:46:37 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e5a32cc7-9145-4181-89a0-ac08752009bb tempest-ProjectReaderTests-117950554 None] Lock "cinder-quobyte-c8c995e1-fce2-469e-8aeb-d2e150b4f7cd" released by "delete_volume" :: held 0.719s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-e5a32cc7-9145-4181-89a0-ac08752009bb tempest-ProjectReaderTests-117950554 None] Created reservations ['97728fbb-cff8-4701-ac47-f6cf4724c004', 'e4330506-d059-4c7c-8c4f-5c14c3d13708', 'ef6d13e9-76c8-4a73-bbb3-7c31c6348f33', '671e8b8e-ffba-4d35-a2c4-4012a89aec53'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e5a32cc7-9145-4181-89a0-ac08752009bb tempest-ProjectReaderTests-117950554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e5a32cc7-9145-4181-89a0-ac08752009bb tempest-ProjectReaderTests-117950554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e5a32cc7-9145-4181-89a0-ac08752009bb tempest-ProjectReaderTests-117950554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-e5a32cc7-9145-4181-89a0-ac08752009bb tempest-ProjectReaderTests-117950554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e5a32cc7-9145-4181-89a0-ac08752009bb tempest-ProjectReaderTests-117950554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e5a32cc7-9145-4181-89a0-ac08752009bb tempest-ProjectReaderTests-117950554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:37 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:46:37 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:37 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:37 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e5a32cc7-9145-4181-89a0-ac08752009bb tempest-ProjectReaderTests-117950554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.271s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1004c5d0-2d23-425b-9e10-a5939691025e tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508 1073741824" returned: 0 in 0.479s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-e5a32cc7-9145-4181-89a0-ac08752009bb tempest-ProjectReaderTests-117950554 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:46:37 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-e5a32cc7-9145-4181-89a0-ac08752009bb tempest-ProjectReaderTests-117950554 None] Deleted volume successfully. Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-e5a32cc7-9145-4181-89a0-ac08752009bb tempest-ProjectReaderTests-117950554 None] Lock "cinder-c8c995e1-fce2-469e-8aeb-d2e150b4f7cd-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1004c5d0-2d23-425b-9e10-a5939691025e tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:37 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508 Nov 02 12:46:37 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:37 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-1004c5d0-2d23-425b-9e10-a5939691025e tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508" returned: 0 in 0.317s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-1004c5d0-2d23-425b-9e10-a5939691025e tempest-ProjectMemberTests-1154001707 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-1004c5d0-2d23-425b-9e10-a5939691025e tempest-ProjectMemberTests-1154001707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1004c5d0-2d23-425b-9e10-a5939691025e tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21a485a-2566-46d1-bac7-154ff718d752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d203753-240e-4c45-9dba-a0a176bdf508', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1004c5d0-2d23-425b-9e10-a5939691025e tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f961db-f020-4316-944e-55b8e9e16b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:37 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-1004c5d0-2d23-425b-9e10-a5939691025e tempest-ProjectMemberTests-1154001707 None] Volume volume-3d203753-240e-4c45-9dba-a0a176bdf508 (3d203753-240e-4c45-9dba-a0a176bdf508): created successfully Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1004c5d0-2d23-425b-9e10-a5939691025e tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f961db-f020-4316-944e-55b8e9e16b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-1004c5d0-2d23-425b-9e10-a5939691025e tempest-ProjectMemberTests-1154001707 None] Flow 'volume_create_manager' (c9c21c24-b24b-4625-b33a-5c745ca5de1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe04b838-c5b7-49b9-8c8e-dea28abba0da tempest-ProjectReaderTests-117950554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fe04b838-c5b7-49b9-8c8e-dea28abba0da tempest-ProjectReaderTests-117950554 None] Flow 'volume_create_manager' (f78a9a24-7348-416d-961a-cf6ca15444ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fe04b838-c5b7-49b9-8c8e-dea28abba0da tempest-ProjectReaderTests-117950554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1db7ff-f0aa-4dff-9e79-c8bdfce8353f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:37 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-1004c5d0-2d23-425b-9e10-a5939691025e tempest-ProjectMemberTests-1154001707 None] Created volume successfully. Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fe04b838-c5b7-49b9-8c8e-dea28abba0da tempest-ProjectReaderTests-117950554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1db7ff-f0aa-4dff-9e79-c8bdfce8353f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-913768476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b21e99cf-ffc4-450f-b832-5ed008a6c3d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f8c3fc2a744394a90a46618a55e603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:38Z,use_quota=True,user_id='8ed4f256244e41e999c60e8323d7f942',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fe04b838-c5b7-49b9-8c8e-dea28abba0da tempest-ProjectReaderTests-117950554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fbc38d3-9643-4e1a-bef1-67834ed0ef71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fe04b838-c5b7-49b9-8c8e-dea28abba0da tempest-ProjectReaderTests-117950554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fbc38d3-9643-4e1a-bef1-67834ed0ef71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fe04b838-c5b7-49b9-8c8e-dea28abba0da tempest-ProjectReaderTests-117950554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a305bb05-7172-4bf1-aa40-06b2423d37c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fe04b838-c5b7-49b9-8c8e-dea28abba0da tempest-ProjectReaderTests-117950554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a305bb05-7172-4bf1-aa40-06b2423d37c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b21e99cf-ffc4-450f-b832-5ed008a6c3d7', 'volume_name': 'volume-b21e99cf-ffc4-450f-b832-5ed008a6c3d7', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fe04b838-c5b7-49b9-8c8e-dea28abba0da tempest-ProjectReaderTests-117950554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c53d35-8e84-49ee-a418-2fa77ade0f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fe04b838-c5b7-49b9-8c8e-dea28abba0da tempest-ProjectReaderTests-117950554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c53d35-8e84-49ee-a418-2fa77ade0f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fe04b838-c5b7-49b9-8c8e-dea28abba0da tempest-ProjectReaderTests-117950554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e11bb59-58d7-44c2-aa48-ed5b15457791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:37 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-fe04b838-c5b7-49b9-8c8e-dea28abba0da tempest-ProjectReaderTests-117950554 None] Volume b21e99cf-ffc4-450f-b832-5ed008a6c3d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b21e99cf-ffc4-450f-b832-5ed008a6c3d7', 'volume_size': 1} Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fe04b838-c5b7-49b9-8c8e-dea28abba0da tempest-ProjectReaderTests-117950554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fe04b838-c5b7-49b9-8c8e-dea28abba0da tempest-ProjectReaderTests-117950554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-fe04b838-c5b7-49b9-8c8e-dea28abba0da tempest-ProjectReaderTests-117950554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-913768476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b21e99cf-ffc4-450f-b832-5ed008a6c3d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5f8c3fc2a744394a90a46618a55e603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:38Z,use_quota=True,user_id='8ed4f256244e41e999c60e8323d7f942',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-fe04b838-c5b7-49b9-8c8e-dea28abba0da tempest-ProjectReaderTests-117950554 None] Creating volume b21e99cf-ffc4-450f-b832-5ed008a6c3d7 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fe04b838-c5b7-49b9-8c8e-dea28abba0da tempest-ProjectReaderTests-117950554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fe04b838-c5b7-49b9-8c8e-dea28abba0da tempest-ProjectReaderTests-117950554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-fe04b838-c5b7-49b9-8c8e-dea28abba0da tempest-ProjectReaderTests-117950554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-fe04b838-c5b7-49b9-8c8e-dea28abba0da tempest-ProjectReaderTests-117950554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fe04b838-c5b7-49b9-8c8e-dea28abba0da tempest-ProjectReaderTests-117950554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-fe04b838-c5b7-49b9-8c8e-dea28abba0da tempest-ProjectReaderTests-117950554 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:46:37 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-fe04b838-c5b7-49b9-8c8e-dea28abba0da tempest-ProjectReaderTests-117950554 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:46:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fe04b838-c5b7-49b9-8c8e-dea28abba0da tempest-ProjectReaderTests-117950554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-b21e99cf-ffc4-450f-b832-5ed008a6c3d7 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:38 devstack sudo[107956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-b21e99cf-ffc4-450f-b832-5ed008a6c3d7 1073741824 Nov 02 12:46:38 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:38 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fe04b838-c5b7-49b9-8c8e-dea28abba0da tempest-ProjectReaderTests-117950554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-b21e99cf-ffc4-450f-b832-5ed008a6c3d7 1073741824" returned: 0 in 0.457s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fe04b838-c5b7-49b9-8c8e-dea28abba0da tempest-ProjectReaderTests-117950554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-b21e99cf-ffc4-450f-b832-5ed008a6c3d7 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:38 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-b21e99cf-ffc4-450f-b832-5ed008a6c3d7 Nov 02 12:46:38 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:38 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fe04b838-c5b7-49b9-8c8e-dea28abba0da tempest-ProjectReaderTests-117950554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-b21e99cf-ffc4-450f-b832-5ed008a6c3d7" returned: 0 in 0.262s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:38 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-fe04b838-c5b7-49b9-8c8e-dea28abba0da tempest-ProjectReaderTests-117950554 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:46:38 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fe04b838-c5b7-49b9-8c8e-dea28abba0da tempest-ProjectReaderTests-117950554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:38 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fe04b838-c5b7-49b9-8c8e-dea28abba0da tempest-ProjectReaderTests-117950554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e11bb59-58d7-44c2-aa48-ed5b15457791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b21e99cf-ffc4-450f-b832-5ed008a6c3d7', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:38 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fe04b838-c5b7-49b9-8c8e-dea28abba0da tempest-ProjectReaderTests-117950554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba67d675-829b-48e8-95f0-052a4cdafa7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:38 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-fe04b838-c5b7-49b9-8c8e-dea28abba0da tempest-ProjectReaderTests-117950554 None] Volume volume-b21e99cf-ffc4-450f-b832-5ed008a6c3d7 (b21e99cf-ffc4-450f-b832-5ed008a6c3d7): created successfully Nov 02 12:46:38 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fe04b838-c5b7-49b9-8c8e-dea28abba0da tempest-ProjectReaderTests-117950554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba67d675-829b-48e8-95f0-052a4cdafa7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:38 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-fe04b838-c5b7-49b9-8c8e-dea28abba0da tempest-ProjectReaderTests-117950554 None] Flow 'volume_create_manager' (f78a9a24-7348-416d-961a-cf6ca15444ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:38 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-fe04b838-c5b7-49b9-8c8e-dea28abba0da tempest-ProjectReaderTests-117950554 None] Created volume successfully. Nov 02 12:46:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-dd4b46b9-33eb-4fc6-8496-24e9af9c5341 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-dd4b46b9-33eb-4fc6-8496-24e9af9c5341 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:39 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-dd4b46b9-33eb-4fc6-8496-24e9af9c5341 tempest-ProjectMemberTests-1154001707 None] Creating offline snapshot 4d8143c4-1f28-48b6-821a-214411b5419a of volume 3d203753-240e-4c45-9dba-a0a176bdf508 {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:46:39 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fe11eb-b4df-4ded-aa94-6f9f54f72f39]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-dd4b46b9-33eb-4fc6-8496-24e9af9c5341 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:39 devstack sudo[107965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508 Nov 02 12:46:39 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:39 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-dd4b46b9-33eb-4fc6-8496-24e9af9c5341 tempest-ProjectMemberTests-1154001707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508" returned: 0 in 0.348s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-dd4b46b9-33eb-4fc6-8496-24e9af9c5341 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508.4d8143c4-1f28-48b6-821a-214411b5419a 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:39 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508.4d8143c4-1f28-48b6-821a-214411b5419a 1G Nov 02 12:46:39 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:39 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-dd4b46b9-33eb-4fc6-8496-24e9af9c5341 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508.4d8143c4-1f28-48b6-821a-214411b5419a 1G" returned: 0 in 0.385s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:39 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-dd4b46b9-33eb-4fc6-8496-24e9af9c5341 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d203753-240e-4c45-9dba-a0a176bdf508 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508.4d8143c4-1f28-48b6-821a-214411b5419a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:39 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d203753-240e-4c45-9dba-a0a176bdf508 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508.4d8143c4-1f28-48b6-821a-214411b5419a Nov 02 12:46:39 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:39 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5f1fa479-8159-41bb-b120-41595c68973c tempest-ProjectReaderTests-117950554 None] Acquiring lock "cinder-b21e99cf-ffc4-450f-b832-5ed008a6c3d7-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:40 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5f1fa479-8159-41bb-b120-41595c68973c tempest-ProjectReaderTests-117950554 None] Lock "cinder-b21e99cf-ffc4-450f-b832-5ed008a6c3d7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:40 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5f1fa479-8159-41bb-b120-41595c68973c tempest-ProjectReaderTests-117950554 None] Acquiring lock "cinder-quobyte-b21e99cf-ffc4-450f-b832-5ed008a6c3d7" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:40 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5f1fa479-8159-41bb-b120-41595c68973c tempest-ProjectReaderTests-117950554 None] Lock "cinder-quobyte-b21e99cf-ffc4-450f-b832-5ed008a6c3d7" acquired by "delete_volume" :: waited 0.021s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:40 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d810dd1b-b881-4b17-8f60-32405ea55e82]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5f1fa479-8159-41bb-b120-41595c68973c tempest-ProjectReaderTests-117950554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-b21e99cf-ffc4-450f-b832-5ed008a6c3d7 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:40 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-dd4b46b9-33eb-4fc6-8496-24e9af9c5341 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d203753-240e-4c45-9dba-a0a176bdf508 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508.4d8143c4-1f28-48b6-821a-214411b5419a" returned: 0 in 0.307s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:40 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-dd4b46b9-33eb-4fc6-8496-24e9af9c5341 tempest-ProjectMemberTests-1154001707 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508.4d8143c4-1f28-48b6-821a-214411b5419a is being set with open permissions: ugo+rw Nov 02 12:46:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-dd4b46b9-33eb-4fc6-8496-24e9af9c5341 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508.4d8143c4-1f28-48b6-821a-214411b5419a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:40 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508.4d8143c4-1f28-48b6-821a-214411b5419a Nov 02 12:46:40 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:40 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-b21e99cf-ffc4-450f-b832-5ed008a6c3d7 Nov 02 12:46:40 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:40 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-dd4b46b9-33eb-4fc6-8496-24e9af9c5341 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508.4d8143c4-1f28-48b6-821a-214411b5419a" returned: 0 in 0.236s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-dd4b46b9-33eb-4fc6-8496-24e9af9c5341 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:40 devstack sudo[107987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508.info Nov 02 12:46:40 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:40 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5f1fa479-8159-41bb-b120-41595c68973c tempest-ProjectReaderTests-117950554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-b21e99cf-ffc4-450f-b832-5ed008a6c3d7" returned: 0 in 0.379s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5f1fa479-8159-41bb-b120-41595c68973c tempest-ProjectReaderTests-117950554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-b21e99cf-ffc4-450f-b832-5ed008a6c3d7 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:40 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-b21e99cf-ffc4-450f-b832-5ed008a6c3d7 Nov 02 12:46:40 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:40 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-dd4b46b9-33eb-4fc6-8496-24e9af9c5341 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508.info" returned: 0 in 0.257s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:40 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-dd4b46b9-33eb-4fc6-8496-24e9af9c5341 tempest-ProjectMemberTests-1154001707 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508.info is being set with open permissions: ugo+rw Nov 02 12:46:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-dd4b46b9-33eb-4fc6-8496-24e9af9c5341 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:40 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508.info Nov 02 12:46:40 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:40 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5f1fa479-8159-41bb-b120-41595c68973c tempest-ProjectReaderTests-117950554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-b21e99cf-ffc4-450f-b832-5ed008a6c3d7" returned: 0 in 0.254s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:40 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5f1fa479-8159-41bb-b120-41595c68973c tempest-ProjectReaderTests-117950554 None] Lock "cinder-quobyte-b21e99cf-ffc4-450f-b832-5ed008a6c3d7" released by "delete_volume" :: held 0.681s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:40 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-5f1fa479-8159-41bb-b120-41595c68973c tempest-ProjectReaderTests-117950554 None] Created reservations ['4f10347a-b3ee-4e8a-891e-8d3c972d9414', 'a35b0d02-9178-4c89-86b6-bd79a502bb56', '78b686f9-b9a3-4c82-946f-c8dda93fa52e', '1ca20c0d-1e6a-452a-85a0-76987b6c4aaa'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5f1fa479-8159-41bb-b120-41595c68973c tempest-ProjectReaderTests-117950554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5f1fa479-8159-41bb-b120-41595c68973c tempest-ProjectReaderTests-117950554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:40 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5f1fa479-8159-41bb-b120-41595c68973c tempest-ProjectReaderTests-117950554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:40 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-5f1fa479-8159-41bb-b120-41595c68973c tempest-ProjectReaderTests-117950554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-5f1fa479-8159-41bb-b120-41595c68973c tempest-ProjectReaderTests-117950554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5f1fa479-8159-41bb-b120-41595c68973c tempest-ProjectReaderTests-117950554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:40 devstack sudo[107997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:46:40 devstack sudo[107997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:40 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-dd4b46b9-33eb-4fc6-8496-24e9af9c5341 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508.info" returned: 0 in 0.257s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:40 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-dd4b46b9-33eb-4fc6-8496-24e9af9c5341 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.882s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:40 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-dd4b46b9-33eb-4fc6-8496-24e9af9c5341 tempest-ProjectMemberTests-1154001707 None] Create snapshot completed successfully Nov 02 12:46:41 devstack sudo[107997]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-5f1fa479-8159-41bb-b120-41595c68973c tempest-ProjectReaderTests-117950554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.301s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:41 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-5f1fa479-8159-41bb-b120-41595c68973c tempest-ProjectReaderTests-117950554 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:46:41 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-5f1fa479-8159-41bb-b120-41595c68973c tempest-ProjectReaderTests-117950554 None] Deleted volume successfully. Nov 02 12:46:41 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-5f1fa479-8159-41bb-b120-41595c68973c tempest-ProjectReaderTests-117950554 None] Lock "cinder-b21e99cf-ffc4-450f-b832-5ed008a6c3d7-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:41 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f0bae443-fe53-4527-b919-41d2c900bea5 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-4d8143c4-1f28-48b6-821a-214411b5419a-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:41 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f0bae443-fe53-4527-b919-41d2c900bea5 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-4d8143c4-1f28-48b6-821a-214411b5419a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:41 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f0bae443-fe53-4527-b919-41d2c900bea5 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-quobyte-3d203753-240e-4c45-9dba-a0a176bdf508" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:41 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f0bae443-fe53-4527-b919-41d2c900bea5 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-3d203753-240e-4c45-9dba-a0a176bdf508" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:41 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f0bae443-fe53-4527-b919-41d2c900bea5 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-quobyte-4d8143c4-1f28-48b6-821a-214411b5419a" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:41 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f0bae443-fe53-4527-b919-41d2c900bea5 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-4d8143c4-1f28-48b6-821a-214411b5419a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:41 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-f0bae443-fe53-4527-b919-41d2c900bea5 tempest-ProjectMemberTests-1154001707 None] Deleting offline snapshot 4d8143c4-1f28-48b6-821a-214411b5419a of volume 3d203753-240e-4c45-9dba-a0a176bdf508 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:46:41 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-f0bae443-fe53-4527-b919-41d2c900bea5 tempest-ProjectMemberTests-1154001707 None] snapshot_file for this snap is: volume-3d203753-240e-4c45-9dba-a0a176bdf508.4d8143c4-1f28-48b6-821a-214411b5419a {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:46:41 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc75ad5-a119-476e-b1eb-92f63e3ef32f]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f0bae443-fe53-4527-b919-41d2c900bea5 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508.4d8143c4-1f28-48b6-821a-214411b5419a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:41 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508.4d8143c4-1f28-48b6-821a-214411b5419a Nov 02 12:46:41 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:41 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f0bae443-fe53-4527-b919-41d2c900bea5 tempest-ProjectMemberTests-1154001707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508.4d8143c4-1f28-48b6-821a-214411b5419a" returned: 0 in 0.372s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:41 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-f0bae443-fe53-4527-b919-41d2c900bea5 tempest-ProjectMemberTests-1154001707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d203753-240e-4c45-9dba-a0a176bdf508(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:46:41 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b648de-a014-4038-89ef-06c64502d79f]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:41 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f0bae443-fe53-4527-b919-41d2c900bea5 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:41 devstack sudo[108007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508 Nov 02 12:46:41 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:42 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f0bae443-fe53-4527-b919-41d2c900bea5 tempest-ProjectMemberTests-1154001707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508" returned: 0 in 0.380s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f0bae443-fe53-4527-b919-41d2c900bea5 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508.4d8143c4-1f28-48b6-821a-214411b5419a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:42 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508.4d8143c4-1f28-48b6-821a-214411b5419a Nov 02 12:46:42 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:42 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f0bae443-fe53-4527-b919-41d2c900bea5 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508.4d8143c4-1f28-48b6-821a-214411b5419a" returned: 0 in 0.341s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f0bae443-fe53-4527-b919-41d2c900bea5 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508.4d8143c4-1f28-48b6-821a-214411b5419a {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:42 devstack sudo[108018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508.4d8143c4-1f28-48b6-821a-214411b5419a Nov 02 12:46:42 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:42 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:42 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f0bae443-fe53-4527-b919-41d2c900bea5 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508.4d8143c4-1f28-48b6-821a-214411b5419a" returned: 0 in 0.297s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:42 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f0bae443-fe53-4527-b919-41d2c900bea5 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-4d8143c4-1f28-48b6-821a-214411b5419a" released by "_delete_snapshot" :: held 1.490s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:42 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f0bae443-fe53-4527-b919-41d2c900bea5 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-3d203753-240e-4c45-9dba-a0a176bdf508" released by "delete_snapshot" :: held 1.515s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:42 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-f0bae443-fe53-4527-b919-41d2c900bea5 tempest-ProjectMemberTests-1154001707 None] Created reservations ['b7c3d39b-d98d-4a24-a2f2-426efe79a886', '8a3eb3a5-ddf7-4378-a6dd-de13f52f3f2d', '44eab4b1-01df-4c50-86d1-7439dc03a03b', '537e760a-3ca7-4087-aea3-77499fcbadf0'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:42 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-f0bae443-fe53-4527-b919-41d2c900bea5 tempest-ProjectMemberTests-1154001707 None] Delete snapshot completed successfully. Nov 02 12:46:42 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f0bae443-fe53-4527-b919-41d2c900bea5 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-4d8143c4-1f28-48b6-821a-214411b5419a-delete_snapshot" released by "delete_snapshot" :: held 1.662s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:43 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b3412008-863e-4846-8db8-9522257a9314 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-3d203753-240e-4c45-9dba-a0a176bdf508-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:43 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b3412008-863e-4846-8db8-9522257a9314 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-3d203753-240e-4c45-9dba-a0a176bdf508-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:43 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b3412008-863e-4846-8db8-9522257a9314 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-quobyte-3d203753-240e-4c45-9dba-a0a176bdf508" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:43 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b3412008-863e-4846-8db8-9522257a9314 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-3d203753-240e-4c45-9dba-a0a176bdf508" acquired by "delete_volume" :: waited 0.020s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:43 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e225174-feea-41dd-a561-e24f350ddacc]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b3412008-863e-4846-8db8-9522257a9314 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:43 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508 Nov 02 12:46:43 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:43 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:43 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:46:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b3412008-863e-4846-8db8-9522257a9314 tempest-ProjectMemberTests-1154001707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508" returned: 0 in 0.380s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b3412008-863e-4846-8db8-9522257a9314 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:43 devstack sudo[108028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:46:43 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:43 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508 Nov 02 12:46:43 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:44 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.276s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:44 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:46:44 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager._thread_info {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:46:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread count: 28 {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:46:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread info: [<_MainThread(MainThread, started 129944084402304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:46:44 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b3412008-863e-4846-8db8-9522257a9314 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-3d203753-240e-4c45-9dba-a0a176bdf508" returned: 0 in 0.277s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:44 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b3412008-863e-4846-8db8-9522257a9314 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-3d203753-240e-4c45-9dba-a0a176bdf508" released by "delete_volume" :: held 0.725s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:44 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=212,cinder:UPDATE=270,cinder:INSERT=74,cinder:DELETE=25 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:46:44 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=198,cinder:DELETE=21,cinder:UPDATE=272,cinder:INSERT=70 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:46:44 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-b3412008-863e-4846-8db8-9522257a9314 tempest-ProjectMemberTests-1154001707 None] Created reservations ['6f880d43-ce0d-4a65-8e39-11a60e4cff3b', '2053039b-ad64-4558-92de-45f15c6a79a6', '66e2274c-874e-4761-8885-b0228b3585af', '597efd8b-e2a3-4c85-81bf-373727c63e66'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b3412008-863e-4846-8db8-9522257a9314 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b3412008-863e-4846-8db8-9522257a9314 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:44 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b3412008-863e-4846-8db8-9522257a9314 tempest-ProjectMemberTests-1154001707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:44 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-b3412008-863e-4846-8db8-9522257a9314 tempest-ProjectMemberTests-1154001707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-b3412008-863e-4846-8db8-9522257a9314 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b3412008-863e-4846-8db8-9522257a9314 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:44 devstack sudo[108034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:46:44 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:44 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-b3412008-863e-4846-8db8-9522257a9314 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.303s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:44 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-b3412008-863e-4846-8db8-9522257a9314 tempest-ProjectMemberTests-1154001707 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:46:44 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-b3412008-863e-4846-8db8-9522257a9314 tempest-ProjectMemberTests-1154001707 None] Deleted volume successfully. Nov 02 12:46:44 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-b3412008-863e-4846-8db8-9522257a9314 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-3d203753-240e-4c45-9dba-a0a176bdf508-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:45 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bb5711e-c052-48f6-8406-c54da62b2907 tempest-ProjectMemberTests-1154001707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:46:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8bb5711e-c052-48f6-8406-c54da62b2907 tempest-ProjectMemberTests-1154001707 None] Flow 'volume_create_manager' (040e0b92-0106-46f1-9605-6a21bd7e2f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8bb5711e-c052-48f6-8406-c54da62b2907 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7bac46c-8f1b-4fff-86e3-9769299982c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8bb5711e-c052-48f6-8406-c54da62b2907 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7bac46c-8f1b-4fff-86e3-9769299982c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1429587073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d09f2fc-8efe-44a4-8a3f-9c1585489980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60099afac3fc4cb3b2313235ee5a57b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:45Z,use_quota=True,user_id='466fcf287769488eaa04f91080ae1f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8bb5711e-c052-48f6-8406-c54da62b2907 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81629e3b-2bc1-4542-8662-bc608e893771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8bb5711e-c052-48f6-8406-c54da62b2907 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81629e3b-2bc1-4542-8662-bc608e893771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8bb5711e-c052-48f6-8406-c54da62b2907 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de2bdae0-7732-4be4-856e-fe3e560ac853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8bb5711e-c052-48f6-8406-c54da62b2907 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de2bdae0-7732-4be4-856e-fe3e560ac853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d09f2fc-8efe-44a4-8a3f-9c1585489980', 'volume_name': 'volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8bb5711e-c052-48f6-8406-c54da62b2907 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b44850ce-4158-45b4-a176-f4210b8d8303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8bb5711e-c052-48f6-8406-c54da62b2907 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b44850ce-4158-45b4-a176-f4210b8d8303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:45 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8bb5711e-c052-48f6-8406-c54da62b2907 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (037a72d6-e1c1-465c-b217-92b341156286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:45 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-8bb5711e-c052-48f6-8406-c54da62b2907 tempest-ProjectMemberTests-1154001707 None] Volume 8d09f2fc-8efe-44a4-8a3f-9c1585489980: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980', 'volume_size': 1} Nov 02 12:46:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8bb5711e-c052-48f6-8406-c54da62b2907 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8bb5711e-c052-48f6-8406-c54da62b2907 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:45 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8bb5711e-c052-48f6-8406-c54da62b2907 tempest-ProjectMemberTests-1154001707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1429587073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d09f2fc-8efe-44a4-8a3f-9c1585489980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60099afac3fc4cb3b2313235ee5a57b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:45Z,use_quota=True,user_id='466fcf287769488eaa04f91080ae1f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:46:45 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-8bb5711e-c052-48f6-8406-c54da62b2907 tempest-ProjectMemberTests-1154001707 None] Creating volume 8d09f2fc-8efe-44a4-8a3f-9c1585489980 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:46:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8bb5711e-c052-48f6-8406-c54da62b2907 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8bb5711e-c052-48f6-8406-c54da62b2907 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:45 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8bb5711e-c052-48f6-8406-c54da62b2907 tempest-ProjectMemberTests-1154001707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:45 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8bb5711e-c052-48f6-8406-c54da62b2907 tempest-ProjectMemberTests-1154001707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8bb5711e-c052-48f6-8406-c54da62b2907 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:45 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8bb5711e-c052-48f6-8406-c54da62b2907 tempest-ProjectMemberTests-1154001707 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:46:45 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-8bb5711e-c052-48f6-8406-c54da62b2907 tempest-ProjectMemberTests-1154001707 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:46:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8bb5711e-c052-48f6-8406-c54da62b2907 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:45 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980 1073741824 Nov 02 12:46:45 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:45 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8bb5711e-c052-48f6-8406-c54da62b2907 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980 1073741824" returned: 0 in 0.450s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8bb5711e-c052-48f6-8406-c54da62b2907 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:45 devstack sudo[108079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980 Nov 02 12:46:45 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:46 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8bb5711e-c052-48f6-8406-c54da62b2907 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980" returned: 0 in 0.273s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:46 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-8bb5711e-c052-48f6-8406-c54da62b2907 tempest-ProjectMemberTests-1154001707 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:46:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8bb5711e-c052-48f6-8406-c54da62b2907 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8bb5711e-c052-48f6-8406-c54da62b2907 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (037a72d6-e1c1-465c-b217-92b341156286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8bb5711e-c052-48f6-8406-c54da62b2907 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaa2809a-1524-4138-bcff-f2486b538976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:46 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-8bb5711e-c052-48f6-8406-c54da62b2907 tempest-ProjectMemberTests-1154001707 None] Volume volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980 (8d09f2fc-8efe-44a4-8a3f-9c1585489980): created successfully Nov 02 12:46:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8bb5711e-c052-48f6-8406-c54da62b2907 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaa2809a-1524-4138-bcff-f2486b538976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:46 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-8bb5711e-c052-48f6-8406-c54da62b2907 tempest-ProjectMemberTests-1154001707 None] Flow 'volume_create_manager' (040e0b92-0106-46f1-9605-6a21bd7e2f3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:46 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-8bb5711e-c052-48f6-8406-c54da62b2907 tempest-ProjectMemberTests-1154001707 None] Created volume successfully. Nov 02 12:46:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8dcafd73-0889-48c2-94a2-4b12a8ac1973 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8dcafd73-0889-48c2-94a2-4b12a8ac1973 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:47 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-8dcafd73-0889-48c2-94a2-4b12a8ac1973 tempest-ProjectMemberTests-1154001707 None] Creating offline snapshot 6c3d301d-b583-4554-8d83-2f8db501dc39 of volume 8d09f2fc-8efe-44a4-8a3f-9c1585489980 {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:46:47 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ed893a-9b9b-4ba4-bd96-774603a794d1]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8dcafd73-0889-48c2-94a2-4b12a8ac1973 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:47 devstack sudo[108090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980 Nov 02 12:46:47 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:47 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8dcafd73-0889-48c2-94a2-4b12a8ac1973 tempest-ProjectMemberTests-1154001707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980" returned: 0 in 0.354s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8dcafd73-0889-48c2-94a2-4b12a8ac1973 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980.6c3d301d-b583-4554-8d83-2f8db501dc39 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:47 devstack sudo[108095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980.6c3d301d-b583-4554-8d83-2f8db501dc39 1G Nov 02 12:46:47 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:48 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8dcafd73-0889-48c2-94a2-4b12a8ac1973 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980.6c3d301d-b583-4554-8d83-2f8db501dc39 1G" returned: 0 in 0.419s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8dcafd73-0889-48c2-94a2-4b12a8ac1973 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980.6c3d301d-b583-4554-8d83-2f8db501dc39 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:48 devstack sudo[108101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980.6c3d301d-b583-4554-8d83-2f8db501dc39 Nov 02 12:46:48 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:48 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8dcafd73-0889-48c2-94a2-4b12a8ac1973 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980.6c3d301d-b583-4554-8d83-2f8db501dc39" returned: 0 in 0.285s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:48 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-8dcafd73-0889-48c2-94a2-4b12a8ac1973 tempest-ProjectMemberTests-1154001707 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980.6c3d301d-b583-4554-8d83-2f8db501dc39 is being set with open permissions: ugo+rw Nov 02 12:46:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8dcafd73-0889-48c2-94a2-4b12a8ac1973 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980.6c3d301d-b583-4554-8d83-2f8db501dc39 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:48 devstack sudo[108106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980.6c3d301d-b583-4554-8d83-2f8db501dc39 Nov 02 12:46:48 devstack sudo[108106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:48 devstack sudo[108106]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8dcafd73-0889-48c2-94a2-4b12a8ac1973 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980.6c3d301d-b583-4554-8d83-2f8db501dc39" returned: 0 in 0.247s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8dcafd73-0889-48c2-94a2-4b12a8ac1973 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:48 devstack sudo[108109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980.info Nov 02 12:46:48 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:49 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8dcafd73-0889-48c2-94a2-4b12a8ac1973 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980.info" returned: 0 in 0.241s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:49 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-8dcafd73-0889-48c2-94a2-4b12a8ac1973 tempest-ProjectMemberTests-1154001707 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980.info is being set with open permissions: ugo+rw Nov 02 12:46:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8dcafd73-0889-48c2-94a2-4b12a8ac1973 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:49 devstack sudo[108112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980.info Nov 02 12:46:49 devstack sudo[108112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:49 devstack sudo[108112]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-8dcafd73-0889-48c2-94a2-4b12a8ac1973 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980.info" returned: 0 in 0.277s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-8dcafd73-0889-48c2-94a2-4b12a8ac1973 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.912s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:49 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-8dcafd73-0889-48c2-94a2-4b12a8ac1973 tempest-ProjectMemberTests-1154001707 None] Create snapshot completed successfully Nov 02 12:46:49 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-fe7cb115-1c9b-4a87-972d-242777bc001f tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-6c3d301d-b583-4554-8d83-2f8db501dc39-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:49 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-fe7cb115-1c9b-4a87-972d-242777bc001f tempest-ProjectMemberTests-1154001707 None] Lock "cinder-6c3d301d-b583-4554-8d83-2f8db501dc39-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:49 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-fe7cb115-1c9b-4a87-972d-242777bc001f tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-quobyte-8d09f2fc-8efe-44a4-8a3f-9c1585489980" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:49 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-fe7cb115-1c9b-4a87-972d-242777bc001f tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-8d09f2fc-8efe-44a4-8a3f-9c1585489980" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:49 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-fe7cb115-1c9b-4a87-972d-242777bc001f tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-quobyte-6c3d301d-b583-4554-8d83-2f8db501dc39" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:49 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-fe7cb115-1c9b-4a87-972d-242777bc001f tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-6c3d301d-b583-4554-8d83-2f8db501dc39" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:49 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-fe7cb115-1c9b-4a87-972d-242777bc001f tempest-ProjectMemberTests-1154001707 None] Deleting offline snapshot 6c3d301d-b583-4554-8d83-2f8db501dc39 of volume 8d09f2fc-8efe-44a4-8a3f-9c1585489980 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:46:49 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-fe7cb115-1c9b-4a87-972d-242777bc001f tempest-ProjectMemberTests-1154001707 None] snapshot_file for this snap is: volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980.6c3d301d-b583-4554-8d83-2f8db501dc39 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:46:49 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a6cdaa-04dd-41ca-b3b7-af4c752a2a42]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:49 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fe7cb115-1c9b-4a87-972d-242777bc001f tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980.6c3d301d-b583-4554-8d83-2f8db501dc39 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:49 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980.6c3d301d-b583-4554-8d83-2f8db501dc39 Nov 02 12:46:49 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:50 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fe7cb115-1c9b-4a87-972d-242777bc001f tempest-ProjectMemberTests-1154001707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980.6c3d301d-b583-4554-8d83-2f8db501dc39" returned: 0 in 0.367s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:50 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-fe7cb115-1c9b-4a87-972d-242777bc001f tempest-ProjectMemberTests-1154001707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:46:50 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fde12c-14a4-4ecd-90f4-ff8668f642cc]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fe7cb115-1c9b-4a87-972d-242777bc001f tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:50 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980 Nov 02 12:46:50 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:50 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fe7cb115-1c9b-4a87-972d-242777bc001f tempest-ProjectMemberTests-1154001707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980" returned: 0 in 0.346s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fe7cb115-1c9b-4a87-972d-242777bc001f tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980.6c3d301d-b583-4554-8d83-2f8db501dc39 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:50 devstack sudo[108125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980.6c3d301d-b583-4554-8d83-2f8db501dc39 Nov 02 12:46:50 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:50 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fe7cb115-1c9b-4a87-972d-242777bc001f tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980.6c3d301d-b583-4554-8d83-2f8db501dc39" returned: 0 in 0.331s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:50 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fe7cb115-1c9b-4a87-972d-242777bc001f tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980.6c3d301d-b583-4554-8d83-2f8db501dc39 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:50 devstack sudo[108130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980.6c3d301d-b583-4554-8d83-2f8db501dc39 Nov 02 12:46:50 devstack sudo[108130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:51 devstack sudo[108130]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:51 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fe7cb115-1c9b-4a87-972d-242777bc001f tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980.6c3d301d-b583-4554-8d83-2f8db501dc39" returned: 0 in 0.249s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:51 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-fe7cb115-1c9b-4a87-972d-242777bc001f tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-6c3d301d-b583-4554-8d83-2f8db501dc39" released by "_delete_snapshot" :: held 1.384s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:51 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-fe7cb115-1c9b-4a87-972d-242777bc001f tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-8d09f2fc-8efe-44a4-8a3f-9c1585489980" released by "delete_snapshot" :: held 1.404s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:51 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-fe7cb115-1c9b-4a87-972d-242777bc001f tempest-ProjectMemberTests-1154001707 None] Created reservations ['f9ac501d-1e2d-4f81-a7fd-59ded0ae393c', '5a1a335c-1034-43bb-8267-6a8ee5f19b2b', 'f7ab98ba-0d45-4b49-b05d-671319d9ae2e', '4163d305-44d6-4713-a260-11f7ca673691'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:51 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-fe7cb115-1c9b-4a87-972d-242777bc001f tempest-ProjectMemberTests-1154001707 None] Delete snapshot completed successfully. Nov 02 12:46:51 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-fe7cb115-1c9b-4a87-972d-242777bc001f tempest-ProjectMemberTests-1154001707 None] Lock "cinder-6c3d301d-b583-4554-8d83-2f8db501dc39-delete_snapshot" released by "delete_snapshot" :: held 1.532s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:51 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ae41a345-6968-41cb-93d8-7cae5ec68fdc tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-8d09f2fc-8efe-44a4-8a3f-9c1585489980-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:51 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ae41a345-6968-41cb-93d8-7cae5ec68fdc tempest-ProjectMemberTests-1154001707 None] Lock "cinder-8d09f2fc-8efe-44a4-8a3f-9c1585489980-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:51 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ae41a345-6968-41cb-93d8-7cae5ec68fdc tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-quobyte-8d09f2fc-8efe-44a4-8a3f-9c1585489980" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:51 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ae41a345-6968-41cb-93d8-7cae5ec68fdc tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-8d09f2fc-8efe-44a4-8a3f-9c1585489980" acquired by "delete_volume" :: waited 0.013s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:52 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8fed7b-b9e5-4a79-a009-8d38189d9567]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ae41a345-6968-41cb-93d8-7cae5ec68fdc tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:52 devstack sudo[108134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980 Nov 02 12:46:52 devstack sudo[108134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:52 devstack sudo[108134]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ae41a345-6968-41cb-93d8-7cae5ec68fdc tempest-ProjectMemberTests-1154001707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980" returned: 0 in 0.348s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ae41a345-6968-41cb-93d8-7cae5ec68fdc tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:52 devstack sudo[108139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980 Nov 02 12:46:52 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:52 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ae41a345-6968-41cb-93d8-7cae5ec68fdc tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8d09f2fc-8efe-44a4-8a3f-9c1585489980" returned: 0 in 0.237s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:52 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ae41a345-6968-41cb-93d8-7cae5ec68fdc tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-8d09f2fc-8efe-44a4-8a3f-9c1585489980" released by "delete_volume" :: held 0.640s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:52 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-ae41a345-6968-41cb-93d8-7cae5ec68fdc tempest-ProjectMemberTests-1154001707 None] Created reservations ['3e14ea9a-1ca3-4e6b-99af-d88c350682be', 'a3cec63d-788a-4ddf-b83a-27e220a121a1', 'f8b0d80c-90e6-411c-a8d6-eed027aa77c8', '80e45ddf-4a75-4b19-a6c2-a633a208d8d0'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ae41a345-6968-41cb-93d8-7cae5ec68fdc tempest-ProjectMemberTests-1154001707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ae41a345-6968-41cb-93d8-7cae5ec68fdc tempest-ProjectMemberTests-1154001707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:52 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ae41a345-6968-41cb-93d8-7cae5ec68fdc tempest-ProjectMemberTests-1154001707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:52 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ae41a345-6968-41cb-93d8-7cae5ec68fdc tempest-ProjectMemberTests-1154001707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ae41a345-6968-41cb-93d8-7cae5ec68fdc tempest-ProjectMemberTests-1154001707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ae41a345-6968-41cb-93d8-7cae5ec68fdc tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:52 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:46:52 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:52 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:52 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ae41a345-6968-41cb-93d8-7cae5ec68fdc tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.235s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:52 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-ae41a345-6968-41cb-93d8-7cae5ec68fdc tempest-ProjectMemberTests-1154001707 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:46:52 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-ae41a345-6968-41cb-93d8-7cae5ec68fdc tempest-ProjectMemberTests-1154001707 None] Deleted volume successfully. Nov 02 12:46:52 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-ae41a345-6968-41cb-93d8-7cae5ec68fdc tempest-ProjectMemberTests-1154001707 None] Lock "cinder-8d09f2fc-8efe-44a4-8a3f-9c1585489980-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:53 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce2257c7-142f-4b07-a1ec-168af68fbb03 tempest-ProjectMemberTests-1154001707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:46:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ce2257c7-142f-4b07-a1ec-168af68fbb03 tempest-ProjectMemberTests-1154001707 None] Flow 'volume_create_manager' (0a673d33-a02e-47b6-9787-a9f71df628a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ce2257c7-142f-4b07-a1ec-168af68fbb03 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdd55104-a999-45aa-8c8e-a807f81a682c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ce2257c7-142f-4b07-a1ec-168af68fbb03 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdd55104-a999-45aa-8c8e-a807f81a682c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1442528333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fd147a3-c81a-4134-b43e-ba3e7e74339f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60099afac3fc4cb3b2313235ee5a57b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:53Z,use_quota=True,user_id='466fcf287769488eaa04f91080ae1f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ce2257c7-142f-4b07-a1ec-168af68fbb03 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec0e961c-dd87-4008-8994-990fec356ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ce2257c7-142f-4b07-a1ec-168af68fbb03 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec0e961c-dd87-4008-8994-990fec356ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ce2257c7-142f-4b07-a1ec-168af68fbb03 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88d8d559-72e2-4286-a8f9-ced5925da76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ce2257c7-142f-4b07-a1ec-168af68fbb03 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88d8d559-72e2-4286-a8f9-ced5925da76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fd147a3-c81a-4134-b43e-ba3e7e74339f', 'volume_name': 'volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ce2257c7-142f-4b07-a1ec-168af68fbb03 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d50d86c0-5bbf-4aa6-92f2-beedfeec3020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ce2257c7-142f-4b07-a1ec-168af68fbb03 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d50d86c0-5bbf-4aa6-92f2-beedfeec3020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:53 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ce2257c7-142f-4b07-a1ec-168af68fbb03 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e240a79c-7a61-4bb4-8734-b7ffc0829509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:53 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-ce2257c7-142f-4b07-a1ec-168af68fbb03 tempest-ProjectMemberTests-1154001707 None] Volume 8fd147a3-c81a-4134-b43e-ba3e7e74339f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f', 'volume_size': 1} Nov 02 12:46:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ce2257c7-142f-4b07-a1ec-168af68fbb03 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ce2257c7-142f-4b07-a1ec-168af68fbb03 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:53 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ce2257c7-142f-4b07-a1ec-168af68fbb03 tempest-ProjectMemberTests-1154001707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1442528333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fd147a3-c81a-4134-b43e-ba3e7e74339f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60099afac3fc4cb3b2313235ee5a57b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:46:53Z,use_quota=True,user_id='466fcf287769488eaa04f91080ae1f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:46:53 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-ce2257c7-142f-4b07-a1ec-168af68fbb03 tempest-ProjectMemberTests-1154001707 None] Creating volume 8fd147a3-c81a-4134-b43e-ba3e7e74339f {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:46:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ce2257c7-142f-4b07-a1ec-168af68fbb03 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ce2257c7-142f-4b07-a1ec-168af68fbb03 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:53 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ce2257c7-142f-4b07-a1ec-168af68fbb03 tempest-ProjectMemberTests-1154001707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:53 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ce2257c7-142f-4b07-a1ec-168af68fbb03 tempest-ProjectMemberTests-1154001707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ce2257c7-142f-4b07-a1ec-168af68fbb03 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:53 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ce2257c7-142f-4b07-a1ec-168af68fbb03 tempest-ProjectMemberTests-1154001707 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:46:53 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-ce2257c7-142f-4b07-a1ec-168af68fbb03 tempest-ProjectMemberTests-1154001707 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:46:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ce2257c7-142f-4b07-a1ec-168af68fbb03 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:53 devstack sudo[108145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f 1073741824 Nov 02 12:46:53 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:53 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ce2257c7-142f-4b07-a1ec-168af68fbb03 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f 1073741824" returned: 0 in 0.405s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:53 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ce2257c7-142f-4b07-a1ec-168af68fbb03 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:54 devstack sudo[108150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f Nov 02 12:46:54 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:54 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-ce2257c7-142f-4b07-a1ec-168af68fbb03 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f" returned: 0 in 0.231s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-ce2257c7-142f-4b07-a1ec-168af68fbb03 tempest-ProjectMemberTests-1154001707 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:46:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-ce2257c7-142f-4b07-a1ec-168af68fbb03 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ce2257c7-142f-4b07-a1ec-168af68fbb03 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e240a79c-7a61-4bb4-8734-b7ffc0829509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ce2257c7-142f-4b07-a1ec-168af68fbb03 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af01a8c3-1be6-4b46-8a04-843a54e78dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:46:54 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-ce2257c7-142f-4b07-a1ec-168af68fbb03 tempest-ProjectMemberTests-1154001707 None] Volume volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f (8fd147a3-c81a-4134-b43e-ba3e7e74339f): created successfully Nov 02 12:46:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ce2257c7-142f-4b07-a1ec-168af68fbb03 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af01a8c3-1be6-4b46-8a04-843a54e78dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:46:54 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-ce2257c7-142f-4b07-a1ec-168af68fbb03 tempest-ProjectMemberTests-1154001707 None] Flow 'volume_create_manager' (0a673d33-a02e-47b6-9787-a9f71df628a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:46:54 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-ce2257c7-142f-4b07-a1ec-168af68fbb03 tempest-ProjectMemberTests-1154001707 None] Created volume successfully. Nov 02 12:46:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c8d6a46e-9653-44eb-b89f-7218d1a1bf82 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c8d6a46e-9653-44eb-b89f-7218d1a1bf82 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:54 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-c8d6a46e-9653-44eb-b89f-7218d1a1bf82 tempest-ProjectMemberTests-1154001707 None] Creating offline snapshot ba965ebb-f89a-4069-b099-e982c1b271c7 of volume 8fd147a3-c81a-4134-b43e-ba3e7e74339f {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:46:54 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4ef668-fbb8-420c-90bb-74145740d40e]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:54 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c8d6a46e-9653-44eb-b89f-7218d1a1bf82 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:54 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f Nov 02 12:46:54 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:55 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c8d6a46e-9653-44eb-b89f-7218d1a1bf82 tempest-ProjectMemberTests-1154001707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f" returned: 0 in 0.350s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c8d6a46e-9653-44eb-b89f-7218d1a1bf82 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f.ba965ebb-f89a-4069-b099-e982c1b271c7 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:55 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f.ba965ebb-f89a-4069-b099-e982c1b271c7 1G Nov 02 12:46:55 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:55 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c8d6a46e-9653-44eb-b89f-7218d1a1bf82 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f.ba965ebb-f89a-4069-b099-e982c1b271c7 1G" returned: 0 in 0.377s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c8d6a46e-9653-44eb-b89f-7218d1a1bf82 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f.ba965ebb-f89a-4069-b099-e982c1b271c7 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:55 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f.ba965ebb-f89a-4069-b099-e982c1b271c7 Nov 02 12:46:55 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:55 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c8d6a46e-9653-44eb-b89f-7218d1a1bf82 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f.ba965ebb-f89a-4069-b099-e982c1b271c7" returned: 0 in 0.283s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:55 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-c8d6a46e-9653-44eb-b89f-7218d1a1bf82 tempest-ProjectMemberTests-1154001707 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f.ba965ebb-f89a-4069-b099-e982c1b271c7 is being set with open permissions: ugo+rw Nov 02 12:46:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c8d6a46e-9653-44eb-b89f-7218d1a1bf82 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f.ba965ebb-f89a-4069-b099-e982c1b271c7 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:55 devstack sudo[108169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f.ba965ebb-f89a-4069-b099-e982c1b271c7 Nov 02 12:46:55 devstack sudo[108169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:55 devstack sudo[108169]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c8d6a46e-9653-44eb-b89f-7218d1a1bf82 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f.ba965ebb-f89a-4069-b099-e982c1b271c7" returned: 0 in 0.228s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:55 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c8d6a46e-9653-44eb-b89f-7218d1a1bf82 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:55 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f.info Nov 02 12:46:55 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:56 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c8d6a46e-9653-44eb-b89f-7218d1a1bf82 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f.info" returned: 0 in 0.235s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:56 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-c8d6a46e-9653-44eb-b89f-7218d1a1bf82 tempest-ProjectMemberTests-1154001707 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f.info is being set with open permissions: ugo+rw Nov 02 12:46:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c8d6a46e-9653-44eb-b89f-7218d1a1bf82 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:56 devstack sudo[108175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f.info Nov 02 12:46:56 devstack sudo[108175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:56 devstack sudo[108175]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-c8d6a46e-9653-44eb-b89f-7218d1a1bf82 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f.info" returned: 0 in 0.225s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-c8d6a46e-9653-44eb-b89f-7218d1a1bf82 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.786s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:56 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-c8d6a46e-9653-44eb-b89f-7218d1a1bf82 tempest-ProjectMemberTests-1154001707 None] Create snapshot completed successfully Nov 02 12:46:56 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-337256b8-ecb8-41e8-9167-33ae32a866ab tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-ba965ebb-f89a-4069-b099-e982c1b271c7-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:56 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-337256b8-ecb8-41e8-9167-33ae32a866ab tempest-ProjectMemberTests-1154001707 None] Lock "cinder-ba965ebb-f89a-4069-b099-e982c1b271c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:56 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-337256b8-ecb8-41e8-9167-33ae32a866ab tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-quobyte-8fd147a3-c81a-4134-b43e-ba3e7e74339f" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:56 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-337256b8-ecb8-41e8-9167-33ae32a866ab tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-8fd147a3-c81a-4134-b43e-ba3e7e74339f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:56 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-337256b8-ecb8-41e8-9167-33ae32a866ab tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-quobyte-ba965ebb-f89a-4069-b099-e982c1b271c7" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:56 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-337256b8-ecb8-41e8-9167-33ae32a866ab tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-ba965ebb-f89a-4069-b099-e982c1b271c7" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:56 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-337256b8-ecb8-41e8-9167-33ae32a866ab tempest-ProjectMemberTests-1154001707 None] Deleting offline snapshot ba965ebb-f89a-4069-b099-e982c1b271c7 of volume 8fd147a3-c81a-4134-b43e-ba3e7e74339f {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:46:56 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-337256b8-ecb8-41e8-9167-33ae32a866ab tempest-ProjectMemberTests-1154001707 None] snapshot_file for this snap is: volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f.ba965ebb-f89a-4069-b099-e982c1b271c7 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:46:56 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f7dcd5-6d6c-4a58-94ec-d836da6cf2d3]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:56 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-337256b8-ecb8-41e8-9167-33ae32a866ab tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f.ba965ebb-f89a-4069-b099-e982c1b271c7 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:56 devstack sudo[108178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f.ba965ebb-f89a-4069-b099-e982c1b271c7 Nov 02 12:46:56 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:57 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-337256b8-ecb8-41e8-9167-33ae32a866ab tempest-ProjectMemberTests-1154001707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f.ba965ebb-f89a-4069-b099-e982c1b271c7" returned: 0 in 0.355s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:57 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-337256b8-ecb8-41e8-9167-33ae32a866ab tempest-ProjectMemberTests-1154001707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:46:57 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74e00bf-52b7-4797-baed-ef18a6dae5a9]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-337256b8-ecb8-41e8-9167-33ae32a866ab tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:57 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f Nov 02 12:46:57 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:57 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-337256b8-ecb8-41e8-9167-33ae32a866ab tempest-ProjectMemberTests-1154001707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f" returned: 0 in 0.361s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-337256b8-ecb8-41e8-9167-33ae32a866ab tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f.ba965ebb-f89a-4069-b099-e982c1b271c7 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:57 devstack sudo[108188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f.ba965ebb-f89a-4069-b099-e982c1b271c7 Nov 02 12:46:57 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:57 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-337256b8-ecb8-41e8-9167-33ae32a866ab tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f.ba965ebb-f89a-4069-b099-e982c1b271c7" returned: 0 in 0.330s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:57 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-337256b8-ecb8-41e8-9167-33ae32a866ab tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f.ba965ebb-f89a-4069-b099-e982c1b271c7 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:57 devstack sudo[108193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f.ba965ebb-f89a-4069-b099-e982c1b271c7 Nov 02 12:46:57 devstack sudo[108193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:58 devstack sudo[108193]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:58 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-337256b8-ecb8-41e8-9167-33ae32a866ab tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f.ba965ebb-f89a-4069-b099-e982c1b271c7" returned: 0 in 0.265s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:58 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-337256b8-ecb8-41e8-9167-33ae32a866ab tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-ba965ebb-f89a-4069-b099-e982c1b271c7" released by "_delete_snapshot" :: held 1.409s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:58 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-337256b8-ecb8-41e8-9167-33ae32a866ab tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-8fd147a3-c81a-4134-b43e-ba3e7e74339f" released by "delete_snapshot" :: held 1.429s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:58 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-337256b8-ecb8-41e8-9167-33ae32a866ab tempest-ProjectMemberTests-1154001707 None] Created reservations ['8883eab9-23d0-413b-ad64-e53b0e49b1f0', '92410acc-65f0-4720-b93a-2a8893a455a3', 'ca656bfc-858c-402d-99b3-ff4c49ab5937', '1baa8239-52fc-4595-8daa-d860a8a662cb'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:58 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-337256b8-ecb8-41e8-9167-33ae32a866ab tempest-ProjectMemberTests-1154001707 None] Delete snapshot completed successfully. Nov 02 12:46:58 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-337256b8-ecb8-41e8-9167-33ae32a866ab tempest-ProjectMemberTests-1154001707 None] Lock "cinder-ba965ebb-f89a-4069-b099-e982c1b271c7-delete_snapshot" released by "delete_snapshot" :: held 1.564s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:58 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-07f2fbaf-db45-40d3-aeac-dde5e039fbfb tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-8fd147a3-c81a-4134-b43e-ba3e7e74339f-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:58 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-07f2fbaf-db45-40d3-aeac-dde5e039fbfb tempest-ProjectMemberTests-1154001707 None] Lock "cinder-8fd147a3-c81a-4134-b43e-ba3e7e74339f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:58 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-07f2fbaf-db45-40d3-aeac-dde5e039fbfb tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-quobyte-8fd147a3-c81a-4134-b43e-ba3e7e74339f" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:46:58 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-07f2fbaf-db45-40d3-aeac-dde5e039fbfb tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-8fd147a3-c81a-4134-b43e-ba3e7e74339f" acquired by "delete_volume" :: waited 0.014s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:46:59 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc86772e-6312-42cc-a2e6-c10e4c2a693c]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:46:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-07f2fbaf-db45-40d3-aeac-dde5e039fbfb tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:59 devstack sudo[108196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f Nov 02 12:46:59 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:59 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-07f2fbaf-db45-40d3-aeac-dde5e039fbfb tempest-ProjectMemberTests-1154001707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f" returned: 0 in 0.360s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-07f2fbaf-db45-40d3-aeac-dde5e039fbfb tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:59 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f Nov 02 12:46:59 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:46:59 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Nov 02 12:46:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-07f2fbaf-db45-40d3-aeac-dde5e039fbfb tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-8fd147a3-c81a-4134-b43e-ba3e7e74339f" returned: 0 in 0.250s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:46:59 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-07f2fbaf-db45-40d3-aeac-dde5e039fbfb tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-8fd147a3-c81a-4134-b43e-ba3e7e74339f" released by "delete_volume" :: held 0.674s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:46:59 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-07f2fbaf-db45-40d3-aeac-dde5e039fbfb tempest-ProjectMemberTests-1154001707 None] Created reservations ['3f9d98d1-0505-45e4-b06a-43b93b4cb4ae', '7970c827-1d31-4951-88b5-57200bc62604', 'd64145d0-ec33-46fa-be10-17fd992459df', '72fd22c3-7293-4b11-9dd0-db3738af9125'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:46:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-07f2fbaf-db45-40d3-aeac-dde5e039fbfb tempest-ProjectMemberTests-1154001707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:46:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-07f2fbaf-db45-40d3-aeac-dde5e039fbfb tempest-ProjectMemberTests-1154001707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:46:59 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-07f2fbaf-db45-40d3-aeac-dde5e039fbfb tempest-ProjectMemberTests-1154001707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:46:59 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-07f2fbaf-db45-40d3-aeac-dde5e039fbfb tempest-ProjectMemberTests-1154001707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:46:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-07f2fbaf-db45-40d3-aeac-dde5e039fbfb tempest-ProjectMemberTests-1154001707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:46:59 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-07f2fbaf-db45-40d3-aeac-dde5e039fbfb tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:46:59 devstack sudo[108204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:46:59 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:00 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-07f2fbaf-db45-40d3-aeac-dde5e039fbfb tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.267s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:00 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-07f2fbaf-db45-40d3-aeac-dde5e039fbfb tempest-ProjectMemberTests-1154001707 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:47:00 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-07f2fbaf-db45-40d3-aeac-dde5e039fbfb tempest-ProjectMemberTests-1154001707 None] Deleted volume successfully. Nov 02 12:47:00 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-07f2fbaf-db45-40d3-aeac-dde5e039fbfb tempest-ProjectMemberTests-1154001707 None] Lock "cinder-8fd147a3-c81a-4134-b43e-ba3e7e74339f-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:00 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-eda50e29-c622-4d4e-a18f-01f213a6f415 tempest-ProjectMemberTests-1154001707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:47:00 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-eda50e29-c622-4d4e-a18f-01f213a6f415 tempest-ProjectMemberTests-1154001707 None] Flow 'volume_create_manager' (1dcca6ad-ecdf-4d81-8297-20f75f42185c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:47:00 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-eda50e29-c622-4d4e-a18f-01f213a6f415 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (734e313c-ccf4-4daf-88fd-f1b5f6208166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:00 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-eda50e29-c622-4d4e-a18f-01f213a6f415 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (734e313c-ccf4-4daf-88fd-f1b5f6208166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-892462179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94012d66-07d9-4dda-9ce5-fd50ce3328b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60099afac3fc4cb3b2313235ee5a57b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:47:00Z,use_quota=True,user_id='466fcf287769488eaa04f91080ae1f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:00 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-eda50e29-c622-4d4e-a18f-01f213a6f415 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22a50348-90af-4456-a684-e8f1d48a87a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:00 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-eda50e29-c622-4d4e-a18f-01f213a6f415 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22a50348-90af-4456-a684-e8f1d48a87a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:00 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-eda50e29-c622-4d4e-a18f-01f213a6f415 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb844dd6-8339-4540-8e03-7f05eaf2ef54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:00 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-eda50e29-c622-4d4e-a18f-01f213a6f415 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb844dd6-8339-4540-8e03-7f05eaf2ef54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94012d66-07d9-4dda-9ce5-fd50ce3328b0', 'volume_name': 'volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:00 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-eda50e29-c622-4d4e-a18f-01f213a6f415 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b47a580-b9a1-4a51-9942-b679de55829e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:00 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-eda50e29-c622-4d4e-a18f-01f213a6f415 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b47a580-b9a1-4a51-9942-b679de55829e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:00 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-eda50e29-c622-4d4e-a18f-01f213a6f415 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed7dd0d-cd00-4d9f-ae0d-6a087cdf6a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:00 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-eda50e29-c622-4d4e-a18f-01f213a6f415 tempest-ProjectMemberTests-1154001707 None] Volume 94012d66-07d9-4dda-9ce5-fd50ce3328b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0', 'volume_size': 1} Nov 02 12:47:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-eda50e29-c622-4d4e-a18f-01f213a6f415 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-eda50e29-c622-4d4e-a18f-01f213a6f415 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:00 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-eda50e29-c622-4d4e-a18f-01f213a6f415 tempest-ProjectMemberTests-1154001707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-892462179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94012d66-07d9-4dda-9ce5-fd50ce3328b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60099afac3fc4cb3b2313235ee5a57b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:47:00Z,use_quota=True,user_id='466fcf287769488eaa04f91080ae1f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:47:00 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-eda50e29-c622-4d4e-a18f-01f213a6f415 tempest-ProjectMemberTests-1154001707 None] Creating volume 94012d66-07d9-4dda-9ce5-fd50ce3328b0 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:47:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-eda50e29-c622-4d4e-a18f-01f213a6f415 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-eda50e29-c622-4d4e-a18f-01f213a6f415 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:00 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-eda50e29-c622-4d4e-a18f-01f213a6f415 tempest-ProjectMemberTests-1154001707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:00 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-eda50e29-c622-4d4e-a18f-01f213a6f415 tempest-ProjectMemberTests-1154001707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-eda50e29-c622-4d4e-a18f-01f213a6f415 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:00 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-eda50e29-c622-4d4e-a18f-01f213a6f415 tempest-ProjectMemberTests-1154001707 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:47:00 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-eda50e29-c622-4d4e-a18f-01f213a6f415 tempest-ProjectMemberTests-1154001707 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:47:00 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eda50e29-c622-4d4e-a18f-01f213a6f415 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:00 devstack sudo[108207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0 1073741824 Nov 02 12:47:00 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:01 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eda50e29-c622-4d4e-a18f-01f213a6f415 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0 1073741824" returned: 0 in 0.421s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eda50e29-c622-4d4e-a18f-01f213a6f415 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:01 devstack sudo[108212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0 Nov 02 12:47:01 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:01 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-eda50e29-c622-4d4e-a18f-01f213a6f415 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0" returned: 0 in 0.266s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:01 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-eda50e29-c622-4d4e-a18f-01f213a6f415 tempest-ProjectMemberTests-1154001707 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:47:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-eda50e29-c622-4d4e-a18f-01f213a6f415 tempest-ProjectMemberTests-1154001707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-eda50e29-c622-4d4e-a18f-01f213a6f415 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed7dd0d-cd00-4d9f-ae0d-6a087cdf6a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-eda50e29-c622-4d4e-a18f-01f213a6f415 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1925a9eb-ab84-4ca4-94fe-3d20bf2e3a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:01 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-eda50e29-c622-4d4e-a18f-01f213a6f415 tempest-ProjectMemberTests-1154001707 None] Volume volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0 (94012d66-07d9-4dda-9ce5-fd50ce3328b0): created successfully Nov 02 12:47:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-eda50e29-c622-4d4e-a18f-01f213a6f415 tempest-ProjectMemberTests-1154001707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1925a9eb-ab84-4ca4-94fe-3d20bf2e3a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:01 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-eda50e29-c622-4d4e-a18f-01f213a6f415 tempest-ProjectMemberTests-1154001707 None] Flow 'volume_create_manager' (1dcca6ad-ecdf-4d81-8297-20f75f42185c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:47:01 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-eda50e29-c622-4d4e-a18f-01f213a6f415 tempest-ProjectMemberTests-1154001707 None] Created volume successfully. Nov 02 12:47:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e8a522f0-cbe7-476d-86c6-095cd9ef8d9e tempest-ProjectMemberTests-1154001707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e8a522f0-cbe7-476d-86c6-095cd9ef8d9e tempest-ProjectMemberTests-1154001707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:01 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-e8a522f0-cbe7-476d-86c6-095cd9ef8d9e tempest-ProjectMemberTests-1154001707 None] Creating offline snapshot 1f30f2f0-db6d-40c3-96e3-95540c32a385 of volume 94012d66-07d9-4dda-9ce5-fd50ce3328b0 {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:47:01 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[5017b4f3-72f5-4b6b-95c8-7f70d1b6d1ab]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:01 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e8a522f0-cbe7-476d-86c6-095cd9ef8d9e tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:01 devstack sudo[108216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0 Nov 02 12:47:01 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:02 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e8a522f0-cbe7-476d-86c6-095cd9ef8d9e tempest-ProjectMemberTests-1154001707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0" returned: 0 in 0.364s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e8a522f0-cbe7-476d-86c6-095cd9ef8d9e tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0.1f30f2f0-db6d-40c3-96e3-95540c32a385 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:02 devstack sudo[108222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0.1f30f2f0-db6d-40c3-96e3-95540c32a385 1G Nov 02 12:47:02 devstack sudo[108222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:02 devstack sudo[108222]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e8a522f0-cbe7-476d-86c6-095cd9ef8d9e tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0.1f30f2f0-db6d-40c3-96e3-95540c32a385 1G" returned: 0 in 0.396s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e8a522f0-cbe7-476d-86c6-095cd9ef8d9e tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0.1f30f2f0-db6d-40c3-96e3-95540c32a385 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:02 devstack sudo[108227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0.1f30f2f0-db6d-40c3-96e3-95540c32a385 Nov 02 12:47:02 devstack sudo[108227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:02 devstack sudo[108227]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e8a522f0-cbe7-476d-86c6-095cd9ef8d9e tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0.1f30f2f0-db6d-40c3-96e3-95540c32a385" returned: 0 in 0.274s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:02 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-e8a522f0-cbe7-476d-86c6-095cd9ef8d9e tempest-ProjectMemberTests-1154001707 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0.1f30f2f0-db6d-40c3-96e3-95540c32a385 is being set with open permissions: ugo+rw Nov 02 12:47:02 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e8a522f0-cbe7-476d-86c6-095cd9ef8d9e tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0.1f30f2f0-db6d-40c3-96e3-95540c32a385 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:02 devstack sudo[108232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0.1f30f2f0-db6d-40c3-96e3-95540c32a385 Nov 02 12:47:02 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:03 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e8a522f0-cbe7-476d-86c6-095cd9ef8d9e tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0.1f30f2f0-db6d-40c3-96e3-95540c32a385" returned: 0 in 0.234s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e8a522f0-cbe7-476d-86c6-095cd9ef8d9e tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:03 devstack sudo[108235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0.info Nov 02 12:47:03 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:03 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e8a522f0-cbe7-476d-86c6-095cd9ef8d9e tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0.info" returned: 0 in 0.238s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:03 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-e8a522f0-cbe7-476d-86c6-095cd9ef8d9e tempest-ProjectMemberTests-1154001707 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0.info is being set with open permissions: ugo+rw Nov 02 12:47:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e8a522f0-cbe7-476d-86c6-095cd9ef8d9e tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:03 devstack sudo[108238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0.info Nov 02 12:47:03 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:03 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e8a522f0-cbe7-476d-86c6-095cd9ef8d9e tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0.info" returned: 0 in 0.223s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e8a522f0-cbe7-476d-86c6-095cd9ef8d9e tempest-ProjectMemberTests-1154001707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.814s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:03 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-e8a522f0-cbe7-476d-86c6-095cd9ef8d9e tempest-ProjectMemberTests-1154001707 None] Create snapshot completed successfully Nov 02 12:47:03 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3c15721f-62b7-41cb-9ad8-36c11a9a40d9 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-1f30f2f0-db6d-40c3-96e3-95540c32a385-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:03 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3c15721f-62b7-41cb-9ad8-36c11a9a40d9 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-1f30f2f0-db6d-40c3-96e3-95540c32a385-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:03 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3c15721f-62b7-41cb-9ad8-36c11a9a40d9 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-quobyte-94012d66-07d9-4dda-9ce5-fd50ce3328b0" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:03 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3c15721f-62b7-41cb-9ad8-36c11a9a40d9 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-94012d66-07d9-4dda-9ce5-fd50ce3328b0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:03 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3c15721f-62b7-41cb-9ad8-36c11a9a40d9 tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-quobyte-1f30f2f0-db6d-40c3-96e3-95540c32a385" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:03 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3c15721f-62b7-41cb-9ad8-36c11a9a40d9 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-1f30f2f0-db6d-40c3-96e3-95540c32a385" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:03 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-3c15721f-62b7-41cb-9ad8-36c11a9a40d9 tempest-ProjectMemberTests-1154001707 None] Deleting offline snapshot 1f30f2f0-db6d-40c3-96e3-95540c32a385 of volume 94012d66-07d9-4dda-9ce5-fd50ce3328b0 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:47:03 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-3c15721f-62b7-41cb-9ad8-36c11a9a40d9 tempest-ProjectMemberTests-1154001707 None] snapshot_file for this snap is: volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0.1f30f2f0-db6d-40c3-96e3-95540c32a385 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:47:03 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[db765fdb-4f0c-48e9-a6f6-45ead2e6bc9e]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:03 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3c15721f-62b7-41cb-9ad8-36c11a9a40d9 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0.1f30f2f0-db6d-40c3-96e3-95540c32a385 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:04 devstack sudo[108241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0.1f30f2f0-db6d-40c3-96e3-95540c32a385 Nov 02 12:47:04 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:04 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3c15721f-62b7-41cb-9ad8-36c11a9a40d9 tempest-ProjectMemberTests-1154001707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0.1f30f2f0-db6d-40c3-96e3-95540c32a385" returned: 0 in 0.356s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:04 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-3c15721f-62b7-41cb-9ad8-36c11a9a40d9 tempest-ProjectMemberTests-1154001707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:47:04 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc831691-ab66-4ca7-92c5-bd73169d0611]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3c15721f-62b7-41cb-9ad8-36c11a9a40d9 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:04 devstack sudo[108246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0 Nov 02 12:47:04 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:04 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3c15721f-62b7-41cb-9ad8-36c11a9a40d9 tempest-ProjectMemberTests-1154001707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0" returned: 0 in 0.378s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:04 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3c15721f-62b7-41cb-9ad8-36c11a9a40d9 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0.1f30f2f0-db6d-40c3-96e3-95540c32a385 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:04 devstack sudo[108253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0.1f30f2f0-db6d-40c3-96e3-95540c32a385 Nov 02 12:47:04 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:05 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3c15721f-62b7-41cb-9ad8-36c11a9a40d9 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0.1f30f2f0-db6d-40c3-96e3-95540c32a385" returned: 0 in 0.316s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3c15721f-62b7-41cb-9ad8-36c11a9a40d9 tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0.1f30f2f0-db6d-40c3-96e3-95540c32a385 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:05 devstack sudo[108258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0.1f30f2f0-db6d-40c3-96e3-95540c32a385 Nov 02 12:47:05 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:05 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:05 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3c15721f-62b7-41cb-9ad8-36c11a9a40d9 tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0.1f30f2f0-db6d-40c3-96e3-95540c32a385" returned: 0 in 0.229s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:05 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3c15721f-62b7-41cb-9ad8-36c11a9a40d9 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-1f30f2f0-db6d-40c3-96e3-95540c32a385" released by "_delete_snapshot" :: held 1.375s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:05 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3c15721f-62b7-41cb-9ad8-36c11a9a40d9 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-94012d66-07d9-4dda-9ce5-fd50ce3328b0" released by "delete_snapshot" :: held 1.395s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:05 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-3c15721f-62b7-41cb-9ad8-36c11a9a40d9 tempest-ProjectMemberTests-1154001707 None] Created reservations ['efe399da-cc50-4d68-9270-2f57c9d59800', 'fec96803-28f5-41b8-9e76-8821267c1c51', '1049f67e-05ec-498e-a662-8ac422bc6d3e', '4be52dcb-7298-4be1-ba43-d505f05e53cc'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:47:05 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-3c15721f-62b7-41cb-9ad8-36c11a9a40d9 tempest-ProjectMemberTests-1154001707 None] Delete snapshot completed successfully. Nov 02 12:47:05 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3c15721f-62b7-41cb-9ad8-36c11a9a40d9 tempest-ProjectMemberTests-1154001707 None] Lock "cinder-1f30f2f0-db6d-40c3-96e3-95540c32a385-delete_snapshot" released by "delete_snapshot" :: held 1.518s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:06 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-dc0b9510-79b4-41c1-8cc0-1e3b7ad56bba tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-94012d66-07d9-4dda-9ce5-fd50ce3328b0-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:06 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-dc0b9510-79b4-41c1-8cc0-1e3b7ad56bba tempest-ProjectMemberTests-1154001707 None] Lock "cinder-94012d66-07d9-4dda-9ce5-fd50ce3328b0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:06 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-dc0b9510-79b4-41c1-8cc0-1e3b7ad56bba tempest-ProjectMemberTests-1154001707 None] Acquiring lock "cinder-quobyte-94012d66-07d9-4dda-9ce5-fd50ce3328b0" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:06 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-dc0b9510-79b4-41c1-8cc0-1e3b7ad56bba tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-94012d66-07d9-4dda-9ce5-fd50ce3328b0" acquired by "delete_volume" :: waited 0.015s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:06 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa39e98-fa6e-4ffa-a48e-26741936296b]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-dc0b9510-79b4-41c1-8cc0-1e3b7ad56bba tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:06 devstack sudo[108261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0 Nov 02 12:47:06 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:06 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-dc0b9510-79b4-41c1-8cc0-1e3b7ad56bba tempest-ProjectMemberTests-1154001707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0" returned: 0 in 0.356s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-dc0b9510-79b4-41c1-8cc0-1e3b7ad56bba tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:06 devstack sudo[108266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0 Nov 02 12:47:06 devstack sudo[108266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:06 devstack sudo[108266]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-dc0b9510-79b4-41c1-8cc0-1e3b7ad56bba tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-94012d66-07d9-4dda-9ce5-fd50ce3328b0" returned: 0 in 0.235s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:06 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-dc0b9510-79b4-41c1-8cc0-1e3b7ad56bba tempest-ProjectMemberTests-1154001707 None] Lock "cinder-quobyte-94012d66-07d9-4dda-9ce5-fd50ce3328b0" released by "delete_volume" :: held 0.650s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:06 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-dc0b9510-79b4-41c1-8cc0-1e3b7ad56bba tempest-ProjectMemberTests-1154001707 None] Created reservations ['e9790626-864a-4921-ba69-9d57783719c9', 'c5fcd680-7e03-4fb7-a22b-9b3a7dc2ac6e', '0abbdc16-e238-4043-a3f1-c1f18c9aca80', '3fa8f06b-ceac-44c6-b8a0-12260142b965'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:47:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-dc0b9510-79b4-41c1-8cc0-1e3b7ad56bba tempest-ProjectMemberTests-1154001707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-dc0b9510-79b4-41c1-8cc0-1e3b7ad56bba tempest-ProjectMemberTests-1154001707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:06 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-dc0b9510-79b4-41c1-8cc0-1e3b7ad56bba tempest-ProjectMemberTests-1154001707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:06 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-dc0b9510-79b4-41c1-8cc0-1e3b7ad56bba tempest-ProjectMemberTests-1154001707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-dc0b9510-79b4-41c1-8cc0-1e3b7ad56bba tempest-ProjectMemberTests-1154001707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:06 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-dc0b9510-79b4-41c1-8cc0-1e3b7ad56bba tempest-ProjectMemberTests-1154001707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:06 devstack sudo[108269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:47:06 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:07 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:07 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-dc0b9510-79b4-41c1-8cc0-1e3b7ad56bba tempest-ProjectMemberTests-1154001707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.237s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:07 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-dc0b9510-79b4-41c1-8cc0-1e3b7ad56bba tempest-ProjectMemberTests-1154001707 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:47:07 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-dc0b9510-79b4-41c1-8cc0-1e3b7ad56bba tempest-ProjectMemberTests-1154001707 None] Deleted volume successfully. Nov 02 12:47:07 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-dc0b9510-79b4-41c1-8cc0-1e3b7ad56bba tempest-ProjectMemberTests-1154001707 None] Lock "cinder-94012d66-07d9-4dda-9ce5-fd50ce3328b0-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:16 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:UPDATE=58,cinder:SELECT=45,cinder:INSERT=13,cinder:DELETE=2 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:47:17 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=46,cinder:INSERT=21,cinder:UPDATE=66,cinder:DELETE=8 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:47:32 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-30d804f1-5f34-4451-be0a-d010e12dc14b tempest-SnapshotDependencyTests-1258217419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:47:32 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-30d804f1-5f34-4451-be0a-d010e12dc14b tempest-SnapshotDependencyTests-1258217419 None] Flow 'volume_create_manager' (57f4b81e-2e0d-480d-b16f-19b6761dcd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:47:32 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-30d804f1-5f34-4451-be0a-d010e12dc14b tempest-SnapshotDependencyTests-1258217419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa35a249-3ed5-4772-a57e-b3d9a03013cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:32 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-30d804f1-5f34-4451-be0a-d010e12dc14b tempest-SnapshotDependencyTests-1258217419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa35a249-3ed5-4772-a57e-b3d9a03013cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:47:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-378049934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6acdf02-756c-422f-bb75-bed4b19f46f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a3df04c3f5341f88861d56a15acea51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:47:33Z,use_quota=True,user_id='c30c2afaef6849acab8b2f819192a749',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-30d804f1-5f34-4451-be0a-d010e12dc14b tempest-SnapshotDependencyTests-1258217419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e007082b-86c0-4d1f-9892-30cf7bfb9b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-30d804f1-5f34-4451-be0a-d010e12dc14b tempest-SnapshotDependencyTests-1258217419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e007082b-86c0-4d1f-9892-30cf7bfb9b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-30d804f1-5f34-4451-be0a-d010e12dc14b tempest-SnapshotDependencyTests-1258217419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2539a04-c933-48f0-afe6-199101d59fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-30d804f1-5f34-4451-be0a-d010e12dc14b tempest-SnapshotDependencyTests-1258217419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2539a04-c933-48f0-afe6-199101d59fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6acdf02-756c-422f-bb75-bed4b19f46f4', 'volume_name': 'volume-e6acdf02-756c-422f-bb75-bed4b19f46f4', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-30d804f1-5f34-4451-be0a-d010e12dc14b tempest-SnapshotDependencyTests-1258217419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aff786f-a02f-4eb3-a011-ea0e659c1fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-30d804f1-5f34-4451-be0a-d010e12dc14b tempest-SnapshotDependencyTests-1258217419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aff786f-a02f-4eb3-a011-ea0e659c1fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-30d804f1-5f34-4451-be0a-d010e12dc14b tempest-SnapshotDependencyTests-1258217419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a2d5c5-7a72-4f79-bee4-376eb7d4def5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:33 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-30d804f1-5f34-4451-be0a-d010e12dc14b tempest-SnapshotDependencyTests-1258217419 None] Volume e6acdf02-756c-422f-bb75-bed4b19f46f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6acdf02-756c-422f-bb75-bed4b19f46f4', 'volume_size': 1} Nov 02 12:47:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-30d804f1-5f34-4451-be0a-d010e12dc14b tempest-SnapshotDependencyTests-1258217419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-30d804f1-5f34-4451-be0a-d010e12dc14b tempest-SnapshotDependencyTests-1258217419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-30d804f1-5f34-4451-be0a-d010e12dc14b tempest-SnapshotDependencyTests-1258217419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:47:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-378049934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6acdf02-756c-422f-bb75-bed4b19f46f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a3df04c3f5341f88861d56a15acea51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:47:33Z,use_quota=True,user_id='c30c2afaef6849acab8b2f819192a749',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)}" {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 12:47:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-30d804f1-5f34-4451-be0a-d010e12dc14b tempest-SnapshotDependencyTests-1258217419 None] Creating volume e6acdf02-756c-422f-bb75-bed4b19f46f4 {{(pid=86515) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 12:47:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-30d804f1-5f34-4451-be0a-d010e12dc14b tempest-SnapshotDependencyTests-1258217419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-30d804f1-5f34-4451-be0a-d010e12dc14b tempest-SnapshotDependencyTests-1258217419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-30d804f1-5f34-4451-be0a-d010e12dc14b tempest-SnapshotDependencyTests-1258217419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-30d804f1-5f34-4451-be0a-d010e12dc14b tempest-SnapshotDependencyTests-1258217419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-30d804f1-5f34-4451-be0a-d010e12dc14b tempest-SnapshotDependencyTests-1258217419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-30d804f1-5f34-4451-be0a-d010e12dc14b tempest-SnapshotDependencyTests-1258217419 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:47:33 devstack cinder-volume[86515]: INFO cinder.volume.drivers.remotefs [None req-30d804f1-5f34-4451-be0a-d010e12dc14b tempest-SnapshotDependencyTests-1258217419 None] casted to osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae Nov 02 12:47:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-30d804f1-5f34-4451-be0a-d010e12dc14b tempest-SnapshotDependencyTests-1258217419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4 1073741824 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:33 devstack sudo[108276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4 1073741824 Nov 02 12:47:33 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:33 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-30d804f1-5f34-4451-be0a-d010e12dc14b tempest-SnapshotDependencyTests-1258217419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4 1073741824" returned: 0 in 0.401s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-30d804f1-5f34-4451-be0a-d010e12dc14b tempest-SnapshotDependencyTests-1258217419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:33 devstack sudo[108281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4 Nov 02 12:47:33 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:33 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-30d804f1-5f34-4451-be0a-d010e12dc14b tempest-SnapshotDependencyTests-1258217419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4" returned: 0 in 0.236s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:33 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-30d804f1-5f34-4451-be0a-d010e12dc14b tempest-SnapshotDependencyTests-1258217419 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'} {{(pid=86515) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 12:47:33 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-30d804f1-5f34-4451-be0a-d010e12dc14b tempest-SnapshotDependencyTests-1258217419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-30d804f1-5f34-4451-be0a-d010e12dc14b tempest-SnapshotDependencyTests-1258217419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a2d5c5-7a72-4f79-bee4-376eb7d4def5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6acdf02-756c-422f-bb75-bed4b19f46f4', 'volume_size': 1}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-30d804f1-5f34-4451-be0a-d010e12dc14b tempest-SnapshotDependencyTests-1258217419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9175c21b-763e-4751-b600-1e7c24f2448f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:33 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-30d804f1-5f34-4451-be0a-d010e12dc14b tempest-SnapshotDependencyTests-1258217419 None] Volume volume-e6acdf02-756c-422f-bb75-bed4b19f46f4 (e6acdf02-756c-422f-bb75-bed4b19f46f4): created successfully Nov 02 12:47:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-30d804f1-5f34-4451-be0a-d010e12dc14b tempest-SnapshotDependencyTests-1258217419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9175c21b-763e-4751-b600-1e7c24f2448f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:33 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-30d804f1-5f34-4451-be0a-d010e12dc14b tempest-SnapshotDependencyTests-1258217419 None] Flow 'volume_create_manager' (57f4b81e-2e0d-480d-b16f-19b6761dcd6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:47:33 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-30d804f1-5f34-4451-be0a-d010e12dc14b tempest-SnapshotDependencyTests-1258217419 None] Created volume successfully. Nov 02 12:47:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e3539cb4-d761-43ca-9a4a-9707d8a6e61f tempest-SnapshotDependencyTests-1258217419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e3539cb4-d761-43ca-9a4a-9707d8a6e61f tempest-SnapshotDependencyTests-1258217419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:34 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-e3539cb4-d761-43ca-9a4a-9707d8a6e61f tempest-SnapshotDependencyTests-1258217419 None] Creating offline snapshot 9e6418ec-7bb0-4d78-9d46-48f8f2b89401 of volume e6acdf02-756c-422f-bb75-bed4b19f46f4 {{(pid=86515) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 12:47:34 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[0366d1a2-7320-459f-9f10-f6a162315ed0]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e3539cb4-d761-43ca-9a4a-9707d8a6e61f tempest-SnapshotDependencyTests-1258217419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:34 devstack sudo[108284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4 Nov 02 12:47:34 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:34 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e3539cb4-d761-43ca-9a4a-9707d8a6e61f tempest-SnapshotDependencyTests-1258217419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4" returned: 0 in 0.337s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e3539cb4-d761-43ca-9a4a-9707d8a6e61f tempest-SnapshotDependencyTests-1258217419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4.9e6418ec-7bb0-4d78-9d46-48f8f2b89401 1G {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:34 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4.9e6418ec-7bb0-4d78-9d46-48f8f2b89401 1G Nov 02 12:47:34 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:34 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e3539cb4-d761-43ca-9a4a-9707d8a6e61f tempest-SnapshotDependencyTests-1258217419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4.9e6418ec-7bb0-4d78-9d46-48f8f2b89401 1G" returned: 0 in 0.361s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:34 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e3539cb4-d761-43ca-9a4a-9707d8a6e61f tempest-SnapshotDependencyTests-1258217419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6acdf02-756c-422f-bb75-bed4b19f46f4 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4.9e6418ec-7bb0-4d78-9d46-48f8f2b89401 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:34 devstack sudo[108295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6acdf02-756c-422f-bb75-bed4b19f46f4 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4.9e6418ec-7bb0-4d78-9d46-48f8f2b89401 Nov 02 12:47:34 devstack sudo[108295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:35 devstack sudo[108295]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e3539cb4-d761-43ca-9a4a-9707d8a6e61f tempest-SnapshotDependencyTests-1258217419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6acdf02-756c-422f-bb75-bed4b19f46f4 -F qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4.9e6418ec-7bb0-4d78-9d46-48f8f2b89401" returned: 0 in 0.282s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:35 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-e3539cb4-d761-43ca-9a4a-9707d8a6e61f tempest-SnapshotDependencyTests-1258217419 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4.9e6418ec-7bb0-4d78-9d46-48f8f2b89401 is being set with open permissions: ugo+rw Nov 02 12:47:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e3539cb4-d761-43ca-9a4a-9707d8a6e61f tempest-SnapshotDependencyTests-1258217419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4.9e6418ec-7bb0-4d78-9d46-48f8f2b89401 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:35 devstack sudo[108300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4.9e6418ec-7bb0-4d78-9d46-48f8f2b89401 Nov 02 12:47:35 devstack sudo[108300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:35 devstack sudo[108300]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e3539cb4-d761-43ca-9a4a-9707d8a6e61f tempest-SnapshotDependencyTests-1258217419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4.9e6418ec-7bb0-4d78-9d46-48f8f2b89401" returned: 0 in 0.234s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e3539cb4-d761-43ca-9a4a-9707d8a6e61f tempest-SnapshotDependencyTests-1258217419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:35 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4.info Nov 02 12:47:35 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:35 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e3539cb4-d761-43ca-9a4a-9707d8a6e61f tempest-SnapshotDependencyTests-1258217419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4.info" returned: 0 in 0.252s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:35 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-e3539cb4-d761-43ca-9a4a-9707d8a6e61f tempest-SnapshotDependencyTests-1258217419 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4.info is being set with open permissions: ugo+rw Nov 02 12:47:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e3539cb4-d761-43ca-9a4a-9707d8a6e61f tempest-SnapshotDependencyTests-1258217419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4.info {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:35 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4.info Nov 02 12:47:35 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:35 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-e3539cb4-d761-43ca-9a4a-9707d8a6e61f tempest-SnapshotDependencyTests-1258217419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4.info" returned: 0 in 0.235s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:35 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-e3539cb4-d761-43ca-9a4a-9707d8a6e61f tempest-SnapshotDependencyTests-1258217419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.788s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:36 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-e3539cb4-d761-43ca-9a4a-9707d8a6e61f tempest-SnapshotDependencyTests-1258217419 None] Create snapshot completed successfully Nov 02 12:47:36 devstack cinder-volume[86515]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86515) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1433}} Nov 02 12:47:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Flow 'volume_create_manager' (15c04c1f-7e3e-424a-870f-f72ec630b9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:47:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (891b6b27-8c30-4dd5-b867-4ed6836130c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (891b6b27-8c30-4dd5-b867-4ed6836130c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T11:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66a64997-9079-4cca-a3a5-e62dd765b00f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a3df04c3f5341f88861d56a15acea51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T11:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9e6418ec-7bb0-4d78-9d46-48f8f2b89401,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T11:47:37Z,use_quota=True,user_id='c30c2afaef6849acab8b2f819192a749',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23eccc7a-b1a0-4b34-949f-b73a360e9fec),volume_type_id=23eccc7a-b1a0-4b34-949f-b73a360e9fec)' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc7648b-198e-4022-9fbc-648fff3c89df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc7648b-198e-4022-9fbc-648fff3c89df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b5dce97-984d-42f7-a35b-e6c23d6ce848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b5dce97-984d-42f7-a35b-e6c23d6ce848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '66a64997-9079-4cca-a3a5-e62dd765b00f', 'volume_name': 'volume-66a64997-9079-4cca-a3a5-e62dd765b00f', 'volume_size': 1, 'snapshot_id': '9e6418ec-7bb0-4d78-9d46-48f8f2b89401'}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20994fc8-520d-48e0-b870-7534ac6ba7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20994fc8-520d-48e0-b870-7534ac6ba7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:36 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a226171-ebb0-44cd-ae8e-04228c28377c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:36 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Volume 66a64997-9079-4cca-a3a5-e62dd765b00f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-66a64997-9079-4cca-a3a5-e62dd765b00f', 'volume_size': 1, 'snapshot_id': '9e6418ec-7bb0-4d78-9d46-48f8f2b89401'} Nov 02 12:47:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:36 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Acquiring lock "cinder-quobyte-9e6418ec-7bb0-4d78-9d46-48f8f2b89401-66a64997-9079-4cca-a3a5-e62dd765b00f" by "_create_volume_from_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:36 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Lock "cinder-quobyte-9e6418ec-7bb0-4d78-9d46-48f8f2b89401-66a64997-9079-4cca-a3a5-e62dd765b00f" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Creating volume 66a64997-9079-4cca-a3a5-e62dd765b00f from snapshot 9e6418ec-7bb0-4d78-9d46-48f8f2b89401 {{(pid=86515) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 12:47:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Selected osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae as target Quobyte volume. {{(pid=86515) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 12:47:36 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Acquiring lock "cinder-quobyte-66a64997-9079-4cca-a3a5-e62dd765b00f" by "_copy_volume_from_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:36 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Lock "cinder-quobyte-66a64997-9079-4cca-a3a5-e62dd765b00f" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] snapshot: 9e6418ec-7bb0-4d78-9d46-48f8f2b89401, volume: 66a64997-9079-4cca-a3a5-e62dd765b00f, {{(pid=86515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 12:47:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:36 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:36 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:37 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[96281d39-c7f7-47ee-9698-f103037f87ce]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4.9e6418ec-7bb0-4d78-9d46-48f8f2b89401 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:37 devstack sudo[108309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4.9e6418ec-7bb0-4d78-9d46-48f8f2b89401 Nov 02 12:47:37 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:37 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4.9e6418ec-7bb0-4d78-9d46-48f8f2b89401" returned: 0 in 0.355s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:37 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6acdf02-756c-422f-bb75-bed4b19f46f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:47:37 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[55969edd-fac8-4c26-8f02-4dcbe55170f0]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:37 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4 Nov 02 12:47:37 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:37 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4" returned: 0 in 0.357s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:37 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] will copy from snapshot at /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4 {{(pid=86515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 12:47:37 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Creating direct copy from snapshot {{(pid=86515) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 12:47:37 devstack cinder-volume[86515]: DEBUG cinder.utils [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Path /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-66a64997-9079-4cca-a3a5-e62dd765b00f not found in is_blk_device check {{(pid=86515) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 12:47:37 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-66a64997-9079-4cca-a3a5-e62dd765b00f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:37 devstack sudo[108319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-66a64997-9079-4cca-a3a5-e62dd765b00f Nov 02 12:47:37 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:43 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-66a64997-9079-4cca-a3a5-e62dd765b00f" returned: 0 in 5.343s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:43 devstack cinder-volume[86515]: DEBUG cinder.image.image_utils [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Image conversion details: src /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4, size 1024.00 MB, duration 5.34 sec, destination /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-66a64997-9079-4cca-a3a5-e62dd765b00f {{(pid=86515) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 12:47:43 devstack cinder-volume[86515]: INFO cinder.image.image_utils [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Converted 1024.00 MB image at 191.61 MB/s Nov 02 12:47:43 devstack cinder-volume[86515]: WARNING cinder.volume.drivers.remotefs [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-66a64997-9079-4cca-a3a5-e62dd765b00f is being set with open permissions: ugo+rw Nov 02 12:47:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-66a64997-9079-4cca-a3a5-e62dd765b00f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:43 devstack sudo[108334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-66a64997-9079-4cca-a3a5-e62dd765b00f Nov 02 12:47:43 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:43 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-66a64997-9079-4cca-a3a5-e62dd765b00f" returned: 0 in 0.266s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:43 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Lock "cinder-quobyte-66a64997-9079-4cca-a3a5-e62dd765b00f" released by "_copy_volume_from_snapshot" :: held 6.397s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:43 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Lock "cinder-quobyte-9e6418ec-7bb0-4d78-9d46-48f8f2b89401-66a64997-9079-4cca-a3a5-e62dd765b00f" released by "_create_volume_from_snapshot" :: held 6.454s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.468s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a226171-ebb0-44cd-ae8e-04228c28377c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66a64997-9079-4cca-a3a5-e62dd765b00f', 'volume_size': 1, 'snapshot_id': '9e6418ec-7bb0-4d78-9d46-48f8f2b89401'}' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a107839b-9210-43ab-9b94-4077b2dd034d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 12:47:43 devstack cinder-volume[86515]: INFO cinder.volume.flows.manager.create_volume [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Volume volume-66a64997-9079-4cca-a3a5-e62dd765b00f (66a64997-9079-4cca-a3a5-e62dd765b00f): created successfully Nov 02 12:47:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a107839b-9210-43ab-9b94-4077b2dd034d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86515) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 12:47:43 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Flow 'volume_create_manager' (15c04c1f-7e3e-424a-870f-f72ec630b9b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86515) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 12:47:43 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-3dd5ed29-84f3-4668-bf3d-5f0a72538d2d tempest-SnapshotDependencyTests-1258217419 None] Created volume successfully. Nov 02 12:47:43 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:47:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:43 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:43 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:43 devstack sudo[108337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:47:43 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:44 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.230s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:44 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:47:44 devstack cinder-volume[86515]: DEBUG oslo_service.periodic_task [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] Running periodic task VolumeManager._thread_info {{(pid=86515) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 12:47:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread count: 28 {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 12:47:44 devstack cinder-volume[86515]: DEBUG cinder.volume.manager [None req-192ee081-0465-422a-81cc-a02e8f88adeb None None] thread info: [<_MainThread(MainThread, started 129944084402304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86515) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 12:47:44 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d8719949-acee-4d80-ba6f-2459000d22e2 tempest-SnapshotDependencyTests-1258217419 None] Acquiring lock "cinder-9e6418ec-7bb0-4d78-9d46-48f8f2b89401-delete_snapshot" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:44 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d8719949-acee-4d80-ba6f-2459000d22e2 tempest-SnapshotDependencyTests-1258217419 None] Lock "cinder-9e6418ec-7bb0-4d78-9d46-48f8f2b89401-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:44 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d8719949-acee-4d80-ba6f-2459000d22e2 tempest-SnapshotDependencyTests-1258217419 None] Acquiring lock "cinder-quobyte-e6acdf02-756c-422f-bb75-bed4b19f46f4" by "delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:44 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d8719949-acee-4d80-ba6f-2459000d22e2 tempest-SnapshotDependencyTests-1258217419 None] Lock "cinder-quobyte-e6acdf02-756c-422f-bb75-bed4b19f46f4" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:44 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d8719949-acee-4d80-ba6f-2459000d22e2 tempest-SnapshotDependencyTests-1258217419 None] Acquiring lock "cinder-quobyte-9e6418ec-7bb0-4d78-9d46-48f8f2b89401" by "_delete_snapshot" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:44 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d8719949-acee-4d80-ba6f-2459000d22e2 tempest-SnapshotDependencyTests-1258217419 None] Lock "cinder-quobyte-9e6418ec-7bb0-4d78-9d46-48f8f2b89401" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:44 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-d8719949-acee-4d80-ba6f-2459000d22e2 tempest-SnapshotDependencyTests-1258217419 None] Deleting offline snapshot 9e6418ec-7bb0-4d78-9d46-48f8f2b89401 of volume e6acdf02-756c-422f-bb75-bed4b19f46f4 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 12:47:44 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-d8719949-acee-4d80-ba6f-2459000d22e2 tempest-SnapshotDependencyTests-1258217419 None] snapshot_file for this snap is: volume-e6acdf02-756c-422f-bb75-bed4b19f46f4.9e6418ec-7bb0-4d78-9d46-48f8f2b89401 {{(pid=86515) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 12:47:44 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0f7f30-258d-4015-979c-e4a67cf86344]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d8719949-acee-4d80-ba6f-2459000d22e2 tempest-SnapshotDependencyTests-1258217419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4.9e6418ec-7bb0-4d78-9d46-48f8f2b89401 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:44 devstack sudo[108340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4.9e6418ec-7bb0-4d78-9d46-48f8f2b89401 Nov 02 12:47:44 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:44 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d8719949-acee-4d80-ba6f-2459000d22e2 tempest-SnapshotDependencyTests-1258217419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4.9e6418ec-7bb0-4d78-9d46-48f8f2b89401" returned: 0 in 0.375s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:44 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.remotefs [None req-d8719949-acee-4d80-ba6f-2459000d22e2 tempest-SnapshotDependencyTests-1258217419 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6acdf02-756c-422f-bb75-bed4b19f46f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86515) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 12:47:44 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[160e081b-468b-4a47-b702-db1d4a1bd6b0]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:44 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d8719949-acee-4d80-ba6f-2459000d22e2 tempest-SnapshotDependencyTests-1258217419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:44 devstack sudo[108345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4 Nov 02 12:47:44 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:45 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d8719949-acee-4d80-ba6f-2459000d22e2 tempest-SnapshotDependencyTests-1258217419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4" returned: 0 in 0.517s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d8719949-acee-4d80-ba6f-2459000d22e2 tempest-SnapshotDependencyTests-1258217419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4.9e6418ec-7bb0-4d78-9d46-48f8f2b89401 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:45 devstack sudo[108352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4.9e6418ec-7bb0-4d78-9d46-48f8f2b89401 Nov 02 12:47:45 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:45 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d8719949-acee-4d80-ba6f-2459000d22e2 tempest-SnapshotDependencyTests-1258217419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4.9e6418ec-7bb0-4d78-9d46-48f8f2b89401" returned: 0 in 0.322s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d8719949-acee-4d80-ba6f-2459000d22e2 tempest-SnapshotDependencyTests-1258217419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4.9e6418ec-7bb0-4d78-9d46-48f8f2b89401 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:45 devstack sudo[108358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4.9e6418ec-7bb0-4d78-9d46-48f8f2b89401 Nov 02 12:47:45 devstack sudo[108358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:45 devstack sudo[108358]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:45 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-d8719949-acee-4d80-ba6f-2459000d22e2 tempest-SnapshotDependencyTests-1258217419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4.9e6418ec-7bb0-4d78-9d46-48f8f2b89401" returned: 0 in 0.259s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:46 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d8719949-acee-4d80-ba6f-2459000d22e2 tempest-SnapshotDependencyTests-1258217419 None] Lock "cinder-quobyte-9e6418ec-7bb0-4d78-9d46-48f8f2b89401" released by "_delete_snapshot" :: held 1.579s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:46 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d8719949-acee-4d80-ba6f-2459000d22e2 tempest-SnapshotDependencyTests-1258217419 None] Lock "cinder-quobyte-e6acdf02-756c-422f-bb75-bed4b19f46f4" released by "delete_snapshot" :: held 1.604s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:46 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-d8719949-acee-4d80-ba6f-2459000d22e2 tempest-SnapshotDependencyTests-1258217419 None] Created reservations ['ee957c67-264c-43eb-8afe-f22a7d10605b', '8b63b7d5-2d87-4990-ae16-e2a2434f3c5a', '179106ac-baf1-4d79-8212-6de497f43868', '020afb07-2af5-4b09-a809-616e2e9bcba5'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:47:46 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-d8719949-acee-4d80-ba6f-2459000d22e2 tempest-SnapshotDependencyTests-1258217419 None] Delete snapshot completed successfully. Nov 02 12:47:46 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-d8719949-acee-4d80-ba6f-2459000d22e2 tempest-SnapshotDependencyTests-1258217419 None] Lock "cinder-9e6418ec-7bb0-4d78-9d46-48f8f2b89401-delete_snapshot" released by "delete_snapshot" :: held 1.746s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:46 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-fc74634c-b81e-4e57-81ce-a57e36412e1c tempest-SnapshotDependencyTests-1258217419 None] Acquiring lock "cinder-e6acdf02-756c-422f-bb75-bed4b19f46f4-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:46 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-fc74634c-b81e-4e57-81ce-a57e36412e1c tempest-SnapshotDependencyTests-1258217419 None] Lock "cinder-e6acdf02-756c-422f-bb75-bed4b19f46f4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:46 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-fc74634c-b81e-4e57-81ce-a57e36412e1c tempest-SnapshotDependencyTests-1258217419 None] Acquiring lock "cinder-quobyte-e6acdf02-756c-422f-bb75-bed4b19f46f4" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:46 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-fc74634c-b81e-4e57-81ce-a57e36412e1c tempest-SnapshotDependencyTests-1258217419 None] Lock "cinder-quobyte-e6acdf02-756c-422f-bb75-bed4b19f46f4" acquired by "delete_volume" :: waited 0.015s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:46 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[161b716f-b661-4a7e-ba50-ab30de6609f5]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:46 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fc74634c-b81e-4e57-81ce-a57e36412e1c tempest-SnapshotDependencyTests-1258217419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:46 devstack sudo[108400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4 Nov 02 12:47:46 devstack sudo[108400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:47 devstack sudo[108400]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fc74634c-b81e-4e57-81ce-a57e36412e1c tempest-SnapshotDependencyTests-1258217419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4" returned: 0 in 0.350s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fc74634c-b81e-4e57-81ce-a57e36412e1c tempest-SnapshotDependencyTests-1258217419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4 {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:47 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4 Nov 02 12:47:47 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:47 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fc74634c-b81e-4e57-81ce-a57e36412e1c tempest-SnapshotDependencyTests-1258217419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-e6acdf02-756c-422f-bb75-bed4b19f46f4" returned: 0 in 0.264s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:47 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-fc74634c-b81e-4e57-81ce-a57e36412e1c tempest-SnapshotDependencyTests-1258217419 None] Lock "cinder-quobyte-e6acdf02-756c-422f-bb75-bed4b19f46f4" released by "delete_volume" :: held 0.681s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:47 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-fc74634c-b81e-4e57-81ce-a57e36412e1c tempest-SnapshotDependencyTests-1258217419 None] Created reservations ['bd08fe9f-fc0d-4205-ad6c-dd240d292c40', '67e9a2e0-e5f6-4c4d-9c6d-7a880cf92865', '8f789b22-53c9-4d90-b943-23e780651962', '1d420944-7f88-45f5-8a72-0ea491b2034e'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:47:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fc74634c-b81e-4e57-81ce-a57e36412e1c tempest-SnapshotDependencyTests-1258217419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fc74634c-b81e-4e57-81ce-a57e36412e1c tempest-SnapshotDependencyTests-1258217419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:47 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-fc74634c-b81e-4e57-81ce-a57e36412e1c tempest-SnapshotDependencyTests-1258217419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:47 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-fc74634c-b81e-4e57-81ce-a57e36412e1c tempest-SnapshotDependencyTests-1258217419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-fc74634c-b81e-4e57-81ce-a57e36412e1c tempest-SnapshotDependencyTests-1258217419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fc74634c-b81e-4e57-81ce-a57e36412e1c tempest-SnapshotDependencyTests-1258217419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:47 devstack sudo[108411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:47:47 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:47 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-fc74634c-b81e-4e57-81ce-a57e36412e1c tempest-SnapshotDependencyTests-1258217419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.243s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:47 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-fc74634c-b81e-4e57-81ce-a57e36412e1c tempest-SnapshotDependencyTests-1258217419 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:47:47 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-fc74634c-b81e-4e57-81ce-a57e36412e1c tempest-SnapshotDependencyTests-1258217419 None] Deleted volume successfully. Nov 02 12:47:47 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-fc74634c-b81e-4e57-81ce-a57e36412e1c tempest-SnapshotDependencyTests-1258217419 None] Lock "cinder-e6acdf02-756c-422f-bb75-bed4b19f46f4-delete_volume" released by "delete_volume" :: held 1.132s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:47 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f87e2508-f495-431c-85ac-3bf0e8002959 tempest-SnapshotDependencyTests-1258217419 None] Acquiring lock "cinder-66a64997-9079-4cca-a3a5-e62dd765b00f-delete_volume" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:47 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f87e2508-f495-431c-85ac-3bf0e8002959 tempest-SnapshotDependencyTests-1258217419 None] Lock "cinder-66a64997-9079-4cca-a3a5-e62dd765b00f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:47 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f87e2508-f495-431c-85ac-3bf0e8002959 tempest-SnapshotDependencyTests-1258217419 None] Acquiring lock "cinder-quobyte-66a64997-9079-4cca-a3a5-e62dd765b00f" by "delete_volume" {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 12:47:47 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f87e2508-f495-431c-85ac-3bf0e8002959 tempest-SnapshotDependencyTests-1258217419 None] Lock "cinder-quobyte-66a64997-9079-4cca-a3a5-e62dd765b00f" acquired by "delete_volume" :: waited 0.014s {{(pid=86515) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 12:47:47 devstack cinder-volume[86515]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1d0cce-a51e-45af-985b-27367f3b962e]: (4, 'qcow2') {{(pid=88866) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 12:47:47 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f87e2508-f495-431c-85ac-3bf0e8002959 tempest-SnapshotDependencyTests-1258217419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-66a64997-9079-4cca-a3a5-e62dd765b00f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:47 devstack sudo[108414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-66a64997-9079-4cca-a3a5-e62dd765b00f Nov 02 12:47:47 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:48 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f87e2508-f495-431c-85ac-3bf0e8002959 tempest-SnapshotDependencyTests-1258217419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-66a64997-9079-4cca-a3a5-e62dd765b00f" returned: 0 in 0.349s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f87e2508-f495-431c-85ac-3bf0e8002959 tempest-SnapshotDependencyTests-1258217419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-66a64997-9079-4cca-a3a5-e62dd765b00f {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:48 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-66a64997-9079-4cca-a3a5-e62dd765b00f Nov 02 12:47:48 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:48 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f87e2508-f495-431c-85ac-3bf0e8002959 tempest-SnapshotDependencyTests-1258217419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db/volume-66a64997-9079-4cca-a3a5-e62dd765b00f" returned: 0 in 0.247s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:48 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f87e2508-f495-431c-85ac-3bf0e8002959 tempest-SnapshotDependencyTests-1258217419 None] Lock "cinder-quobyte-66a64997-9079-4cca-a3a5-e62dd765b00f" released by "delete_volume" :: held 0.636s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:48 devstack cinder-volume[86515]: DEBUG cinder.quota [None req-f87e2508-f495-431c-85ac-3bf0e8002959 tempest-SnapshotDependencyTests-1258217419 None] Created reservations ['30ce6df9-abf2-4e29-91e0-7d158aecd09b', '50f1d87a-6d78-4e0e-a105-b3fbc8eaaf75', '062d1da0-2a41-44a6-8582-7a0e31fd5e04', 'fd878fd3-e214-449c-a8a8-4f329ff6164d'] {{(pid=86515) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 12:47:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f87e2508-f495-431c-85ac-3bf0e8002959 tempest-SnapshotDependencyTests-1258217419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 12:47:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f87e2508-f495-431c-85ac-3bf0e8002959 tempest-SnapshotDependencyTests-1258217419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 12:47:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f87e2508-f495-431c-85ac-3bf0e8002959 tempest-SnapshotDependencyTests-1258217419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae': None} {{(pid=86515) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 12:47:48 devstack cinder-volume[86515]: DEBUG cinder.volume.drivers.quobyte [None req-f87e2508-f495-431c-85ac-3bf0e8002959 tempest-SnapshotDependencyTests-1258217419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7ea2acbb-7456-4c89-af8b-7b40ed6639ae'] {{(pid=86515) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 12:47:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.lockutils [None req-f87e2508-f495-431c-85ac-3bf0e8002959 tempest-SnapshotDependencyTests-1258217419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86515) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 12:47:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f87e2508-f495-431c-85ac-3bf0e8002959 tempest-SnapshotDependencyTests-1258217419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 12:47:48 devstack sudo[108422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db Nov 02 12:47:48 devstack sudo[108422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 12:47:48 devstack sudo[108422]: pam_unix(sudo:session): session closed for user root Nov 02 12:47:48 devstack cinder-volume[86515]: DEBUG oslo_concurrency.processutils [None req-f87e2508-f495-431c-85ac-3bf0e8002959 tempest-SnapshotDependencyTests-1258217419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/85def7cf853c6bf449db76d801e000db" returned: 0 in 0.225s {{(pid=86515) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 12:47:48 devstack cinder-volume[86515]: DEBUG cinder.manager [None req-f87e2508-f495-431c-85ac-3bf0e8002959 tempest-SnapshotDependencyTests-1258217419 None] Notifying Schedulers of capabilities ... {{(pid=86515) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 12:47:48 devstack cinder-volume[86515]: INFO cinder.volume.manager [None req-f87e2508-f495-431c-85ac-3bf0e8002959 tempest-SnapshotDependencyTests-1258217419 None] Deleted volume successfully. Nov 02 12:47:48 devstack cinder-volume[86515]: DEBUG cinder.coordination [None req-f87e2508-f495-431c-85ac-3bf0e8002959 tempest-SnapshotDependencyTests-1258217419 None] Lock "cinder-66a64997-9079-4cca-a3a5-e62dd765b00f-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=86515) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 12:47:58 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:UPDATE=34,cinder:SELECT=24,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 12:47:58 devstack cinder-volume[86515]: DEBUG dbcounter [-] [86515] Writing DB stats cinder:SELECT=25,cinder:UPDATE=24,cinder:INSERT=7,cinder:DELETE=3 {{(pid=86515) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}